Efe Omoregie
Associate Staff Engineer at Yellowcard Financial
Efe Omoregie is an Associate Staff Engineer at Yellow Card, where he builds AI applications and leads fintech projects. With nearly a decade of software engineering experience, he has worked on payment systems, healthcare platforms, and cloud infrastructure.
Previously, Efe led payment integrations at Yellow Card, scaling fiat payment rails across 20+ countries, and held engineering roles at GeroCare, Skooleeo and Code4TEEN.
He holds a Master’s degree in Information Technology from the University of Lagos, a Bachelor’s degree in Computer Science, and a Diploma in Networking and System Security from Benson Idahosa University.
Abstract
Background jobs power some of the most critical parts of modern applications: sending emails, processing payments, generating reports, running ML pipelines, and synchronising external services, etc. While the initial setup is often simple, scaling these systems introduces a range of reliability challenges. </br> In this talk, we’ll explore common failure modes that appear as Python worker systems grow: retry storms, job duplication, long-running tasks blocking queues, and cascading failures when downstream services slow down. Drawing from real production lessons, we’ll examine patterns that make background job systems more resilient. </br> The session will cover techniques such as designing idempotent jobs, handling retries safely, preventing queue congestion, and monitoring worker health. We’ll also discuss architectural considerations around task queues, worker isolation, and backpressure management. </br> By the end of the talk, attendees will understand strategies for designing background job systems that remain reliable as workloads scale.