Moses profile picture

Moses Daudu

AI Engineer at Path

AI engineer focused on building scalable, production-ready systems that solve real-world problems. At
YourPath, I developed question and image generation platform APIs from scratch, enabling the creation
of over 20,000 exams across SAT, ACT, GRE, LSAT, CompTIA, and more. I specialize in LLMs,
Generative AI, and multimodal systems, combining research innovation with engineering excellence.
Passionate about pushing the frontiers of AI, mentoring upcoming talent, and contributing to
open-source AI projects that drive broader industry growth.

Abstract

Python at Scale: A Practical Guide to Serving 1 Million Users with FastAPI and Flask

Every Python developer has heard it: "Python is too slow to scale." This belief drives teams to premature rewrites in Go, Rust, or Java burning months of engineering time on a problem they don't actually have. The myth persists because people confuse raw execution speed benchmarks with real-world application scalability. I will walk through three pillars of evidence and practice: 1. Production Proof (5 min) Real companies, real numbers. Instagram handles 2 billion monthly users on Django with tens of thousands of Python servers. Spotify processes 600 million+ users with Python powering 80% of backend services. Pinterest scaled to 100 million users on a Flask + Gunicorn + gevent stack. I will also reference relevant examples from the African tech ecosystem, including how Python-heavy architectures support platforms like Paystack and Andela at continental scale. 2. Framework Deep Dive: FastAPI vs Flask (10 min) A technical comparison of how each framework handles concurrency at scale: - FastAPI: async/await with uvloop, asyncpg for 10x database throughput over synchronous drivers, native WebSocket support, and how a single worker handles 10,000+ concurrent connections - Flask: process-level parallelism with Gunicorn + gevent, the worker formula (2 × cores + 1), Flask 2.0+ async support, and when to consider Quart for ASGI - Honest benchmark analysis: FastAPI achieves 15,000-20,000 RPS for simple endpoints vs Flask's 2,000-5,000 — but the gap compresses dramatically with real database queries 3. The Scaling Architecture Blueprint (10 min) A concrete, reproducible architecture for serving 1 million concurrent users: - Horizontal scaling with Kubernetes: 100-200 pods behind a load balancer - Caching strategy: Redis for sessions and hot data, CDN for static assets (offloading 60-80% of traffic) - Async task processing: Celery + RabbitMQ for background work (6x throughput over synchronous processing) - Database optimization: connection pooling with PgBouncer, read replicas, choosing the right driver - The real cost: estimated $15,000-50,000/month cloud spend — far cheaper than a full rewrite 4. Why the GIL Doesn't Matter (and What's Changing) (3 min) A clear explanation of why the Global Interpreter Lock is irrelevant for I/O-bound web applications, how multi-process deployment bypasses it entirely (this is exactly what Instagram does), and a forward look at Python 3.13+ free-threaded builds that showed 82% improvement for multi-threaded workloads. 5. Actionable Takeaways (2 min) Five things every Python developer can do immediately to improve their application's scalability — no infrastructure overhaul required. Who Should Attend Backend developers, DevOps engineers, and technical leads who build or maintain Python web applications and want to understand how to scale them confidently. You should be comfortable with Python and have basic familiarity with web frameworks, but no prior scaling experience is needed. What Attendees Will Walk Away With - A data-backed counterargument to "Python doesn't scale" - A clear mental model for why framework speed matters less than architecture design - A reusable scaling architecture blueprint for FastAPI and Flask - Concrete optimization techniques they can apply immediately - Confidence to choose Python for their next high-scale project

Short Talk Intermediate