Arnold Ighiwiyisi
Senior Data Scientist and MLOps Engineer at Interswitch Group
I am a professional Data Scientist and Machine Learning Engineer committed to delivering high-impact data-driven solutions for businesses. My experience spans building data-driven products for health tech, fintech, Anti-money Laundry (AML), and KYC/KYB.
3rd Place Winner of AI commons Health and well-being Hackathon. Proficient in a range of technology such as Deep Learning, computer vision, Natural Language Processing, Python, FastApi, Flask, SciPy, Scikit-learn, PyTorch, TensorFlow, and MLOp.
I have led and spoken at severally communities focused on peer-to-peer learning and knowledge sharing including Data Science Nigeria, Bitgrit Inc. Japan, Codeln, AI summer of code, and PyCon Nigeria. I am committed to knowledge sharing and social good.
Abstract
Running GPU-powered ML inference in production is notoriously hard — you either pay for idle GPU hours, wrestle with CUDA driver hell, or hit cold-start walls that make your model unusable at scale. For African developers and startups, expensive cloud GPU reservations can be a showstopper before you even ship a demo. This talk walks through how serverless GPU inference with Modal solves this problem: you write pure Python, define your container and GPU requirements as code, and only pay for the milliseconds your inference actually runs. This talk will cover my experience building serverless GPU inference engine for low-resource language and low-budget inference engine. During this talk we will build a fully functional image-generation, transcription inference with Whisper and LLM inference service live on stage — deploying a Stable Diffusion pipeline, transcription service with modal and a quantized LLaMA model from scratch, with cold-start optimizations, batching, and autoscaling — all within a free-tier budget. You'll leave with a working template, a mental model for GPU-first Python design, and the confidence to ship ML-powered APIs without owning a single GPU.