
Building a Realtime Data Capture Stream

By Ahmad Bilesanmi
Software Engineer at Complete FarmerAbstract:
We dive deep into the Change Data Capture (CDC) world and how it can be implemented for real-time data streaming using a powerful tech stack. You will use technologies like Docker, Postgres, Debezium, Kafka, Apache Spark, and Slack to create an efficient and responsive data pipeline. We learn how to containerize our pipeline using Docker. We would also learn how to get notified when changes are made to our database using Debezium. This tutorial is intermediate level. Participants are expected to have good Python, databases, and SQL knowledge.
GO BACK
Other Talks
-
-
Getting into AI for solving problems in Agriculture in Africa
by Daniel Samuel Etukudo -
How Many Wings does the Giraffe Have? - Hallucinations in MLLMs
by Johannes Kolbe -
-
Automate Your Life with Python Scripts
by Zaynab Awofeso
