Building a Realtime Data Capture Stream


Building a Realtime Data Capture Stream

  • General Python, Web/DevOps
  • Tutorial
  • Intermediate
  • Image Description

    By Ahmad Bilesanmi

    Software Engineer at Complete Farmer

    Abstract:

    We dive deep into the Change Data Capture (CDC) world and how it can be implemented for real-time data streaming using a powerful tech stack. You will use technologies like Docker, Postgres, Debezium, Kafka, Apache Spark, and Slack to create an efficient and responsive data pipeline. We learn how to containerize our pipeline using Docker. We would also learn how to get notified when changes are made to our database using Debezium. This tutorial is intermediate level. Participants are expected to have good Python, databases, and SQL knowledge.


    GO BACK
    Image Description