Kafka Consumers in Python - A Walkthrough

Getting data out of Apache Kafka is easy if you know how, so let's go through an example step-by-step. In this walkthrough we take you through the process of creating a simple Kafka Consumer using the Quix Streams library.
📥 Clone, fork or star the source code: github.com/quixio/simple-kafk...
📺 Watch the producer-side walkthrough: • A Simple Kafka and Pyt...
--
0:00 Intro & Setup
0:47 Connecting & Subscribing
3:15 Reading the Messages
8:13 A Little Refactoring
8:55 We Could Stop There...
9:10 Offset Management
13:08 Recap and Reflect
13:45 Until Next Time...

[@vincentchong6005]

OMG. I actually understand what you are talking about! Thank you sir.

[@michaelslavev]

This is briliantly explained. As a kafka admin of multiple cluster, we are now bit scared of multiple teams trying to implement consumers and producers by themself because of poor offset management. I should make some Python/JS/Java examples! Thanks.

[@JacobChencha]

I came to learn Kafka, learnt that and how to write great python code!!

[@souravbarua3991]

Great video. Waiting for this and upcoming videos. Thank you for this tutorial series 🙏.

[@krisajenkins]

Glad you're enjoying it. We have quite a few planned, but if there's anything in particular you're interested in seeing, let me know. :-)

[@souravbarua3991]

@@krisajenkins For now I am learning from you. Eagerly waiting for next step/videos.Thank you again for this tutorial series🙏.

[@samable9585]

fantastic! will have to watch your other videos - thank again!

[@radoniainarakotonirina2856]

Nice vids 🎉

[@dailypakaffairs2590]

Really a great video. I was waiting for such masterpiece on kafka with python, can't find any before. Can you also make a video on how to add a notifier_consumer (may it through email or something). Also consider configuring Kong with kafka.

[@steverosam1265]

Another great video Kris

[@krisajenkins]

Thanks! 🙂

[@munishkhatri33]

Which code editor are u using in this video ?

[@krisajenkins]

It’s Neovim. 👍

[@munishkhatri33]

@krisajenkins Thanks, I tried to install it, but it doesn't give type hints as I saw in your video. Any plugins required for that?

[@krisajenkins]

@@munishkhatri33 Ah yeah, takes a little configuration. `nvim-lspconfig` is what you need, but if I were you I'd start with the Neovim Kickstart project. It's a default config which will set up lsp for you, plus a lot more.

[@krisajenkins]

(I'd put a link to it, but every time I do, KZbin auto-deletes my comment. Google will guide you to it. 👍)