A Simple Kafka and Python Walkthrough

Getting data into Apache Kafka is easy if you know how, so let's go through an example step-by-step. In this walkthrough we take you through the process of creating a simple Kafka Producer using the Quix Streams library.
📥 Clone, fork or star the source code: github.com/quixio/simple-kafk...
--
0:00 Introduction
0:29 Setting up a Python Environment
1:10 Fetching some JSON
3:30 Writing it into Kafka
7:40 Job Done! Let's extend it...
10:07 kcat as a debugging tool
10:58 Next steps...

[@zedzpan]

Thank you for this. It was incredibly easy to follow.

[@chinyerenwigwe5166]

You just got a new subscriber!!! Simple andl understandable

[@souravbarua3991]

Thank you🙏 for this video. Much needed. Please keeps coming this type of tutorial videos of kafka python with quixstreams. Please do make video on making dataframe with quixstreams (next level or say continuation of this video)

[@QuixStreams]

Will do! Stay tuned, there's a video like that planned for this month. :-)

[@TheAremoh]

Subscribed, liked and notification turned on. Great video ❤

[@TheMrSnuSnu]

Really good design patterns, thanks for the tutorial

[@shehanreshin]

Love your teaching style

[@QuixStreams]

Thank you!

[@jesusjar11]

Wonderful! I dont do any python nor kafka, but surely its entertaining watching setting up a project from the ground up : )

[@QuixStreams]

Thank you! Glad you enjoyed it.

[@steverosam1265]

Thanks. Love this

[@dreamyangel1858]

Neat video

[@ipelezikis]

Nice! I didnt know this library. Any advantages/disadvantages over confluent-kafka and kafka-python?

[@krisajenkins]

The big advantage is stream processing. All three libraries support producers and consumers, quixstreams also adds in Kafka Streams-style processing. If you ever need to write the kind of code that reads from one topic and writes to another, that's a huge addition. (There's a new video coming out later today that showcases the stream-processing part of the library. 🥳) For the producer/consumer side, quixstreams is actually using confluent-kafka under the hood, and exposes all the same options, so it's basically a superset of that library. Kafka-Python's big advantage is that it's native Python. Both quixstreams and confluent-kafka wrap the C client, librdkafka. That may be an important factor to you. Though given how good Python wheel support is these days, it's not as big a deal as it used to be. 🤷‍♂

[@CrypticConsole]

why use this over kafka-python or confluent-kafka-python?