Apache Kafka Crash Course - Part 1

[@ThePomelo09]

your content is the best of youtube, many Thanks

[@ByteMonk]

Appreciate the kind words, glad you're enjoying the content!

[@satishkumar-vo1kv]

Thanks alot for the eloborated video. Waiting for the next one.

[@sjsh3hee815]

was looking for this, Thanks for the upload

[@alirezahaghi2812]

where is the second part after 7 months?

[@parthsolanki7878]

I like your explanation style. Would be great if you can create a video on Kafka's zero copy. Thanks.

[@mahendragundeti]

Thanks for sharing kafka video. we are using msk from aws and we are migrating data to other mks graviton cluster using mirrormaker2 but we are facing issue with offset translation issue as offset is not translating to new cluster even after using connectors. if you have experience in this can you suggest any solutions.

[@ByteMonk]

This is a common problem, and there can be multiple reasons, I can think of few here, but you should first start with double checking the logs, version compatibility, and configurations. 1. You may first like to examine the MirrorMaker2 logs for any errors related to consumer group offsets or offset translation. These logs might provide clues about the root cause. 2. Ensure you have enabled automated consumer offset sync in MirrorMaker2. Starting with Apache Kafka 2.7, this is achieved by setting sync.group.offsets.enabled and emit.checkpoints.enabled properties to true in your configuration. This allows MM2 to translate and synchronize offsets during data replication. 3. Also verify that MirrorMaker2 is creating the consumer group on the destination cluster. If you've pre-created the group with a different ID, it might lead to offset translation issues 4. If you're using a custom replication policy, double-check its configuration for handling consumer group offsets. Ensure it's designed to translate offsets from the source to the destination cluster. Good luck!

[@indraalapati989]

This session is helpful and looking for next part. I have question about consumer, is the consumer an end client ? Let's take Uber as an example, where the ride requestor wants to know the position of a driver and the position of a driver is streamed to a kafka broker and end user is subscribed to that broker. Can we assume the ride requestor who is the end client as a consumer ?

[@i.vigneshdavid1698]

Waiting for the next part

[@pavanbadsha]

Can u create a topic on click or journey tracking for mobile and web applications where there are different journeys

[@rahul_singh_rajput3292]

waiting for the real world example 🤝