Apache Kafka® Components & Architecture Detailed Explanation in 15 min | Javatechie

[@karthikreddymarthala1434]

i am using kafka in my current project without knowing any knowledge. i have observed the offset, consumer,cluster and partitions words in the console and i thought where these words are in my project. after the watching this video i clearly understand about these components, Thank you bro for your clear explanation

[@subhashjha936]

Thank you for starting the Kafka series and I am eagerly waiting for more videos on this topic..🙂🙂👍👍

[@rajkumarwinc9372]

Finally.... I learnt kafka😊 thanks Basant ❤

[@raghuvardhansaripalli9636]

Mega star is back with high voltage Kafka action.. All of us are Waiting here for upcoming videos .. God bless you Basant !!:)

[@Javatechie]

Thanks Raghu . Mega star 🤣 i am planning for this weekend but getting enough time. After March i will actively post as my first spring boot microservice The live course will be complete .

[@punyabikash3624]

Excellent sir i was crying 😢 earlier thinking that it would be difficult topic...how easily you explained thanks a lot for this video....

[@Javatechie]

Thanks punya . Keep learning 😃

[@vengateshan7800]

Yes.... they way explanation with real time examples is awesome and easily understandable..

[@lolitaad19]

Me too

[@maciejmaciek2967]

Bro you are the most understandeble Indian tech guy on the world:) !

[@Javatechie]

Thank you so much buddy for your word 🥰. Keep learning

[@vengateshan7800]

This tutorial really very helpful to understand from base architecture and its explained each component as easily understandable. Thank you so much and post more videos.

[@ramakrishna-jm4lc]

Excellent, Simplified well Thank you Java Techie

[@pooovibes7966]

Superb sir… this is like life saver..keep going and giving us this kind of quality product.😊

[@uttam4alltech114]

thanks for sharing the kafka series , could you please share or create knowledge on DLQ . dead letter queue implementation in spring boot

[@Javatechie]

Yes i will

[@manu27161]

Excellent explanation, explaining in simple way with realistic examples

[@rameshbabub5243]

Excellent and easy to understand, thanks for making this series

[@rishabhshukla5199]

one of the best explanations, thank you.

[@umeshsharma2883]

Very creative and helpful video anyone can understand. I went through many articles and videos, and I was very confused, and my thought was Kafka is very big and very vast. But by watching this video I am full cleared on Kafka concepts.

[@grrlgd3835]

Nice work JT - again ! really appreciate these. Perfect

[@suryaprakash-u9n]

Awesome tutorial , thanks much for clear and short way explination

[@DebasisMahapatra-t4n]

very creative and informative video

[@kalaiselvankesavel2971]

I am a big fan of you buddy ❤The way you explain with example even a fresh mind will be expert of the topic . Kudos to you.

[@Javatechie]

Thank you so much buddy 😊. Keep learning

[@senbagasundareswaranmuruga6396]

Loved it, thanks for such core details on Kafka.

[@sudhanshusemwal-hg6sc]

Thanks java techie for crisp and clear explanation

[@devireddyfavreddy4785]

Very well explained and I worked on Solace it’s also same as like Kafka

[@jasper5016]

As always, great content brother. Thanks so much.

[@zahidhasankhan5762]

Nice presentation and understanding about KAFKA

[@vaibhavmanwatkar534]

Thanks for such detailed videos. Great job.

[@CodeWithAqeel]

Top-notch Explanation. Loved It.

[@sureshmanne7245]

As usual default like to your videos from me always, keep going

[@akshayengineer2018]

Thanks again for next part 👏...

[@HarshSingh-ly8mw]

Most awaited videos sir 😍

[@beaumontmuni4294]

Awesome! Thanks for sharing. 👍

[@rajondas5551]

Great for beginners

[@sutirthabrahmachari6387]

amazing explainations and presentation

[@muhammadsidheek2994]

very informative video ,good job👍👍

[@db-channel2023]

Nicely explained😊

[@chandrashekarkambalapally1087]

Superb Brother 👍🏻👍🏻👍🏻👍🏻

[@kvsm123]

Great video. Thank you.

[@carlpei6570]

Thanks ..very good playlist

[@raghuvardhansaripalli9636]

Hi Basant, after this Kafka series could you please create knowledge sessions on SPARK. And integrating kafka with spark using spring boot by creating a data pipeline. thanks

[@Piddie]

Very good explanation!

[@Breakdownsmth]

Tech, you touch, it becomes interesting❤️

[@muralidhuli9900]

nice bro . Great explanation

[@sharmarahul17]

Excellent explanation 👌

[@saurabhsuman4960]

Easy to understand and keeps my interest up. Thanks I have one request, can u please make a detailed video on " techniques to get addictions to learning forever" After 11 years I feel like losing interest in learning new and also deep learning. I have seen the same for experienced IT person in different companies I have worked. It's a humble request 🙏

[@Javatechie]

Thank you 😊. Noted ✅️ your point

[@saurabhsuman4960]

Thanks ​@@Javatechie ❤

[@anuragsekhri2315]

Well explained

[@gulraizjaved147]

very nice explaination brother.

[@itsnarahari]

Great and clean explanation bro

[@viki.04677]

Great session with presentation 👏

[@test-nature]

Great efforts

[@BhaaRaThh]

Really great 👍

[@mohanr8009]

Great quality content 👍

[@divakarpandey9094]

Thanku yuh sir you've been a great help!!❤

[@dearsikandarkhan]

Well articulated.

[@bharathr5223]

Super explanation

[@bhaumikpatel5932]

Waiting for it.. thanks sir

[@yogeshy7736]

Thnks for sharing

[@rajthakkar0071]

Quick question : if there are two systems or application who is working as consumer and producer , how consumer knows that they need to create multiple consumer for consuming from multiple kafka partitions ? how to specify those in real world projects when desiging kafka clusters ? Can you please make a video on designing kafka clusters ?

[@Amitkumarswain-ud1gx]

How many consumer group needs to be created that totally depends on requirements of consumer application.let a scinario we have kafka topic and consumer application wants to get all the messages in all env then they create 3 consumer group .

[@bugrae9341]

Easy and strong explained as usual thanks a lot man keep go on :)

[@2RAJ21]

Thank you

[@cnaresh6930]

Thank you so much

[@samsameer3214]

thank you sir

[@sameergupta675]

The Best!:)

[@tusharfasate7388]

Suppose,there is a topic which has 5 partitions and one partition's broker dies,in that case,there will be data loss and that why we use replication factor which keeps back up on each partition on other broker

[@sachinpete4507]

We have right to send the msg on which partition as i have read from kafka. In case you doesn't specify it will works as round robin. Please make the note of this. Thank you for video

[@Javatechie]

Yes absolutely correct. It's in my queue and will upload soon

[@YtAmar000]

Thank you❤

[@surajmahato2557]

Could you please frequently upload the videos for this series

[@raghavendrapatil659]

Query: 13:17" videos shows figure of multiple partitions within a topic and messages in it. Here squence number are specific to partition or topic ?

[@Javatechie]

To partition

[@rushikeshpangare9917]

Thank you for the information. When the next video will come.

[@Javatechie]

In the coming days i will upload . Most probably before coming weekend

[@bapssampshort]

Comment for support your work

[@Javatechie]

Thanks buddy

[@ronakagarwal8934]

After consumer listening messages from partitions , Are messages got deleted ? If YES then what is the work of offset value there .. Suppose Consumer read 4 messages so offset val is 3 and consumer is down foe a while. Now as Consumer is back to life he will again read the messages from offset+1 value which is 4. But partition only have messages from 4 , right? because 0-3 are already consumed by consumer and got deleted.

[@afuadanquah836]

Java Techie, I love your videos. When is your next video? I am eagerly waiting.

[@Javatechie]

Afun thanks for your interest. Occupied with lots of work so please expect a bit of a delay on the Kafka series

[@charmbracelets]

@@Javatechie Thanks for the response and all the best.

[@AmlandeepNandi]

Hi Basant, if possible can you make a video on how consumer is related to offset commit. Kindly explain the auto and manual commit. Thank you in advance.

[@Javatechie]

Sure buddy it's a good point to discuss. Thanks

[@VenkatBujjam]

PLEASE DO THE VIDEO ON REACTIVE KAFKA FOR PUB AND SUB

[@shilpasingla1739]

Hi Basant..here you have considered employee and payment topic separately..what if we want payment information of an employee...are we going to create new topic(having emp-payment) info and emp-payment table also?

[@Javatechie]

It depends on your business to decide the payload structure per topic . To simplify the purpose of the topic i have explained this scenario

[@alokdeo123]

@javatechie I have one confusion. Does all the partitions under one topic have the same messages or does each partition have different messages. If the same messages then a storage issue will come and if different messages then if partition goes down or corrupts we will lose the message

[@Javatechie]

No message won't be duplicated across partition

[@itsnarahari]

Please cover all the components in upcoming videos by practical

[@YtAmar000]

Thanks❤🌹🙏

[@venkateswararao2142]

How Kafka will relate with mainframe and MQ?

[@neha6000]

When will Kafka stream start ..?

[@Javatechie]

Neha will go from beginner level step by step it will take time to reach on stream part

[@neha6000]

@@Javatechie okay sir I will eagerly waiting for your videos I hope they will upload soon

[@santoshkamat6132]

Bro make video where we have to re trigger event in case where consumer logic doesn't get executed Also talk about idempotency. Example In my ecommerce project rewards are getting deducted twice for customer because consumer logic is getting executed twice Will thank you👍👍

[@Javatechie]

Santosh will go from the beginning don't worry

[@santoshkamat6132]

@@Javatechie thanks bro i love your videos I know you like to do challenging things too 🙌🙌

[@PradeepKumar-sx6ms]

we can divide it into several partitions My question is suppose we divide a topic into 6 partitions can we have 3 partitions in one computer and another 3 in one computer like that

[@Javatechie]

The entire partition needs to be part of one computer We can't be segregated with partition but yes you can segregate brokers

[@anuragsekhri2315]

What if two consumers have subscribed to same partition how that will be handled ??

[@rssaini01]

Is Kafka Topic like RabbitMQ Queue??

[@Sanket_Ardalkar]

can one producer/publisher may have multiple topics or there will be one topic per producer/publisher?

[@Javatechie]

1 producer can publish to N number of topic

[@bikashbittu236]

What will happen if we have 3-partition but 2-consumer in the consumer group ?

[@Javatechie]

1 consumer instance will read from 2 partition

[@dasithasandaruwan]

When will the next session come out?

[@Javatechie]

Trying for this weekend buddy

[@mihirprakash1817]

When can we have the next videos?

[@Javatechie]

This week 100% i will upload 2 videos on Kafka

[@adityavinayak3076]

chinn tapaak dam dam

[@vishalkharche9662]

thoda jaldi jaldi videos upload karo please

[@michaeldeng1981]

the zookeeper is not part of the Kafka anymore

[@Javatechie]

Yes

[@indrajeetsharma7306]

Very creative and helpful video anyone can understand. I went through many articles and videos, and I was very confused, and my thought was Kafka is very big and very vast. But by watching this video I am full cleared on Kafka concepts.

[@lokeshparihar5693]

Great explanation sir 👍