Learn Kafka in 10 Minutes | Most Important Skill for Data Engineering

[@DarshilParmar]

Don’t forget to LIKEEEE

[@geonpeter8434]

Never... Never Forget to 👍

[@anandgupta7273]

What's the prior knowledge should have to learn Apache Kafka?

[@pm4982]

For tech enthusiasts, one common issue is falling asleep while watching learning videos. However, after watching one such video, I found this gem. Thanks Man !

[@jay0932]

I really love the way you explain. Especially you showed it in both Jupyter notebook and terminal. No waste of time straight to the point. Loved it.

[@harishbala5958]

Great content to understand what Kafka is and it's components and how they work together

[@ramanom233]

Very good content, looking for more videos...

[@DarshilParmar]

More to come!

[@sudarshanmhaisdhune1039]

Top video! in such short time, you explained it clearly, Darshil!

[@DarshilParmar]

Glad you liked it!

[@kondurisanthoshtharun276]

Best one, Please explain indepth architecture in Kafka!!! Love to hear more!

[@DarshilParmar]

Very soon!

[@sankuM]

@@DarshilParmar Hey Darshil, did you release this later?

[@ayesamson]

Great overview. Well done!

[@karthikharisamy5367]

I am facing issue while installing pydoop which is needed for me to write data from kafka topics to hadoop. Please can you help me put in installing pydoop.

[@kirant5548]

one of the best video on this topic

[@abhishekjaiswal5788]

Go deeper into architecture and implementation of Kafka. Great video!

[@DarshilParmar]

Thanks, will do!

[@ManishSharma-fi2vr]

Please consider this request from my side as well.

[@DarshilParmar]

@@ManishSharma-fi2vr Sure

[@madukomablessed4712]

Yes, please go deeper

[@CallMeYoursBabe]

love this content, keep making it sir ❤

[@DarshilParmar]

More to come!

[@deepam.g4558]

falling in love with your content quality 🔥

[@electrowizard2658]

great content sir keep up

[@AmeerHamza-u6x]

very good way of explaining but you need to slow down your speed

[@sharaths5487]

Great stuff, could you also explain how to handle DLQ messages and consumer lag in sink connector

[@DarshilParmar]

Will create some tutorial on this

[@plearn9722]

Thanks for the video. It was useful.

[@DarshilParmar]

You're welcome

[@LaughsOnLolland]

i love this video. im from Ghana 🎉🎉

[@priyankavaidya1809]

This is perfecttt! 👌🏻👌🏻

[@sohamshah4666]

This Explanation was best , Can we get same for apache nifi?

[@Real_Intelligence]

Great content vro.. build a video series of the format. Killed it 🫡

[@DarshilParmar]

Thank you

[@padmamurala-t5v]

Its simple and clear the topic

[@sohamshah4666]

Hello Darshil is great to watch this content and learn some new concept each day. Can we get the same for Apache Hadoop , Apache Nifi the more reliabe tools which are ongoing used in Data engineering Projects Thank you!

[@saranshkaushik8259]

Wow I was just looking for this !

[@DarshilParmar]

Glad you found it

[@jasonhall6526]

That is a serious unibrow. Bravo.

[@mukulbatham7318]

Thank you ❤❤ It was really helpful 🎉.

[@DarshilParmar]

You're welcome 😊

[@ankitabanerjee9979]

Wow! Interesting

[@ansumandas5749]

Great content man.

[@dogzrgood]

3:32 how to create this map?

[@SUKESHMR-x3i]

Darshil, I taken combo data engineering pack recently in your website. I saw some course yet to come like kafka, aws etc. When i can expect these syllabus/module in pack. And is it free upgradable?. Please help me out.

[@Zaheer-r4k]

Can you please come up with Kafka end to end series for your people...

[@DarshilParmar]

will be launching course on this soon

[@brijesh6323]

@@DarshilParmar i am thinking to buy, when it will come please let me know its very urgent !!!!!!

[@sarbjeetsinghpal6321]

Nice information thanks ❤

[@DarshilParmar]

Welcome

[@alexiojunior7867]

great content and i have been looking at your content for years now, i still learning but i feel like something is missing, like a real life project , real time processing where one can use kafka,pyspark , orchastrated by airflow and the data goes in a medallion achitecture then transformed by dbt and then deployed in production using ci/cd ,and then monitor the dags using promethus and grafana ,something of that sort and then mayb deploy it on gcp or aws

[@abhishekn2048]

make a full courese on kafaka and snowflake integration

[@DarshilParmar]

I already have on snowflake

[@abhishekn2048]

@@DarshilParmar but kafka integration kind of

[@DarshilParmar]

That will come soon

[@okotpascal]

@@DarshilParmar I would very much appreciate one extensive tutorial on Kafka, thanks for the awesome lessons

[@ezequielsaldana8279]

Hi, yours courses hace the translate to spanish?

[@crystalllake3158]

Hi Darshil First of all , Great Content ! I am trying to replicate the steps as the video , and it works fine from the terminal. Messages sent from the producer is displayed at consumer end. But when I'm trying to run it with the producer/consumer scripts , the consumer does not receives the messages. Any idea why ? Both containers(kafka & zookeeper) are on the same bridge n/w on same subnet.

[@brijesh6323]

when this course or combo will come on it ?, i just want to ask something regarding course buy, can we connect ?

[@UjjwalSinghPal-um3pb]

if i started learning for now than there are very less data engineering internships(if one has data internship it is easy to get a job ,and that person also get hand on experience ) ,,,,so should i do data analyst first only for internship and after that i will study for data engineering for job because it is also a good way , and i need to do an internship because it is in our college criteria , they do not support much if you do not have done internship?? nice video on kafka

[@DarshilParmar]

Start with any data field that you get, foundation skills are same for all

[@devparmar7420]

Hey let's connect and talk more about it

[@UjjwalSinghPal-um3pb]

@@devparmar7420 ok

[@UjjwalSinghPal-um3pb]

@@devparmar7420 ok

[@UjjwalSinghPal-um3pb]

@@devparmar7420 share me your email are you also an student

[@hit7090]

Guys remember if you wanna learn kafka, go to documentation section and read it

[@DarshilParmar]

All time best resource

[@lectures3727]

Hi bhaiya Needed a laptop in college and programming i started learning data science and ml but dont do gaming so i didnt take any GPU laptop I have 2 options First lenovo ideapad pro 5 with 14" ultra 9 H processor 32 gb ram 1 tb ssd and 84 wh battery Second is lenovo yoga slim 7i with ultra 7 processor 32 gb ram 1 tb ssd and 65 wh battery Both price same Which one should i go for?

[@o__bean__o]

What about Google Cloud Pub/sub. Both Kafka and pub/sub are same

[@DarshilParmar]

Yes it’s similar

[@Vikasptl07]

For data engineers scope is mostly limited to consumption side and rarely you write to topics as producers (for specific use cases) . Most of the complexity of setting up kafka and micro service should be handled by source systems. Consumer should only worry about consuming those events and setting up pipelines which is pretty easy.

[@DarshilParmar]

100%

[@jadhavalliance]

After typing command docker-compose up i am getting eeror like incorrect username and password

[@DarshilParmar]

you will have to login to docker using cli, just google about it

[@quiet8691]

What is the work of the zookeeper here?

[@DarshilParmar]

Manage resources and work on coordination/synchronization We are running multiple machines

[@mayankpatni5639]

I have done bcom want to enter in it what should i do mtech vs mca

[@DarshilParmar]

MTech is good option you’ll get in-depth understanding

[@johnlloydjayme9482]

Epic 🥰

[@prashu25925]

We need a full tutorial on Kafka

[@DarshilParmar]

on it!

[@vignesh004]

I have some queries what is the way to contact you?