Learn Kafka in 10 Minutes | Most Important Skill for Data Engineering

[@DarshilParmar]

Don’t forget to LIKEEEE

[@geonpeter8434]

Never... Never Forget to 👍

[@anandgupta7273]

What's the prior knowledge should have to learn Apache Kafka?

[@pm4982]

For tech enthusiasts, one common issue is falling asleep while watching learning videos. However, after watching one such video, I found this gem. Thanks Man !

[@jay0932]

I really love the way you explain. Especially you showed it in both Jupyter notebook and terminal. No waste of time straight to the point. Loved it.

[@harishbala5958]

Great content to understand what Kafka is and it's components and how they work together

[@ramanom233]

Very good content, looking for more videos...

[@DarshilParmar]

More to come!

[@plearn9722]

Thanks for the video. It was useful.

[@DarshilParmar]

You're welcome

[@deepam.g4558]

falling in love with your content quality 🔥

[@kondurisanthoshtharun276]

Best one, Please explain indepth architecture in Kafka!!! Love to hear more!

[@DarshilParmar]

Very soon!

[@sankuM]

@@DarshilParmar Hey Darshil, did you release this later?

[@sudarshanmhaisdhune1039]

Top video! in such short time, you explained it clearly, Darshil!

[@DarshilParmar]

Glad you liked it!

[@CallMeYoursBabe]

love this content, keep making it sir ❤

[@DarshilParmar]

More to come!

[@Real_Intelligence]

Great content vro.. build a video series of the format. Killed it 🫡

[@DarshilParmar]

Thank you

[@ayesamson]

Great overview. Well done!

[@saranshkaushik8259]

Wow I was just looking for this !

[@DarshilParmar]

Glad you found it

[@abhishekjaiswal5788]

Go deeper into architecture and implementation of Kafka. Great video!

[@DarshilParmar]

Thanks, will do!

[@ManishSharma-fi2vr]

Please consider this request from my side as well.

[@DarshilParmar]

@@ManishSharma-fi2vr Sure

[@madukomablessed4712]

Yes, please go deeper

[@sharaths5487]

Great stuff, could you also explain how to handle DLQ messages and consumer lag in sink connector

[@DarshilParmar]

Will create some tutorial on this

[@sohamshah4666]

This Explanation was best , Can we get same for apache nifi?

[@sohamshah4666]

Hello Darshil is great to watch this content and learn some new concept each day. Can we get the same for Apache Hadoop , Apache Nifi the more reliabe tools which are ongoing used in Data engineering Projects Thank you!

[@alexiojunior7867]

great content and i have been looking at your content for years now, i still learning but i feel like something is missing, like a real life project , real time processing where one can use kafka,pyspark , orchastrated by airflow and the data goes in a medallion achitecture then transformed by dbt and then deployed in production using ci/cd ,and then monitor the dags using promethus and grafana ,something of that sort and then mayb deploy it on gcp or aws

[@sarbjeetsinghpal6321]

Nice information thanks ❤

[@DarshilParmar]

Welcome

[@ansumandas5749]

Great content man.

[@lectures3727]

Hi bhaiya Needed a laptop in college and programming i started learning data science and ml but dont do gaming so i didnt take any GPU laptop I have 2 options First lenovo ideapad pro 5 with 14" ultra 9 H processor 32 gb ram 1 tb ssd and 84 wh battery Second is lenovo yoga slim 7i with ultra 7 processor 32 gb ram 1 tb ssd and 65 wh battery Both price same Which one should i go for?

[@crystalllake3158]

Hi Darshil First of all , Great Content ! I am trying to replicate the steps as the video , and it works fine from the terminal. Messages sent from the producer is displayed at consumer end. But when I'm trying to run it with the producer/consumer scripts , the consumer does not receives the messages. Any idea why ? Both containers(kafka & zookeeper) are on the same bridge n/w on same subnet.

[@mukulbatham7318]

Thank you ❤❤ It was really helpful 🎉.

[@DarshilParmar]

You're welcome 😊

[@Zaheer-r4k]

Can you please come up with Kafka end to end series for your people...

[@DarshilParmar]

will be launching course on this soon

[@brijesh6323]

@@DarshilParmar i am thinking to buy, when it will come please let me know its very urgent !!!!!!

[@abhishekn2048]

make a full courese on kafaka and snowflake integration

[@DarshilParmar]

I already have on snowflake

[@abhishekn2048]

@@DarshilParmar but kafka integration kind of

[@DarshilParmar]

That will come soon

[@brijesh6323]

when this course or combo will come on it ?, i just want to ask something regarding course buy, can we connect ?

[@johnlloydjayme9482]

Epic 🥰

[@UjjwalSinghPal-um3pb]

if i started learning for now than there are very less data engineering internships(if one has data internship it is easy to get a job ,and that person also get hand on experience ) ,,,,so should i do data analyst first only for internship and after that i will study for data engineering for job because it is also a good way , and i need to do an internship because it is in our college criteria , they do not support much if you do not have done internship?? nice video on kafka

[@DarshilParmar]

Start with any data field that you get, foundation skills are same for all

[@devparmar7420]

Hey let's connect and talk more about it

[@UjjwalSinghPal-um3pb]

@@devparmar7420 ok

[@UjjwalSinghPal-um3pb]

@@devparmar7420 ok

[@UjjwalSinghPal-um3pb]

@@devparmar7420 share me your email are you also an student

[@hit7090]

Guys remember if you wanna learn kafka, go to documentation section and read it

[@DarshilParmar]

All time best resource

[@prashu25925]

We need a full tutorial on Kafka

[@DarshilParmar]

on it!

[@karthikharisamy5367]

I am facing issue while installing pydoop which is needed for me to write data from kafka topics to hadoop. Please can you help me put in installing pydoop.

[@Vikasptl07]

For data engineers scope is mostly limited to consumption side and rarely you write to topics as producers (for specific use cases) . Most of the complexity of setting up kafka and micro service should be handled by source systems. Consumer should only worry about consuming those events and setting up pipelines which is pretty easy.

[@DarshilParmar]

100%

[@o__bean__o]

What about Google Cloud Pub/sub. Both Kafka and pub/sub are same

[@DarshilParmar]

Yes it’s similar

[@quiet8691]

What is the work of the zookeeper here?

[@DarshilParmar]

Manage resources and work on coordination/synchronization We are running multiple machines

[@dogzrgood]

3:32 how to create this map?

[@jadhavalliance]

After typing command docker-compose up i am getting eeror like incorrect username and password

[@DarshilParmar]

you will have to login to docker using cli, just google about it

[@mayankpatni5639]

I have done bcom want to enter in it what should i do mtech vs mca

[@DarshilParmar]

MTech is good option you’ll get in-depth understanding

[@vignesh004]

I have some queries what is the way to contact you?