What's the prior knowledge should have to learn Apache Kafka?
@pm4982Ай бұрын
For tech enthusiasts, one common issue is falling asleep while watching learning videos. However, after watching one such video, I found this gem. Thanks Man !
@jay09322 ай бұрын
I really love the way you explain. Especially you showed it in both Jupyter notebook and terminal. No waste of time straight to the point. Loved it.
@harishbala59583 ай бұрын
Great content to understand what Kafka is and it's components and how they work together
@ramanom2333 ай бұрын
Very good content, looking for more videos...
@DarshilParmar3 ай бұрын
More to come!
@plearn97223 ай бұрын
Thanks for the video. It was useful.
@DarshilParmar3 ай бұрын
You're welcome
@deepam.g455820 күн бұрын
falling in love with your content quality 🔥
@kondurisanthoshtharun2763 ай бұрын
Best one, Please explain indepth architecture in Kafka!!! Love to hear more!
@DarshilParmar3 ай бұрын
Very soon!
@sankuMАй бұрын
@@DarshilParmar Hey Darshil, did you release this later?
@sudarshanmhaisdhune10393 ай бұрын
Top video! in such short time, you explained it clearly, Darshil!
@DarshilParmar3 ай бұрын
Glad you liked it!
@CallMeYoursBabe3 ай бұрын
love this content, keep making it sir ❤
@DarshilParmar3 ай бұрын
More to come!
@Real_Intelligence3 ай бұрын
Great content vro.. build a video series of the format. Killed it 🫡
@DarshilParmar3 ай бұрын
Thank you
@ayesamson3 ай бұрын
Great overview. Well done!
@saranshkaushik82593 ай бұрын
Wow I was just looking for this !
@DarshilParmar3 ай бұрын
Glad you found it
@abhishekjaiswal57883 ай бұрын
Go deeper into architecture and implementation of Kafka. Great video!
@DarshilParmar3 ай бұрын
Thanks, will do!
@ManishSharma-fi2vr3 ай бұрын
Please consider this request from my side as well.
@DarshilParmar3 ай бұрын
@@ManishSharma-fi2vr Sure
@madukomablessed47123 ай бұрын
Yes, please go deeper
@sharaths54873 ай бұрын
Great stuff, could you also explain how to handle DLQ messages and consumer lag in sink connector
@DarshilParmar3 ай бұрын
Will create some tutorial on this
@sohamshah46663 ай бұрын
This Explanation was best , Can we get same for apache nifi?
@sohamshah46663 ай бұрын
Hello Darshil is great to watch this content and learn some new concept each day. Can we get the same for Apache Hadoop , Apache Nifi the more reliabe tools which are ongoing used in Data engineering Projects Thank you!
@alexiojunior78673 ай бұрын
great content and i have been looking at your content for years now, i still learning but i feel like something is missing, like a real life project , real time processing where one can use kafka,pyspark , orchastrated by airflow and the data goes in a medallion achitecture then transformed by dbt and then deployed in production using ci/cd ,and then monitor the dags using promethus and grafana ,something of that sort and then mayb deploy it on gcp or aws
@sarbjeetsinghpal63213 ай бұрын
Nice information thanks ❤
@DarshilParmar3 ай бұрын
Welcome
@ansumandas57492 ай бұрын
Great content man.
@lectures37273 ай бұрын
Hi bhaiya Needed a laptop in college and programming i started learning data science and ml but dont do gaming so i didnt take any GPU laptop I have 2 options First lenovo ideapad pro 5 with 14" ultra 9 H processor 32 gb ram 1 tb ssd and 84 wh battery Second is lenovo yoga slim 7i with ultra 7 processor 32 gb ram 1 tb ssd and 65 wh battery Both price same Which one should i go for?
@crystalllake31583 ай бұрын
Hi Darshil First of all , Great Content ! I am trying to replicate the steps as the video , and it works fine from the terminal. Messages sent from the producer is displayed at consumer end. But when I'm trying to run it with the producer/consumer scripts , the consumer does not receives the messages. Any idea why ? Both containers(kafka & zookeeper) are on the same bridge n/w on same subnet.
@mukulbatham73183 ай бұрын
Thank you ❤❤ It was really helpful 🎉.
@DarshilParmar3 ай бұрын
You're welcome 😊
@Zaheer-r4k3 ай бұрын
Can you please come up with Kafka end to end series for your people...
@DarshilParmar3 ай бұрын
will be launching course on this soon
@brijesh63232 ай бұрын
@@DarshilParmar i am thinking to buy, when it will come please let me know its very urgent !!!!!!
@abhishekn20483 ай бұрын
make a full courese on kafaka and snowflake integration
@DarshilParmar3 ай бұрын
I already have on snowflake
@abhishekn20483 ай бұрын
@@DarshilParmar but kafka integration kind of
@DarshilParmar3 ай бұрын
That will come soon
@brijesh63232 ай бұрын
when this course or combo will come on it ?, i just want to ask something regarding course buy, can we connect ?
@johnlloydjayme9482Ай бұрын
Epic 🥰
@UjjwalSinghPal-um3pb3 ай бұрын
if i started learning for now than there are very less data engineering internships(if one has data internship it is easy to get a job ,and that person also get hand on experience ) ,,,,so should i do data analyst first only for internship and after that i will study for data engineering for job because it is also a good way , and i need to do an internship because it is in our college criteria , they do not support much if you do not have done internship?? nice video on kafka
@DarshilParmar3 ай бұрын
Start with any data field that you get, foundation skills are same for all
@devparmar74203 ай бұрын
Hey let's connect and talk more about it
@UjjwalSinghPal-um3pb3 ай бұрын
@@devparmar7420 ok
@UjjwalSinghPal-um3pb3 ай бұрын
@@devparmar7420 ok
@UjjwalSinghPal-um3pb3 ай бұрын
@@devparmar7420 share me your email are you also an student
@hit70903 ай бұрын
Guys remember if you wanna learn kafka, go to documentation section and read it
@DarshilParmar3 ай бұрын
All time best resource
@prashu259253 ай бұрын
We need a full tutorial on Kafka
@DarshilParmar3 ай бұрын
on it!
@karthikharisamy53672 ай бұрын
I am facing issue while installing pydoop which is needed for me to write data from kafka topics to hadoop. Please can you help me put in installing pydoop.
@Vikasptl073 ай бұрын
For data engineers scope is mostly limited to consumption side and rarely you write to topics as producers (for specific use cases) . Most of the complexity of setting up kafka and micro service should be handled by source systems. Consumer should only worry about consuming those events and setting up pipelines which is pretty easy.
@DarshilParmar3 ай бұрын
100%
@o__bean__o3 ай бұрын
What about Google Cloud Pub/sub. Both Kafka and pub/sub are same
@DarshilParmar3 ай бұрын
Yes it’s similar
@quiet86913 ай бұрын
What is the work of the zookeeper here?
@DarshilParmar3 ай бұрын
Manage resources and work on coordination/synchronization We are running multiple machines
@dogzrgood27 күн бұрын
3:32 how to create this map?
@jadhavalliance2 ай бұрын
After typing command docker-compose up i am getting eeror like incorrect username and password
@DarshilParmar2 ай бұрын
you will have to login to docker using cli, just google about it
@mayankpatni56393 ай бұрын
I have done bcom want to enter in it what should i do mtech vs mca
@DarshilParmar3 ай бұрын
MTech is good option you’ll get in-depth understanding
@vignesh0043 ай бұрын
I have some queries what is the way to contact you?