Apache Kafka® & Confluent Kafka CLI hands on tutorial | Producer & Consumer Flow | JavaTechie

In this Tutorial, We will play with Kafka CLI to understand pub -sub model also we will demonstrate all the Kafka components and their internal work flow
#JavaTechie #Kafka
Spring boot microservice premium course available now
Hurry-up & Register today itself!
COURSE LINK : javatechie5246.ongraphy.com/
PROMO CODE : JAVATECHIE50
GitHub:
github.com/Java-Techie-jt
Blogs:
/ javatechie
Facebook:
/ javatechie
guys if you like this video please do subscribe now and press the bell icon to not miss any update from Java Techie
Disclaimer/Policy:
----------------------------
Note : All uploaded content in this channel is mine and its not copied from any community ,
you are free to use source code from above mentioned GitHub account

[@user-im3nc4iy1c]

Excellent Explanation i liked it

[@amarjeet2162]

Kafka was very strange and scary for me before watching your videos, Thanks a lots from deep of my heart...❤

[@Javatechie]

Thank you buddy 😊I will explain in an easier way when we start coding .

[@shekhadaradhika4265]

Thank you for this. Really helped me learn 😊

[@Vikash88vvicky]

Your video is very informative, I'm regularly watching your videos. Thanks for all these valuable videos. I have one request from you, a part of Jenkins try to deliver one topic on tekton also. It is also alternative of Jenkins and much better than that also.

[@user-nv1bp6fk6z]

super video. keep going..

[@rashmiranjanswain601]

This video is very helpful.Please implement this at a realtime spring boot project.

[@Javatechie]

Yes I will

[@chidanandmirje2271]

Good one for beginners

[@maverickf.d.2620]

Saludos y gracias por el tutorial

[@nawwintphyu1873]

Thank you!

[@deepakgowda7292]

Thank you so much sir i am waiting for this tutorial ❤❤

[@suryavspradeeparava640]

[@sachinpete4507]

Thank you sir for video

[@vishnuvardhanreddy3137]

Thank you soo much sir

[@obiremiiyimide7728]

Hey this is the best video on Kafka ever please can you make a video on Kafka on confluent cloud platform like the spring boot

[@Javatechie]

Thank you buddy Yes i will

[@sona4560]

Thanks a ton for this

[@hemantmangwani7172]

It's very useful videos. Thank You we can also use kadeck for monitoring topics.

[@Javatechie]

Thanks I am not aware about this tool will definitely try

[@PravinRautData]

Apache Kafka integration with KZbin comments to do sentimental analysis kzbin.info/aero/PLEnhbgHn_gC7cCSmncE20HEN1NDfaxMwI

[@rishabhshukla5199]

It's a very good video❤, can you please take some real spring boot projects and explain Kafka by its integration into the project? It will be very helpful.

[@Javatechie]

Yes I will do that

[@riturajishwar7251]

Love you bro please one full project with spring boot, hibernate, microservices,and Kafka

[@Javatechie]

Yes i will

[@trishulcurtis1810]

Great Explanation! Does a consumer read from all partitions?

[@Javatechie]

Yes

[@phyohtetpaing44]

How can we split the partitions to different server . It is working on same port with one server but how to scale the partition to another node or machine and the replication too.

[@umeshjoshi2578]

Hi @Java Techie while starting the server for confluent kafka I am getting below error could not find or load main class org.apache.zookeeper.server.quorum.QuorumPeerMain. Could please you guide on this. Thanks

[@rishiraj2548]

🙏

[@ayushpreenza3071]

my client is using kafka and they want me to do automation testing on it, can someone suggest what would be the best way to do so.

[@shaikakbarali5257]

Basant could you make a video on spring cloud stream with Spring boot 3.x as it got upgraded with Functional programming and EnableBinding annotation got deprecated.

[@Javatechie]

Okay I will Do that

[@praveens4519]

can you please help how start the kafka server zookeeper is running fine

[@abhishekmishra4296]

Hi Basant, can you pls do a video on Spring HATEOAS. Thanks in advance.

[@Javatechie]

Okay i will do that

[@AnilprasadReddyMekala-wy9ix]

Hi Basant it's very useful videos. The commands are same in windows as well?

[@rthiaga]

Under bin folder, you will find a folder called "windows". You will find the corresponding .bat file. Just replace .sh files with .bat files

[@AnilprasadReddyMekala-wy9ix]

@@rthiaga thanks for your reply. I have asked for syntax of the commands are same in windows as well

[@Javatechie]

Yes it's the same

[@SudhakarReddyChannel]

@@Javatechie Hi Basnat, I am unable to run the zookeeper on windows OS. I am getting error like The System cannot find the path specified.

[@SudhakarReddyChannel]

@@rthiaga Are you able to run the zoo keep successfully? I am unable to run the zookeeper on windows OS. I am getting error like The System cannot find the path specified.

[@dhiirendra8]

How to use schema registry for AVRO payload? thanks.

[@Javatechie]

I have not tried this buddy

[@PradeepKumar-sx6ms]

what is the tool that you used here to see the topic and partitions

[@Javatechie]

Offset explorer i have mentioned in the video buddy.

[@medAmineRg]

UPDATE !!! if you got this error -> Classpath is empty. Please build the project first e.g. by running 'gradlew jarAll' while using the confluent. Here's the fix : Step 1: Navigate to \confluent\bin\windows Step 2: Open kafka-run-class.bat file. Step 3 : Search -> rem Classpath addition for core Step 4: Now, just add the below code just above the rem Classpath addition for core line. rem classpath addition for LSB style path if exist %BASE_DIR%\share\java\kafka\* ( call:concat %BASE_DIR%\share\java\kafka\* )

[@AdaptToFuture]

When I try to open kafka-run-class.bat file. It doesn't open, it opens up for a milli second and then closes itself.

[@ball8385]

Can you explain the mechanism how partition leader get elected in Kafka?

[@Javatechie]

I will cover that in coming video

[@rishikakapoor6220]

I am on windows machine and I am unable to send topics from consumer to producer. Any help?

[@Javatechie]

It should be producer to topic then topic to consumer please check whether you started zookeeper and Kafka server or not. It is not OS dependant

[@sauravpurohit6789]

how to download and start Kafka explorer on Linux ?

[@Javatechie]

Simply go to the official page of Kafka offset explorer and download from there then provide your zookeeper url and connect to cluster

[@medAmineRg]

for everyone using windows and trying version 3.6.1 it wont work, it will give an error saying -> Classpath is empty. Please build the project first e.g. by running ‘gradlew jarAll’ i tried every solution on the web and nothing work, well i used 3.2.1 and its working now !!

[@Javatechie]

Thanks for the update buddy

[@medAmineRg]

all thanks goes to you Mr basant@@Javatechie

[@medAmineRg]

all thanks goes to you Mr Basant@@Javatechie

[@user-zm1ng8zh6r]

Connection cluster is not connecting

[@user-sq3ej4vx4d]

when Iam trying give connection to cluster it is not connecting

[@Javatechie]

Have you started Kafka and zookeeper ?

[@kratos_gow610]

16:33

[@mohitbawankar6179]

I tried to load CSV file using command in windows but not working can any one please help me out here

[@arkatgdaplays8381]

Did you try it on Power shell and got - "The '

[@praveens4519]

D:\back\kafka_2.12-3.6.0-1\bin\windows>kafka-server-start.bat D:\back\kafka_2.12-3.6.0-1\config\server.properties D:\back\kafka_2.12-3.6.0-1\bin\windows> my server is not starting in window with above command

[@satyabatigoswami1735]

kafka-server-start.bat ..\..\config\server.properties

[@kishore87jetty]

Hellow Bro , I don't think confluent Kafka would be running out of the box . in windows there is an isue running the kafka. Error : "Classpath is empty. Please build the project first e.g. by running 'gradlew jarAll' in bin/windows/kafka-run-class.bat file search "rem Classpath addition for core" and then add these lines above it rem classpath addition for LSB style path if exist %BASE_DIR%\share\java\kafka\* ( call:concat %BASE_DIR%\share\java\kafka\* ) in this bat file.The code would look like this :we need to add below code to start the zookeeper. after some research I found this and added in here

[@Javatechie]

Is it resolved?

[@tusharagarwal3475]

Classpath is empty. Please build the project first e.g. by running './gradlew jar -PscalaVersion=2.13.10' this is coming whenever running command to start the zookeeper and server

[@Javatechie]

Are you running Kafka from the correct folder where you have added the binary distribution of Kafka

[@tusharagarwal3475]

@@Javatechie yes

[@saikirankocharlakota]

same problem as tushar, can u share valid steps to clear the issue.

[@Javatechie]

Are you guys using the correct Kafka version?

[@thepskrishnan]

I had the same problem but then found that one of my sub folders had space in the name, which when I removed, the commands all worked…😮