Apache Kafka® & Confluent Kafka CLI hands on tutorial | Producer & Consumer Flow | JavaTechie

In this Tutorial, We will play with Kafka CLI to understand pub -sub model also we will demonstrate all the Kafka components and their internal work flow
#JavaTechie #Kafka
Spring boot microservice premium course available now
Hurry-up & Register today itself!
COURSE LINK : javatechie5246...
PROMO CODE : JAVATECHIE50
GitHub:
github.com/Jav...
Blogs:
/ javatechie
Facebook:
/ javatechie
guys if you like this video please do subscribe now and press the bell icon to not miss any update from Java Techie
Disclaimer/Policy:
----------------------------
Note : All uploaded content in this channel is mine and its not copied from any community ,
you are free to use source code from above mentioned GitHub account

[@amarjeet2162]

Kafka was very strange and scary for me before watching your videos, Thanks a lots from deep of my heart...❤

[@Javatechie]

Thank you buddy 😊I will explain in an easier way when we start coding .

[@gsk320]

@@Javatechie can we getPPT you have shown us

[@Javatechie]

Please drop an email [e-mail]

[@manishtrivedi6243]

Thanks, this is very helpful for beginners like me. Can you please share the slides deck?

[@Javatechie]

Drop me an email to [e-mail]

[@ajayrudresh9406]

Thanks a lot sir, this hands-on session is easy to understand about kafka and connect it with real time use cases

[@rashmiranjanswain601]

This video is very helpful.Please implement this at a realtime spring boot project.

[@Javatechie]

Yes I will

[@rishabhshukla5199]

It's a very good video❤, can you please take some real spring boot projects and explain Kafka by its integration into the project? It will be very helpful.

[@Javatechie]

Yes I will do that

[@obiremiiyimide7728]

Hey this is the best video on Kafka ever please can you make a video on Kafka on confluent cloud platform like the spring boot

[@Javatechie]

Thank you buddy Yes i will

[@hemantmangwani7172]

It's very useful videos. Thank You we can also use kadeck for monitoring topics.

[@Javatechie]

Thanks I am not aware about this tool will definitely try

[@trishulcurtis1810]

Great Explanation! Does a consumer read from all partitions?

[@Javatechie]

Yes

[@codingispassion6376]

Bhaiya, can you please make a video on time-based API authentication using Keycloak? We want to restrict the functionality of the entire application so that it's only available to users from 10 AM to 5 PM.

[@malayswain8158]

Kindly do sessions in windows OS sometimes it is confusing to follow the same instructions of MAc OS for WIndows. most of us use windows OS

[@Javatechie]

Hello Malaya i completely agree with you but it seems difficult for me to manage all the video software in windows 🪟. So please cooperate and also there is not much difference in mac and windows . So what I am planning going forward I will share all windows specific command and changes in my medium blog that way audience won't block on their dev

[@srikanthg8006]

From where the Confluent kafka server is reading the topics created for open source kafka? This information will get stored anywhere in the system?

[@shaikakbarali5257]

Basant could you make a video on spring cloud stream with Spring boot 3.x as it got upgraded with Functional programming and EnableBinding annotation got deprecated.

[@Javatechie]

Okay I will Do that

[@NiteshSingh-tt8ex]

I am trying to connect using offset explorer, not able to connect . Connection is getting refused. I am using WSL ubantu. Any suggestion , my kafka and zookeeper server are both up and running

[@abhishekbhatt5975]

anyone find "The operation couldn’t be completed. Unable to locate a Java Runtime." this error

[@Vikash88vvicky]

Your video is very informative, I'm regularly watching your videos. Thanks for all these valuable videos. I have one request from you, a part of Jenkins try to deliver one topic on tekton also. It is also alternative of Jenkins and much better than that also.

[@Rogue_iron]

any one else facing this issue when you try to run zookeeper server from confluent and it throws "Classpath is empty. Please build the project first e.g. by running 'gradlew jarAll'" in the cmd? i have followed the steps carefully and downloaded the community edition of confluent.

[@chiragsahu4994]

premium content sir

[@kadakpahadi1592]

Hi Basant,Pls provide path for file..where all commands are listed.used in this video..Not able to find

[@Javatechie]

It's there in video description buddy please check

[@ayushpreenza3071]

my client is using kafka and they want me to do automation testing on it, can someone suggest what would be the best way to do so.

[@shekhadaradhika4265]

Thank you for this. Really helped me learn 😊

[@ArchanSai]

Excellent Explanation i liked it

[@tanmaysenapati1328]

Make a video how to delete a topic on CMD and programmatically on spring boot

[@riturajishwar7251]

Love you bro please one full project with spring boot, hibernate, microservices,and Kafka

[@Javatechie]

Yes i will

[@abhishekmishra4296]

Hi Basant, can you pls do a video on Spring HATEOAS. Thanks in advance.

[@Javatechie]

Okay i will do that

[@praveens4519]

D:\back\kafka_2.12-3.6.0-1\bin\windows>kafka-server-start.bat D:\back\kafka_2.12-3.6.0-1\config\server.properties D:\back\kafka_2.12-3.6.0-1\bin\windows> my server is not starting in window with above command

[@satyabatigoswami1735]

kafka-server-start.bat ..\..\config\server.properties

[@phyohtetpaing44]

How can we split the partitions to different server . It is working on same port with one server but how to scale the partition to another node or machine and the replication too.

[@deepakgowda7292]

Thank you so much sir i am waiting for this tutorial ❤❤

[@suryavspradeeparava640]

[@PradeepKumar-sx6ms]

what is the tool that you used here to see the topic and partitions

[@Javatechie]

Offset explorer i have mentioned in the video buddy.

[@medAmineRg]

for everyone using windows and trying version 3.6.1 it wont work, it will give an error saying -> Classpath is empty. Please build the project first e.g. by running ‘gradlew jarAll’ i tried every solution on the web and nothing work, well i used 3.2.1 and its working now !!

[@Javatechie]

Thanks for the update buddy

[@medAmineRg]

all thanks goes to you Mr basant@@Javatechie

[@medAmineRg]

all thanks goes to you Mr Basant@@Javatechie

[@2RAJ21]

Thank you

[@praveens4519]

can you please help how start the kafka server zookeeper is running fine

[@umeshjoshi2578]

Hi @Java Techie while starting the server for confluent kafka I am getting below error could not find or load main class org.apache.zookeeper.server.quorum.QuorumPeerMain. Could please you guide on this. Thanks

[@govardhanreddysidhigari6901]

Have you resolved this issue?

[@ball8385]

Can you explain the mechanism how partition leader get elected in Kafka?

[@Javatechie]

I will cover that in coming video

[@rishikakapoor6220]

I am on windows machine and I am unable to send topics from consumer to producer. Any help?

[@Javatechie]

It should be producer to topic then topic to consumer please check whether you started zookeeper and Kafka server or not. It is not OS dependant

[@medAmineRg]

UPDATE !!! if you got this error -> Classpath is empty. Please build the project first e.g. by running 'gradlew jarAll' while using the confluent. Here's the fix : Step 1: Navigate to \confluent\bin\windows Step 2: Open kafka-run-class.bat file. Step 3 : Search -> rem Classpath addition for core Step 4: Now, just add the below code just above the rem Classpath addition for core line. rem classpath addition for LSB style path if exist %BASE_DIR%\share\java\kafka\* ( call:concat %BASE_DIR%\share\java\kafka\* )

[@AdaptToFuture]

When I try to open kafka-run-class.bat file. It doesn't open, it opens up for a milli second and then closes itself.

[@vishnuvardhanreddy3137]

Thank you soo much sir

[@dhiirendra8]

How to use schema registry for AVRO payload? thanks.

[@Javatechie]

I have not tried this buddy

[@VenkatBujjam]

super video. keep going..

[@RiyaGhosal-m7b]

Please make the bg color of your terminal opaque black. It's very hard to read

[@chidanandmirje2271]

Good one for beginners

[@nawwintphyu1873]

Thank you!

[@sona4560]

Thanks a ton for this

[@kishore87jetty]

Hellow Bro , I don't think confluent Kafka would be running out of the box . in windows there is an isue running the kafka. Error : "Classpath is empty. Please build the project first e.g. by running 'gradlew jarAll' in bin/windows/kafka-run-class.bat file search "rem Classpath addition for core" and then add these lines above it rem classpath addition for LSB style path if exist %BASE_DIR%\share\java\kafka\* ( call:concat %BASE_DIR%\share\java\kafka\* ) in this bat file.The code would look like this :we need to add below code to start the zookeeper. after some research I found this and added in here

[@Javatechie]

Is it resolved?

[@sachinpete4507]

Thank you sir for video

[@sauravpurohit6789]

how to download and start Kafka explorer on Linux ?

[@Javatechie]

Simply go to the official page of Kafka offset explorer and download from there then provide your zookeeper url and connect to cluster

[@AnilM-wy9ix]

Hi Basant it's very useful videos. The commands are same in windows as well?

[@rthiaga]

Under bin folder, you will find a folder called "windows". You will find the corresponding .bat file. Just replace .sh files with .bat files

[@AnilM-wy9ix]

@@rthiaga thanks for your reply. I have asked for syntax of the commands are same in windows as well

[@Javatechie]

Yes it's the same

[@SudhakarReddyChannel]

@@Javatechie Hi Basnat, I am unable to run the zookeeper on windows OS. I am getting error like The System cannot find the path specified.

[@SudhakarReddyChannel]

@@rthiaga Are you able to run the zoo keep successfully? I am unable to run the zookeeper on windows OS. I am getting error like The System cannot find the path specified.

[@AnushaKonthalapalli]

when Iam trying give connection to cluster it is not connecting

[@Javatechie]

Have you started Kafka and zookeeper ?

[@maverickf.d.2620]

Saludos y gracias por el tutorial

[@mohitbawankar6179]

I tried to load CSV file using command in windows but not working can any one please help me out here

[@arkatgdaplays8381]

Did you try it on Power shell and got - "The '

[@MohamedFazan-w2y]

Connection cluster is not connecting

[@PravinRautData]

Apache Kafka integration with KZbin comments to do sentimental analysis kzbin.info/aero/PLEnhbgHn_gC7cCSmncE20HEN1NDfaxMwI

[@hearttouchingvideos1262]

Video is not clear but you explained very well unable to see the things you are writing

[@Javatechie]

Video is in 4k buddy please check your internet and increase the resolution to get better visibility

[@rishiraj2548]

🙏

[@kratos_gow610]

16:33

[@tusharagarwal3475]

Classpath is empty. Please build the project first e.g. by running './gradlew jar -PscalaVersion=2.13.10' this is coming whenever running command to start the zookeeper and server

[@Javatechie]

Are you running Kafka from the correct folder where you have added the binary distribution of Kafka

[@tusharagarwal3475]

@@Javatechie yes

[@saikirankocharlakota]

same problem as tushar, can u share valid steps to clear the issue.

[@Javatechie]

Are you guys using the correct Kafka version?

[@thepskrishnan]

I had the same problem but then found that one of my sub folders had space in the name, which when I removed, the commands all worked…😮