Apache Kafka® Producer Example using SpringBoot 3.x | Java Techie

In this tutorial, we will be creating a simple Kafka Producer using Spring Boot 3.0 and will understand below key points
👉 Default topic create by Spring Boot
👉 How to handle the results asynchronously in kafka producer
👉 How to create topic programatically
👉 How messages will be distributed to multiple partition
👉 Offset Explorer to visualise kafka events
#JavaTechie #SpringBoot #Kafka
Spring boot microservice Premium course lunched with 70% off 🚀 🚀
Hurry-up & Register today itself!
COURSE LINK : javatechie5246.ongraphy.com/
PROMO CODE : JAVATECHIE50
GitHub:
github.com/Java-Techie-jt/kaf...
Blogs:
/ javatechie
Facebook:
/ javatechie
Join this channel to get access to perks:
kzbin.infojoin
guys if you like this video please do subscribe now and press the bell icon to not miss any update from Java Techie
Disclaimer/Policy:
--------------------------------
Note : All uploaded content in this channel is mine and its not copied from any community ,
you are free to use source code from above mentioned GitHub account

[@pottendlanagma7263]

very clear and concise explanation. Keep Rock!

[@MrOpolo91]

Great series! Thanks for your very detailed and clear explanations... Keep it going!

[@gopisambasivarao5282]

Great tutorial on Kafka. Appreciate your efforts, Basant.

[@nomadicmayank6120]

Hi Basant, thank you for sharing kafka series. I apricate your efforts

[@deveshagarwal660]

Really helpful, detailed and amazing video. Keep up the good work brother.

[@umeshsharma2883]

Very creative and helpful video anyone can understand. I went through many articles and videos, and I was very confused, and my thought was Kafka is very big and very vast. But by watching this video I am full cleared on Kafka concepts.

[@ChandlerBing11]

Java Techie, we miss you so much!!!

[@GunelMammadova93]

Thank you for your videos! They are super helpful

[@bakdaulet_13]

Amazing tutorial, thank you bro!

[@amarnatha1614]

Very nice explanation, Thank you sir.

[@tanishmanas1011]

Great.....God Bless you !!!!

[@sergiogb]

Great video, thanks!

[@sharmarahul17]

Excellent video!

[@pulkitkaushik4539]

Hi Basant, Your videos helped immensely during the interview prep time and it helped to get a decent job as Senior Software Engineer... many thnaks to you !!

[@Javatechie]

Glad to hear this buddy 🥰. Thank you so much keep learning

[@FeliksBekeshov]

send to Basant, at least some percent of your salary bro , he is doing it for free! )

[@Javatechie]

hey buddy, I get you're joking, but I truly enjoyed the appreciation from you guys, which means more to me than money.

[@user-vj7fu5hz4n]

This is awesome

[@user-vj7fu5hz4n]

This is awesome !!!

[@mubarakahmed9060]

Great knowledge sharing. Hope we can see multithreading consumer tutorial

[@Javatechie]

Yes i will cover that with consumer group don't worry

[@carlpei6570]

👍 thanks

[@pitumalkani]

Hello @Java Techie, thank you for the amazing content , it is quite easy to understand. I have few queries, 1. What is the importance of replicationFactor? 2. How the kafka setup ensures delivery of message in case when consumer application is down? 3. Is it possible to create the topics from docker-compose.yml files?

[@akshaykumarr7541]

Please post a video for setting up the consumer for the same. Amazing video

[@Javatechie]

Sure buddy that will be my next video.

[@anilmanuka2052]

How to listen the Kafka consume with some intervel time when producer send the data to the kafla server

[@cloud_Engineer]

How it will behave when multiple instance of application are launched?? It will create different topics or adhere to same topic??

[@raghu101982]

please share the link of the 1st video. Thanks

[@rohitmanohar2733]

Loved ur video, sir can u please make a video of inter service communication in spring Microserverices with real time example using kafka

[@Javatechie]

Buddy i have done the same in the cqrs design pattern please check that

[@rnages1921]

I owe you a drink.

[@Vikusoun1]

Hi Basant Thank you for Kaka tutorial. Learned a lot from you in the fast. I have few queries 1. How can we create multiple topics programmatically? With @Bean we can create only topic at a time 2.. If topic already exist, it throws exception. How can we skip topic creation if topic already exist. 3. Does it creates new thread for each message send?

[@Javatechie]

First and Two questions are quite interesting i will check and update you but regarding the 3rd one it won't execute by a separate thread message will concurrently be distributed to multiple partitions but to get those messages you need to implement multi threading in the consumer part . You can even use the Executor service in the producer itself

[@PradeepKumar-sx6ms]

Event Streaming with huge data reading and writing

[@ramanav3139]

can you please explain Kafka clustering topic using spring boot if possible

[@devaamujuri5998]

Hi This is not related to this video but in General I Want to know is that Mac Air laptop will supports our all Java tools? or we need Mac pro ?? I want to shifting from windows to Mac. I need AI ,ML tool Supper as Well. pls suggest

[@Javatechie]

No i am using a Mac desktop with custom congratulations 16 GB . You can use a Mac pro laptop with the latest configuration to play with ai

[@ravi.m4954]

Hi Basant, thanks for knowledge sharing.can you post video on replication factor other than one and how it will behave and in this case duplicate messages will be received by consumer or not

[@Javatechie]

I will do that buddy

[@saurabhsuradkar1626]

How do you set idempotence= true for producer?

[@SurajKumarSingh93]

Thanks for this nice video, I have configured offset exproler but for me instead of actual message it showing hascode of message

[@Javatechie]

Okay just click on topic and change the type to string instead of byte

[@akasheditz6754]

Sir if you don't mind please mention the link of microservice playlist taught by you...

[@Javatechie]

Please go through it Microservice: kzbin.info/aero/PLVz2XdJiJQxxWhFkucZBoMxeYE6qTgEF8

[@rajenderprasad1193]

Hi Basant. I have a question. We have already used KafkaTemplate and it is creating the topic if topic is not already created. Why do we need to again use NewTopic bean and pass the topic name in KafkaTemplate instance. Pls explain. Thanks

[@Javatechie]

Rajendra correct Kafka will create the topic but with default configuration like 1 partition and replication factor so if you want to customize it then you need to create topic by your own either using terminal or programmatically

[@rajenderprasad1193]

@@Javatechie oh okay. Thank you 🙏🏻

[@kishore87jetty]

Have a quick question: if you are capturing the result into an object after sending, isn't that mean the thread will wait for result to come and it is still hampering the performance of the app ?

[@Javatechie]

It will just capture metadata of your records nothing else so I don't think it will impact anything on performance

[@kishore87jetty]

Also looks like the messages in kafka are getting encrypted by default, I dont see actual message in offset Explorer. Is ther a way to get plain message in kafka topic

[@Javatechie]

No in offset you need to change the data type to json or plain text in topic itself

[@AshishRohillax]

Hi Basant, How do you get yml intellisense on intellij ?

[@Javatechie]

I believe it's by default available in the community edition but not sure whether I add any plugin or not. Can you check the plugin name spring boot assistant

[@anketpatel2312]

Hello Sir,, Here Topic 'java-techie-demo-3' will be created only If it is not exist already. Right?

[@Javatechie]

Yes correct 👍

[@smtad229lad]

Do you have offset Explorer license to use it for the educational purpose? It is not free to use for educational purpose as mentioned on its website. Just brining to your notice.

[@Javatechie]

It's open source and free

[@smtad229lad]

@@Javatechie This is what is mentioned on its website Offset Explorer is free for personal use only. Any non-personal use, including commercial, educational and non-profit work is not permitted without purchasing a license. Non-personal use is allowed for evaluation purposes for 30 days following the download of Offset Explorer, after which you must purchase a valid license or remove the software

[@Javatechie]

Not sure then, there might be some changes but it's installed on my machine from past 2 years and software didn't force me for any licence

[@knageswari6020]

Hi Basant can you please tell me how can we integrate Kafka instead of active mq with spring boot

[@Javatechie]

This is a Kafka integration example only right? What are you looking for?

[@tayfunslife]

How can we send events in to same partition rather than round robin. Because there is order in partition but no order among partition how we provide order by sending same partition.

[@Javatechie]

Yes I will cover that

[@jaripatidevendra6172]

Can you make video on spring boot jdbc template Mapsqlparametersource with stringutils and string builder using sql queries please

[@Javatechie]

Okay i will do that

[@rishiraj2548]

🙏👍

[@Suryanarayan094]

20:09 In my scenario my data stored only partition 2. No data stored in partition 0 & 1. Why ?? @javatechie

[@Javatechie]

Try 2 or 3 times again it will store messages to different partition. Please check in video i mentioned why okay

[@Suryanarayan094]

@@Javatechie Thanks Sir. I got it.

[@user-lv5ck6zz9o]

sir i have issue to download Offset Explorer for Ubuntu system can provide .sh file

[@Javatechie]

No it's a simple DMG file for me I just need to install it

[@sunnysingh7854]

Hello everyone, I am constantly gettinig the below given error: Required type: CompletableFuture Provided: ListenableFuture everytime I try declaring future variable

[@Javatechie]

The return type is incorrect just use your ide to get the correct return type brother

[@sunnysingh7854]

@@Javatechie hello brother, I tried but I'm not getting the option to use completable future in java 11. I am using Intellij

[@Javatechie]

@sunnysingh7854 please share your code in GitHub.com

[@lokeshswamy4440]

The next part is expected soon..maybe today 😅.. thanks

[@Javatechie]

I will try to do it soon

[@user-io4mf6rr9i]

how to start Zookeeper and kafka on windows

[@abhishekanand2163]

Please teach something complex like Kafka streams as not many good videos are there

[@Javatechie]

I will do that concept step by step

[@astar4782]

Hi ..you have missed a crucial point as to how to distribute the messages among partitions using Kafka custom Partitioner

[@Javatechie]

I will do that buddy along with read and write part

[@vladstarichenko4937]

I was confused by the fact that not all messages were sent to the topic, when I'm trying to see the data only 100 messages are in presence. The reason is that you need to specify the number of messages you wanna see, hope this helps beginners not search for errors

[@Javatechie]

No it should send all the messages. Check the total message count in each partition

[@vladstarichenko4937]

@@Javatechie Everything is working well, as I said I couldn't see all the messages as there was a limit for messages that can be shown (in offset explorer)

[@Javatechie]

@@vladstarichenko4937 it's a free tool buddy if I will send 1000 message still it will show max 100 message in app so better to check in each partition level message count

[@MrOpolo91]

Great series! Thanks for your very detailed and clear explanations... Keep it going!