🚀 Apache Kafka Crash Course With Spring Boot 3.0.x |

#JavaTechie #DistributedMessaging #SpringBoot #Kafka
👉 This video will guide you through Kafka, starting from the fundamentals and progressing to advanced topics, all while adhering to real-time coding standards. By the end of this course, you'll emerge as a Kafka expert, equipped with a deep understanding of its internal workflow and ready to tackle complex scenarios with confidence.
What You Will Learn:
👉 00:00:00 course outline
👉 00:00:58 What is Kafka & Why We Need It?
👉 00:14:45 Kafka Components & Internal Architecture
👉 00:29:54 kafka installation
👉 00:41:27 Play With Kafka using Kafka CLI - Hands-on Example
👉 01:22:09 installing kafka using docker-compose
👉 01:37:43 kafka producer example using springboot
👉 02:02:46 kafka consumer example using springboot
👉 02:29:48 Apache Kafka Object Serialize & Deserialize Example
👉 02:54:19 Understand Message Routing with Specific Partitions in Kafka
👉 03:10:33 Kafka End-to-End Integration Testing in Spring Boot with TestContainers
👉 03:33:15 Kafka Error Handling with Spring Boot: Retry Strategies & Dead Letter Topics
👉 04:01:12 Kafka Schema Registry & Avro with Practical Example and Implementation
🧨 Hurry-up & Register today itself!🧨
Devops for Developers course (Live class ) 🔥🔥:
javatechie.ongraphy.com/cours...
COUPON CODE : NEW24
Spring boot microservice Premium course lunched with 70% off 🚀 🚀
COURSE LINK : Spring boot microservice course link :
javatechie.ongraphy.com/cours...
PROMO CODE : JAVATECHIE50
GitHub:
github.com/Java-Techie-jt/spr...
Blogs:
/ javatechie4u
Facebook:
/ javatechie
Join this channel to get access to perks:
kzbin.infojoin
🔔 Guys, if you like this video, please do subscribe now and press the bell icon to not miss any update from Java Techie.
Disclaimer/Policy:
📄 Note: All uploaded content in this channel is mine and it's not copied from any community, you are free to use source code from the above-mentioned GitHub account.

[@mfolarin]

00:00:00 course outline 00:00:58 kafka for beginners 00:14:45 components and architecture 00:29:54 kafka installation 00:41:27 kafka CLI and workflows 01:22:09 installing kafka using docker-compose 01:37:43 kafka producer example using springboot 02:02:46 kafka consumer example using springboot 02:29:48 kafka serialize & deserialize 02:54:19 kafka partition 03:10:33 kafka e2e testing in spring boot with test containers 03:33:15 kafka error handling 04:01:12 kafka schema registry

[@Javatechie]

Thank you so much buddy ☺️

[@samirattar]

thanks!

[@ascar66]

Oh now I know what I'm gonna do this weekend. Thank you

[@attrayadas8067]

Much needed! Thanks for posting 👏

[@bala7965]

00:00:00 Course Content 00:00:58 Kafka for beginners 00:14:45 Kafka Components & Internal Architecture 00:29:54 Kafka installation 00:41:27 Kafka CLI and workflows 01:22:10 How to install kafka using Docker 01:22:09 Installing kafka using docker-compose 01:37:43 Create Producer Application using Kafka & Spring Boot 02:02:46 Create Consumer Application using Kafka & Spring Boot 02:29:48 Apache Kafka Object Serialize & Deserialize Example 02:54:19 Kafka Pro Tips | Mastering Message Routing with Specific Partitions 03:10:33 Kafka End-to-End Integration Testing in Spring Boot with TestContainers 03:33:15 Kafka Error Handling with Spring Boot: Retry Strategies & Dead Letter Topics Detailed Explanation 04:01:12 Kafka Schema Registry & Avro with Practical Example and Implementation

[@BloodIsBat]

Great Share, Hoping for more like this.

[@ravi1341975]

Wow thanks for this JavaTechie.

[@srinivasreddy552]

@JavaTechie, as long as you are there, no issues for us to learn Java Ecosystem tools and software, many thanks.

[@vaibhavsrivastava4645]

Thank you so much for your efforts. After finishing this tutorial i have now got enough knowledge around Kafka and associated tools. I am very eager in a tutorial on Ktable and Kstreams of Kafka. Kudos.

[@gopisambasivarao5282]

Thanks Basant😊.. Appreciate your efforts, these are all our previous videos.. will go through one more time.. waiting for new topics 😊.. God bless You!!!!

[@mikedesta3520]

Good Job Basant, thank you so much! All your videos are just amazing. Keep providing us with such amazing tutorials

[@SoumedhT]

Thank you Basant sir, Love and great regards from Mumbai

[@nadetdevfullstack7041]

Very good ! Excellent !

[@PappuKumar-ho3ek]

Thanks for uploading this video 😊

[@rishabhshukla5532]

Gold Stuff, what a clear concise explanation, Thanks for your effort towards the community Basant.

[@abdus_samad890]

Thanks for making this course

[@grrlgd3835]

Thanks !!! More JT gold

[@fipabrate]

Great video! Keep up the fantastic work. By the way, every time you say "why is it crying," it cracks me up! Keep those hilarious moments coming!

[@Javatechie]

Thank you for your word . Keep learning 🤓

[@chrislyu7211]

Absolutely fantastic

[@prashlovessamosa]

Dhanywad Basant sir

[@divaharm2534]

great Java Techie

[@7tharan]

Please try to post about performance tuning in Java and SQL side

[@prathapkumarkesaboyina]

Very good Video. Need video on Kafka Connect and Connectors.

[@hamednikbakht9708]

very good

[@tanveersyed1049]

Nice video sir pls make a video on real time use cases of Kafka ...

[@kamlesh_k007]

Hello @JavaTechie thank you very very much for this course.Please add angular and react course as well if possible.We are waiting so long. Thank you very much.

[@mmmcorp8505]

thanks for everything.

[@balag2368]

You are really great bro. Thanks for the wonderful content.

[@ganeshbabu8263]

Thanks a lot!.

[@Hacks00145]

Thank you

[@Deepakblg97]

Thank you so much sir 🙏❤️

[@vino7tech]

Tq basen. 🎉🎉🎉🎉

[@sagardarade]

Thanks a ton Buddy

[@deeplife9654]

Just awesome 😎 thanks

[@suraj7440]

thank you for uploading such grate content - can you please make video for redis with real time example

[@karthikeyanrm3446]

@JavaTechie great one. can you please add the timer ? It would be really useful - for example we can straight away go to the consumer implementation for example.

[@Javatechie]

Yes i will add

[@Phoenix-od2bp]

Hi Basant, I want to understand difference between client id and group id. Can you please explain with an example of usage

[@dhaanaanjaay]

Great video ! Please add chapters/timeline in case someone wants to back and take a quick look at particular section

[@Javatechie]

Noted will update that

[@mayurnagdev5545]

#JavaTechie , I noticed producer config values being printed in my IDE logs every time we threw exception for invalid IP address from the consumer . I guess that is because we are actually 'producing' to the DLT topic from the consumer? Please advise

[@shilpasingla1739]

Hi Basant, while creating topic via binary download you have used bootstrap-server localhost:9092 but with docker you have used zookeeper:2181. Can you pls tell reason for difference

[@user-ig4dg8zq5q]

Thank you so much. Please will you be updating the Java AWS course any time soon?

[@Javatechie]

Java AWS already available please checkout AWS playlist buddy 🙂

[@RaviYadav-cx2pb]

Much needed if possible then mysql or postgresql db integration between them

[@Javatechie]

I already cover this usecase in cqrs design pattern buddy please check

[@subhronilsensarma3790]

@javaTechie.- I am someone who has hugely benefitted from your videos where you explained everything in detail. I am also a fan member of your channel. One small humble request if it is possible, please if you could kindly show us how to make the configurations of kafka in a windows machine. I have seen a lot of videos but most of them are misleading.

[@Javatechie]

Hello subhra . Thanks for following Javatechie and I am so happy to see you as a member of Javatechie. Could you please tell me what configuration you are expecting is it offset explorer or Kafka yaml configuration.

[@subhronilsensarma3790]

@@Javatechie if you could show how the kafka, the zookeeper configuration setting is done in windows command prompt, because the settings would be very different from MAC right?

[@subhronilsensarma3790]

Hi @Javatechie. Any plan on making the video of the topic I mentioned please.😔

[@Javatechie]

Hello buddy. No I don't have any plans at this moment because I Don't have windows OS with me now but i can suggest you to check out my old video which I did using windows .

[@subhronilsensarma3790]

@@Javatechie Thank you man! Sorry for bothering you too much could you please provide me with the link?

[@rishiraj2548]

🙏🙂👍

[@karthikeyharishtiwari3437]

Very Informative Tutorial but I have a question, In the Avro Lecture It is demonstrated that producer and consumer is in same project and whenever we make a change in employee.avsc file It changes the employee class in the defined package and now since both producer and consumer are in same project and are using employee class from same package that will not an issue, But If producer and Consumer are in different projects , then how do the changes we make in the employee.avsc file will be in sync with the Employee class in consumer. Asuming that I am using Avro and producer in a single project and Consumer in another project @Java Techie

[@Javatechie]

Yes if it's in different project then nothing to worry we are not generating Employee class manually right, consumer needs to just run mvn build it will create payload for you by reading the latest schema

[@deeplife9654]

Bro can you make a video on jackson api and json to java obj and vice versa ?

[@malleswarrao3887]

In the real World Springboot application how can we use Kafka, i mean We have lot of apis and rest classes

[@hdmusiq8648]

Hi brother!! In my offset explorer, I can see data which is sent by producer is saving as different word. Is this due to serialization or something?

[@Javatechie]

No it's not because of the serialization issue please check at topic level you have to choose string as data format by default it will set byte array for you.

[@hdmusiq8648]

@@Javatechie ok.. Thanks brother

[@nazimuddinasif5489]

can you please share git repo? above git repo is about springboot-apache-pulsar.

[@Javatechie]

Please go to the root repo and just filter with Kafka

[@karthikkumar5213]

Hey Hi @Javatechie... I was following along and faced an issue while doing serialize and deserialize i was getting serialization exception... Then after checking whole lot of things i found out package name fro Customer class has to be same as one defined in consumer even if contents of class are same it wasn't working fine... So couldn't understand why this was happenning. Can you help me with this?

[@amitrawat9670]

when deserialization in consumer side consumer, it uses the metadata about object which include while serialization. use these in consumer properties spring.kafka.consumer.properties.spring.json.use.type_info_headers=false spring.kafka.consumer.properties.spring.json.value.default.type=yourEntitynamewithpackage spring.kafka.consumer.properties.spring.json.use.type.headers=false

[@Javatechie]

Hello Amrit you need to soecify trusted package both from consumer and producer if it's different

[@rahulsukale4575]

I am trying to download kafka file on windows but every time getting editable notepad file Please guide me how to download

[@softwareengineer5893]

partitions in a topic will not have depluicate data, meaning - if a topic has 3 partitions then a data will be present in all 3 partitions but ony 1...

[@Javatechie]

Yes only 1 partition will have that info it won't be spam in other

[@arbindsharma1423]

Could we please have the pdf you used.

[@krish-pp6zt]

Nice tutorial. Where Can I find the source code used in the tutorial?

[@Javatechie]

In video description

[@malleswarrao3887]

May i know the part 2 link please for kafka

[@Javatechie]

Part 2 not released yet.

[@inoyatovnuriddin]

RabbitMQ also

[@sanathrayala2745]

It would have been so great if there were timestamps. Other than that, it's all good

[@Javatechie]

I will add it soon 🤠

[@lagishettydheeraj290]

I think each consumer group consumes all the messages from all the partitions rather one CG to one Partition, Correct me if Im wrong.

[@Javatechie]

No buddy. Each consumer will listen to one partition if there cg is different

[@niketsharma]

Why fonts are so small? It is too difficult to watch.

[@knowledgehouse4620]

Part 2 neiki asa

[@BillionDollerDream]

Do we need to know Java to learn from this tutorial???

[@Javatechie]

Yes java knowledge required

[@aminhlel7241]

stop reading my mind please !!!

[@waaaqas]

this is very boring . Too much explanation and less interaction . Better if we can start action side by side

[@deepaks5312]

Hello @javaTechie : around 1h:43m , while using the template to send the message to topic. getting the below error Cannot invoke "org.springframework.kafka.core.KafkaTemplate.send(String, Object)" because "this.template" is null

[@mayurnagdev5545]

@javatechie, I get the error in kafkaconsumer at 02:45:05 Caused by: org.springframework.messaging.converter.MessageConversionException: failed to resolve class name. Class not found [com.example.kafka_youtube_javatechie.model.User] at org.springframework.kafka.support.mapping.DefaultJackson2JavaTypeMapper.getClassIdType(DefaultJackson2JavaTypeMapper.java:137) ~[spring-kafka-3.1.4.jar:3.1.4] in your case, the Customer class is in the same package in both producer and consumer projects. But in my case, the equivalent (User.java) is in different packages in both producer & consumer. Can you please help?

[@mayurnagdev5545]

turns out I had to use the following consumer configuration: Map map = Map.of(ConsumerConfig.BOOTSTRAP_SERVERS_CONFIG, "localhost:9092", ConsumerConfig.KEY_DESERIALIZER_CLASS_CONFIG, StringDeserializer.class, ConsumerConfig.VALUE_DESERIALIZER_CLASS_CONFIG, JsonDeserializer.class, JsonDeserializer.TRUSTED_PACKAGES, "com.example.kafka_consumer_javatechie.model,com.example.kafka_youtube_javatechie.model", JsonDeserializer.USE_TYPE_INFO_HEADERS, false, JsonDeserializer.VALUE_DEFAULT_TYPE, "com.example.kafka_consumer_javatechie.model.User");

[@sumanthkumarmakkena7617]

Can you send me core java complete

[@komaljayswal5070]

Thank you