Apache Kafka Tutorial with Spring Boot Reactive & WebFlux | Kafka Tutorial

🔥 Secure your spot now and embark on your journey to becoming a Spring Boot master!🔥
aliboucoding.com/p/spring-boo...
🎁 🚀 COUPON Code: EARLY_BIRD_30
We'll explore the nuances of Kafka Clusters, Producers, Consumers, Topics, Partitions, Consumer Groups, Offsets, and demystify Serialization.
As part of our comprehensive demonstration, we'll construct an entire application designed to consume a reactive REST API stream utilizing Spring Boot Reactive and WebFlux. The producer component will dispatch events to a Kafka broker, while a dedicated consumer will process and store this data seamlessly into a DynamoDB database.
🧑‍💻 Source code: github.com/ali-bouali/apache-...
🌐 Wiki media dashboard: esjewett.github.io/wm-eventso...
🔗 Wikimedia Stream API: stream.wikimedia.org/v2/strea...
🎟 Join this channel to get access to perks: / @boualiali
Recommended Courses:
🎬 Spring Boot security & JWT token: • Spring boot 3.0 - Secu...
🎬 Spring security - Roles and permissions: • Spring boot 3 & Spring...
🎬 Spring Boot - Microservices architecture: • Microservices tutorial...
🎬 DevOps - Github Actions CI/CD: • GitHub Actions CI/CD p...
🎬 Spring Security - KeyCloak integration: • Spring boot 3 Keycloak...
🎬 DevOps - Docker for Beginners: • Docker tutorial for be...
🎬 DevOps - AWS EC2 deployment: • 🚀 Deploy Spring boot a...
🎬 Angular - Full course from scratch: • Angular Tutorial For B...
🎬 Websocket - Chat application one to one: • WebSocket Tutorial wit...
🎬 Spring Security - Two Factors Authentication 2FA (TFA): • Two Factor Authenticat...
🎬 Spring Boot - Swagger UI & OpenApi Decomentation : • Spring boot 3 - OpenAp...
🎬 Spring Boot - Reactive programming & WebFlux: • Reactive Programming w...
🎬 Spring Data JPA & Hibernate: • Spring Data JPA - The ...
CONNECT WITH ME:
👨‍💻. Website: aliboucoding.com
👨‍🏫 Facebook: / 589612651142975
📸 Instagram: / alibou_coding
🎮 GitHub: github.com/ali-bouali
🏘️ Discord: / discord
Table of content:
00:00 Intro
04:02 What is a message broker
06:13 Kafka overview
09:42 Kafka Cluster
11:06 Kafka Broker
12:14 Kafka Producer
12:54 Kafka Consumer
13:37 Kafka Topic
14:46 Kafka Partitions
17:38 Kafka Partitions Offsets
21:37 Kafka Consumer Groups
23:13 Kafka Installation
25:30 Play & Explore Kafka
33:08 Create a new Spring boot project
34:18 Configure Kafka Producer and Consumer
40:50 Configure Kafka Topic
42:57 Create a Kafka Producer
46:10 Create the REST API
48:40 Send the first message
50:36 Create the Kafka Consumer
54:23 Configure Kafka for JSON Object & Serialisation | Deserialisation
58:04 Create Kafka Json Producer
01:01:37 Adjust the REST API
01:03:48 Configure the truster packages
01:07:08 Adjust the Consumer and test the changes
01:09:58 Real world application - Overview
01:15:04 Create the Producer project
01:16:34 Configure the producer
01:18:29 Configure the WebClient (WebFlux)
01:19:25 Create the Wikimedia Kafka Producer
01:21:11 Create the Wikimedia Stream consumer
01:25:14 Consume and Publish to Kafka Topic
01:30:40 Implement the Kafka Consumer
01:35:06 Test the application
01:35:52 Outro
#SpringSecurity #kafka #apachekafka #tutorial

[@oskilochka]

Thank you for the explanation !

[@guuridev]

Not gonna lie, this channel is top tier Spring Boot content nowadays. Straight to the point, made it look so easy, well explained with pragmatic methods, 10/10, salutes from Spain 🫡

[@BoualiAli]

Glad you think so!

[@user-cy7xm8lt9d]

Really Great and Helpful for me Thank you!

[@user-ig9xc9ws4s]

The best kafka tutorial I have ever seen, On top of that the diagrams make the things really understandable and to relate with the code.

[@BoualiAli]

Glad it helped!

[@arefsa6]

Ali, you teach us how to walk and learning to run is our duty. Thank you for your exceptional teachings

[@BoualiAli]

My pleasure!

[@magadiflo-dev]

Great, I really like when you use diagrams, I feel it is easier to understand the concepts, thank you very much for the time you took to share this knowledge.

[@BoualiAli]

Glad you like them!

[@user-mz1rs8tp9y]

Can’t wait to start ❄️

[@BoualiAli]

Enjoy it!

[@mrcoder9401]

This is great, Thanks Ali.

[@abu-dukhan]

Can't wait for this Bro 🔥🔥🔥

[@BoualiAli]

I will be waiting for your feedback

[@MutantBikers]

Thanks you so much for the video ❤

[@BoualiAli]

Happy you liked it

[@user-wh6fj9mj9o]

Zo`r tushintirib qo`yibsiz ,Alloh rozi bo`lsin,ko`p narsalarni sizni darslaringizni ko`rib o`rganyapman👍👍👍

[@BoualiAli]

Thank you

[@tobbythebeast12]

your tutorials are the best.you are my savior as always.keep up the good work.love you 😘😘😘 (plz consider doing tutorial on Kafka streams)

[@BoualiAli]

Noted!

[@achrafplayzz]

great video, thanks a lot.

[@BoualiAli]

Glad you liked it!

[@wilsonvaboum1338]

Autrement dit 😀, very nice tutorail, well done

[@BoualiAli]

hahah

[@abdellatifzouliga5885]

Thank you for this tutorial.

[@BoualiAli]

Glad it was helpful!

[@alexandervasilenko7773]

Cool, Ali! Thanxx a lot!!

[@BoualiAli]

Glad you liked it!

[@haithemmihoubi]

Thanks 🎉🎉🎉❤

[@QuickMixKZ]

Kafka has a reactive client. The title of the video is confusing. I expected to see an example of using a reactive client here.

[@abdelhaibouaicha3293]

Generated by Talkbud: 📝 Summary of Key Points: 📌 Kafka is a distributed, fault-tolerant, and highly scalable message broker and stream processing platform. It can handle large volumes of data streams in real-time and provides advantages such as scalability, durability, fault tolerance, and real-time processing. 🧐 Kafka consists of components such as Kafka clusters, producers, consumers, topics, partitions, offsets, and consumer groups. Producers publish messages to Kafka topics, consumers subscribe to topics and process messages, and topics can be divided into partitions for parallel processing. 🚀 The video demonstrates how to install Kafka and configure topics, producers, and consumers within a Spring Boot framework. It also highlights the importance of serialization, deserialization, and offsets in Kafka. 📌 A real-world example is presented, showing how to create a Kafka topic, configure a producer and consumer, and implement a reactive REST API that consumes data from a streaming source and publishes it to the Kafka broker. The consumer transcribes the messages into a database, ensuring no messages are missed. 💡 Additional Insights and Observations: 💬 "Kafka allows for the decoupling of producers and consumers, enabling flexibility and independence in application development." 📊 Kafka is designed to handle large volumes of data streams and can process millions of messages per second. 🌐 Kafka has a rich ecosystem with connectors for integrating with various data storage systems, stream processing frameworks, and analytics tools. 📣 Concluding Remarks: The video provides a comprehensive overview of Kafka and its components, explaining its benefits and capabilities. It also offers practical examples of how to use Kafka in a Spring Boot application, demonstrating the configuration of producers, consumers, and topics. The video emphasizes the scalability, fault tolerance, and real-time processing capabilities of Kafka, making it a powerful tool for handling large volumes of data streams.

[@BoualiAli]

I like the resume

[@gabrielbatista1712]

very good content thank you.

[@BoualiAli]

You are welcome!

[@farjallahhaythem5675]

great content

[@BoualiAli]

Thank you. Waiting for your feedback

[@rahman_darb]

Thanks bro

[@BoualiAli]

Welcome

[@cartoonnewseasons3461]

Wonderful job thannnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnnks a lot MAN

[@BoualiAli]

Glad you liked it!

[@haykelmaaoui2492]

Great work Ali, we are still waiting to explain how debugging with Intelij like evaluate expression, ....

[@BoualiAli]

I already published a video about that, Check the channel

[@haykelmaaoui2492]

i don't find the video, can you share the link here please @@BoualiAli

[@BoualiAli]

@@haykelmaaoui2492kzbin.info/www/bejne/fWjPi4Wrj7CIhqs

[@jasongoossens]

Very good tutorial! I like the no-fluff approach! (but OTOH, that makes it slightly less tailored to complete beginners 🤷‍♂)

[@BoualiAli]

Glad it was helpful!

[@ferchamin1]

Thank you Sebas Battaglia!

[@BoualiAli]

You are welcome!

[@naderayed9562]

Thank you very much, Mr. Ali, for your efforts,I appreciate it

[@BoualiAli]

sure, soon

[@AmayasABBOUTE]

Great tutorial ! Do we need a zookeeper systematically when we use kafka ?

[@BoualiAli]

Yes we do. It is the brokers orchestrator

[@iampradeephr]

Please do a video on KAFKA STREAMS.

[@saurabhmaurya6964]

how can we fetch all the messages from the particular topic after hitting end-point url ?..Help me with this..I tried To do with the help of KafkaConsumer consumer .. this has a method poll .. but after hitting end point i'm getting null in consumer..please help me with this ..

[@ramanav3139]

can you guide me on how to do Kafka clustering in the spring boot application,do one video one how kafka brokers work in real time applications

[@maulanahahaha]

Woaa

[@BoualiAli]

Happy you liked it!

[@user-qq1zb4ke6g]

Did only I notice that the script for introduction is ai generated, and it is obvious that you are reading it.

[@BoualiAli]

is that a sin?

[@TikTokTrendsCompilation]

Finally! Just Please don't make a generic tutorial with boilerplate minimal kafka producer/consumer example. Everyone already made tutorials for that. There are tons of blogs posts for that.I already learned how to setup the basics of kafka to work and many people also figured it out, or if they havent yet they can easily learn in 10 minutes. We don't need another 1057th tutorial showing the basics of producer/consumer with kafka. Please turn this tutorial series into a practical real world project that uses kafka, such as a chat app, live-stream, or any real world usage with kafka. I don't know how to use kafka in a real world project because no one explains it. You could be the first one to finally explain it. How do i even connect kafka to a frontend angular/react/nextjs project? I have no clue. NPM doesnt even have a kafka library. How would i deploy kafka to AWS production app? I have no clue because no one explains it. Please make sure the tutorial series covers these concepts otherwise the tutorial would be no different than 1000s of others that already exist.

[@BoualiAli]

Thank you for your comment and here is my answer. This is not the first time you post a similar comment, that's why I want to clarify things for you. First, I don't create my videos only for you, I create videos for my community and they already voted for todays topic and here the Kafka tutorial is live now (I think you're not part of our community). Second, it seems that you are not a loyal subscriber to my channel because you don't know my teaching style (We don't need another 1057th tutorial showing the basics of producer/consumer with kafka.) Third, I'm getting payed to create content on KZbin, I'm offering free high quality content for my community and I'm not getting any income from it. Fourth, Creating 90 minutes video tutorial, takes at least 4 days (preparing diagrams, coding, recording, editing,...) so you can image how long what you're asking for might need to be ready Fifth, I will create more Kafka tutorials to cover other parts and advanced ones. Thank you for your understanding

[@TikTokTrendsCompilation]

@@BoualiAli why do you keep deleting my comment? i can't reply with valid arguments?

[@BoualiAli]

@@TikTokTrendsCompilation I didn't delete your comment. it is still there and you're already answering my response. Waiting for your arguments.

[@TikTokTrendsCompilation]

@@BoualiAli ​​Not sure why youtube keeps deleting my comment then, i'll try to disperse the comment into 5 comments. 1/5 I know how difficult and time consuming it is to make a video and explain especially an advanced topic. but if youtube is your main job or you earn income from youtube, that should be no excuse.

[@TikTokTrendsCompilation]

@@BoualiAli 3/5 I believe you have the same potential to be the best content creator on youtube but in Spring Boot realm since you also make high quality content. I support and like all of your videos. You need to take my feedback as a constructive positive criticism.