Kafka Stream Processing | Spring Boot

[@francksgenlecroyant]

Thanks brother Mania! it helps a lot! Keep producing videos about Spring Boot + Kafka!

[@FullstackMania]

More to come!

[@dynamicdivyavlogs8101]

@@FullstackMania We are deploying springboot microservice in EKS cluster. We have new requirement to consume Kafka messages of other organisation. But is it required to configure in our AWS environment. Or can we consume with zookeeper broker instance.

[@BallaPruthviraj]

Thank you sir

[@amitbarud]

Thank you my friend, I am new to kafka stream world and I was exactly looking for this. God bless you

[@Software.Engineering.in.Action]

Perfect explanation, but unfortunately not all my questions closed. The simplest question can be answered here. 1. Is it possible to specify kafka `group-id` for input stream? And more complex one needs different video maybe. 2. How to connect to secured kafka using jks?

[@yashchudasama3078]

Question1:- Properties properties = new Properties(); properties.put(StreamsConfig.APPLICATION_ID_CONFIG, "your-application-id"); properties.put(StreamsConfig.BOOTSTRAP_SERVERS_CONFIG, "your-bootstrap-servers"); StreamsBuilder builder = new StreamsBuilder(); KStream inputTopic = builder.stream("your-input-topic"); // Group by key and perform further processing inputTopic.groupByKey().count().toStream().to("output-topic"); KafkaStreams streams = new KafkaStreams(builder.build(), properties); streams.start(); Question 2:- In your Java code, you need to configure the Kafka client with security properties Make sure to adapt the configuration according to your specific Kafka security settings (SSL, SASL, etc.). Additionally, handle exceptions and errors appropriately in your code.

[@Software.Engineering.in.Action]

@@yashchudasama3078 Thanks for you answer. ...but why do you use java configuration at time when streaming is configured in `yml`? I think security configuration must be managed in the same way.

[@vino7tech]

The best example and nice explanation sir. Tq very much siir

[@duylong3684]

Why the Input and Output have through line, they are out of technology?, Can you make a video again about this content with new Kafa Stream Processing nowaday. Tks you so much

[@anandlshinde]

Thanks a lot . most valuable topic . Hi please make video on Kafka consumer

[@FullstackMania]

Sure . Will make video on the same.

[@phanimc11211]

very good explanation to point, the entire video was interesting to listen, plz keep posting more videos of Spring cloud and kafka, THX A LOT

[@FullstackMania]

Will do that bro

[@HimanshuSingh-ti6qw]

How will these two listeners listen simultaneously from one topic and the make sure that takeaway will always listen to takeaway order ,what will happen if it receives home delivery order

[@anushbabu5023]

Thanks for your explanation Bro. It's very nice & clean explanation. Could you please make complete Docker videos for beginner to experts. I will keep following you Bro

[@FullstackMania]

Sure, will do it

[@rroy2812]

For the streams service -- there is no need of JsonDeserializer ? How does Spring Cloud know that data is json type ?

[@FullstackMania]

Json is the default format and it is assumed to be json

[@Xavier12329]

Thanks bro,its clearly understandable.

[@FullstackMania]

Thank you

[@SachinK-q7j]

You did not speak about partition, which you told you will cover on the latter part of the video

[@JS-eh9kl]

Excellent!

[@vasudevayakrishna68]

I have tried the same but didn't receive messages in takeaway-service and home-service console

[@FullstackMania]

It should work. Please try again or else reach out to me over mail

[@aakashkhatavkar7877]

I tried your approach but for me I received messages in home-service but not on takeaway-service 😥 Have you got that working !!

[@MehdiBENGHAZI]

me too @@aakashkhatavkar7877

[@gnanaprakasam131]

awesome video, thanks sir.

[@FullstackMania]

Thank you

[@abdulKareem-ri8ti]

How to deploy and manage on Kafka cluster?

[@abdulKareem-ri8ti]

Apart from docker and kubernetes

[@maheswaraot]

Why you are using depricated annotations when you are creating this video!!!!!!

[@FullstackMania]

Bcs this is still used by most developers

[@przemysawgesieniec3495]

@@FullstackMania It does not mean that it is a good approach! All the bindings should be done by suffixing the topics with "-in" or "-out". That's it.

[@FullstackMania]

@@przemysawgesieniec3495 There is another video where i followed the same approach.

[@thedarkwithinc1]

Media offline randomly appearing LOL

[@usmanshaik778]

2023-05-18T15:54:34.929+05:30 ERROR 4136 --- [nio-8080-exec-1] o.a.c.c.C.[.[.[/].[dispatcherServlet] : Servlet.service() for servlet [dispatcherServlet] in context with path [] threw exception [Request processing failed: org.apache.kafka.common.KafkaException: Failed to construct kafka producer] with root cause