A BETTER Way to Kafka Event Driven Applications with C#

Рет қаралды 14,795

Күн бұрын

Пікірлер: 40

@danieltravaglia9825 Жыл бұрын

This is a great demonstration on how to build event-driven applications. If you could post a video outlining also the basics of Kafka, that would be awesome! Thanks.

@gui.ferreira Жыл бұрын

Hi Daniel Thanks for the feedback. I will plan a video on the basic concepts needed for a Developer 😉

@JOHNSONLOBOlobojony Жыл бұрын

video outlining the basics of Kafka would be of great help

@gui.ferreira Жыл бұрын

@@JOHNSONLOBOlobojony Coming soon 😉

@gui.ferreira Жыл бұрын

@@JOHNSONLOBOlobojony Here it is 😉 kzbin.info/www/bejne/Zp6pY5SYl8mJars

@gui.ferreira Жыл бұрын

Here it is 😉 kzbin.info/www/bejne/Zp6pY5SYl8mJars

@denathor3886 Жыл бұрын

Clear and straight to the point. Thanks Gui!

@gui.ferreira Жыл бұрын

Thank you 🙏

@bengie23 Жыл бұрын

Great video, short, clear, no extra stuff , please share the basics too

@gui.ferreira Жыл бұрын

Hi Benjamin! Thanks! I will plan a video on the basics 😉

@gui.ferreira Жыл бұрын

Here it is 😉 kzbin.info/www/bejne/Zp6pY5SYl8mJars

@jackdesparrow4783 7 ай бұрын

good Explanation :) I can add this concept into resume.... thanks a lot once again

@gui.ferreira 7 ай бұрын

If you get a job based on just this video let me know 😜

@pbp2387 5 ай бұрын

😂@@gui.ferreira

@ismailm123 Жыл бұрын

Would definately like to see a video on the management API and all the other capabilites.

@predigr 6 ай бұрын

Great video!!! I am wondering where the messages are stored, since producer/consumer apps don't. I am thinking whether Kafka is good for "sync" database changes between 2 databases that should have "same data". For instance, when table X row Y changes, publish a message to Kafka so other app can consume it and update its own "version" of that table.

@gui.ferreira 5 ай бұрын

The messages are stored on Kafka. But keep in mind that there are retention policies in place. That scenario is one of the use cases for Kafka. Take a look at Kafka Connect and Kafka Streams.

@predigr 5 ай бұрын

@@gui.ferreira Oh, thank you for your reply and hints!

@antonyndungu5514 Жыл бұрын

In your AddTaskHandler class, can you inject an Interface, same way you did for ILogger, but that interface has been registered in the pipeline using AddScoped()? When I do that get error message like "Cannot consume scoped service 'IConcreteClass' from singleton 'AddTaskHandler'."

@gui.ferreira Жыл бұрын

I guess it's a lifetime mismatch. You can fix it by either registering as Singleton: .AddScoped() Or, change the Typed Handlers lifetime with: .WithHandlerLifetime(InstanceLifetime.Scoped) You can see it here: farfetch.github.io/kafkaflow/docs/guides/middlewares/typed-handler-middleware#configuring-handler-lifetime Let me know if it doesn't help.

@ismailm123 Жыл бұрын

Love this, amazing work. One question when using parallel consumers, is the parrellism dependant on the number of partitions or you could have 1 partition and still have more than one consumer?

@gui.ferreira Жыл бұрын

Thanks, Ismail. That is the beauty of it. With KafkaFlow you can use workers to get a multi-threaded consumer even with only one partition. Keep in mind that in Kafka there is no point in adding more consumers than you have partitions in a topic.

@musazulu7013 Жыл бұрын

Nice video, i would really like to see how can i add a management api, and dashboard thanks

@gui.ferreira Жыл бұрын

Hi! Take a look here: kzbin.info/www/bejne/rF7Ed56woaeJpqcsi=j3CYYJqDfYeASMAg&t=132

@alexandermackintosh1755 10 ай бұрын

Hey Gui! Thanks for the video. Would you still recommend this now as the way to do things? I know things move fast in the software development world so a year always feels old ! :D

@gui.ferreira 9 ай бұрын

Hey! If I had to create a Kafka consumer/producer today, I would keep using KafkaFlow. However, let me tell you that the company that builds KafkaFlow has been acquired. So, I don't know what is the long-term strategy moving forward. I hope they keep investing in it since it's an amazing framework.

@ismailm123 Жыл бұрын

Is opentelemtry support built in? If not how would one go about plugging that in?

@gui.ferreira Жыл бұрын

At the moment it's not built-in. Even then, I imagine that you could pull it out easily with a KafkaFlow Middleware.

@DaminGamerMC 8 ай бұрын

Great video! How do i do authentication with this? The docs have a demo on de c# side of things but how do i configure it on the kafka side of things?

@gui.ferreira 7 ай бұрын

You can find all authentication methods here: docs.confluent.io/platform/current/kafka/overview-authentication-methods.html

@NelsonGiraldo Жыл бұрын

I need to consume records from Kafka and save them through an web API; would that be done with a middleware and a handler? Thanks :)

@gui.ferreira Жыл бұрын

Hi Nelson! The cool thing is that you can do it with a Middleware or a Typed Handler. Typed Handlers are Middleware in fact. Either way, if your records can be of multiple types, I would recommend using Typed Handlers.