Gotchas! in Event Driven Architecture - What you need to be aware of

Event Driven Architecture has a few gotchas. Things that you always need to be aware of or think about. Regardless of whether you're new to Event Driven Architecture or a seasoned veteran, these just don't go away. Let me cover 4 aspects of event driven architecture that you need to think about.
🔗 EventStoreDB
eventsto.re/co...
🔔 Subscribe: / @codeopinion
💥 Join this channel to get access to source code & demos!
/ @codeopinion
🔥 Don't have the JOIN button? Support me on Patreon!
/ codeopinion
📝 Blog: codeopinion.com
👋 Twitter: / codeopinion
✨ LinkedIn: / dcomartin
📧 Weekly Updates: mailchi.mp/63c...
0:00 Intro
0:34 Duplicate Messages
3:34 Consistent Publishing
6:37 Bypassing your API
8:11 Handling Failures
#softwarearchitecture #softwaredesign #eventdrivenarchitecture

[@LuisRuizHalo]

In addition, duplication may happen even from the system design of the broker as it requires to be highly available. Moreover, a replication strategy between data held among shards is required to be implemented, leading into duplication of messages regardless our acknowledgment mechanism.

[@redouane5626]

Your videos are concise and contain tons of information, Thanks!

[@CodeOpinion]

Thanks!

[@rodrigoalves8554]

Congratulations for the high level of your channel! Great content! Best Regards

[@shahrazkl]

Another great topic and great video! Thank you!

[@CodeOpinion]

Glad you enjoyed it!

[@sanjevsaalaivazan7786]

Thanks a Ton, Will try to send more often.

[@CodeOpinion]

Thank you! I really appreciate that!

[@brightshadow9480]

Tip: don't use a full white background. Those with HDR monitors thank you.

[@gokera.9935]

Nice one, thanks.

[@hrtummala]

Gotcha🙂, question on DLQ ..if your consumer is calling I/O service to make state changes then there is always a great chance that newer message gets successful than the old message in DLQ. How do we handle this ?

[@CodeOpinion]

Depends what your consumer is doing. This one is hard to explain via a comment and I should probably create a video about ordering and expectations. The short answer is don't create event consumers that try and use event state to maintain some type of their own state. Expect to consume out of order.

[@hrtummala]

@@CodeOpinion thank you. Will look forward for the video.

[@aleksg2925]

Love your videos! At 4:30 state update and message sending is in two separate transactions. I know you're familiar with the outbox pattern (you have a brilliant video about it) - dont you think these two operations _always_ need to be done in one transaction? If not, you have 'at most once delivery'. You wont even have eventual consistency - in a large production system you're basically guaranteed inconsistency?

[@CodeOpinion]

Correct, if you aren't using the outbox pattern then you could fail to publish the event to the broker but still have saved state. If you are using the outbox pattern, then you can also introduce publishing duplicate messages if the publish occurs to the broker, but fails to remove from the outbox.

[@aleksg2925]

@@CodeOpinion Thanks for your answer! Indeed, though duplicate messages seems like a much better problem to have 😄

[@Greenthum6]

You make pizza delivery sound pretty difficult:) Anyways, great info on the topic again!

[@CodeOpinion]

Thanks! 😃

[@nieve4939]

Regarding handling failures- you're suggesting retrials might have an impact on the overall processing times of other messages by the consumer. But, aren't there buses and brokers that will reintroduce the failed message into the back of the queue, so that other messages will be handled before the failed one will get the retry? In some cases you get this by default, no?

[@CodeOpinion]

At the end I'm suggesting each individual http call to the external service be driven by an individual message in a queue. In that case it will not have an impact on any other work. How it was implemented in the example would have an impact because all the http calls were made within the same process. If one causes an exception is would fail the message. If it was retried, it would end up making duplicate calls that could have worked the first time.

[@kenjohnsiosan9707]

I really love watching your videos so far. but as a beginner like me where I could possibly start implementing this kind of pattern. Do you have sample projects for references.. appreciate some advise. thank you sir. ☺️

[@CodeOpinion]

I'm working on something more complete that involves a lot of the concepts I talk about in these videos. Stay tuned!

[@idan5323]

Hey Derek, nice video! I have a question: What do you think about the design of the Blazor Hero template? I would love to hear your opinion about that

[@CodeOpinion]

I'll take a look. Can't say I've looked at Blazor too much really.

[@idan5323]

@@CodeOpinion Well I actually think blazor is great. I was a bit skeptic at the beginning, but I found out that you can build good looking apps with little effort and almost no js. The performence is pretty good aswell. There are improvements to be made, like better hot reload, but as of now I think it is totally production ready and a real game changer

[@Nekroido]

Thanks!

[@CodeOpinion]

Welcome!

[@EverydayRoadster]

The topic of your talk really is messaging, not eventing.

[@CodeOpinion]

Agreed.