BEWARE of Consumer Lag! Event Driven Architecture Monitoring

An essential aspect of Event-Driven Architecture is understanding how your system is performing (throughput). Everything is running smooth, and services are publishing and consuming events, and then out of nowhere, one service starts failing or has significant decrease in throughput which then causes havoc to your system. Let me explain some of those reasons and why having metrics and alarms will allow you to proactively make changes to keep everything running smoothly.
🔗 EventStoreDB
eventsto.re/codeopinion
🔔 Subscribe: / @codeopinion
💥 Join this channel to get access to a private Discord Server and any source code in my videos.
🔥 Join via Patreon
/ codeopinion
✔️ Join via KZbin
/ @codeopinion
📝 Blog: codeopinion.com
👋 Twitter: / codeopinion
✨ LinkedIn: / dcomartin
📧 Weekly Updates: mailchi.mp/63c7a0b3ff38/codeo...
0:00 Intro
2:29 Consumer Lag / Queue Length
4:28 Competing Consumers
5:29 Increased Processing Time
6:29 Ordering
#eventdrivenarchitecture #softwarearchitecture #softwaredesign

[@CodeOpinion]

If you're a long time watcher you may have noticed the black background in the presentation. Let me know if you prefer it or my usual white background in slides.

[@anreton]

Dark theme is cool)

[@ItzukiTheDemon]

Black background 👍

[@MisterNOmercy]

Hey Derek! I much prefer the blackground over the old one, it's less distracting! If you are looking for things to change, I would recommend checking how it differs if you wear a non-black shirt with a bit more colorful (but not too distracting) color? You kind of blend in with the background one. Perhaps another background light source would also be good. The last one was too white and bright, but now the background is perhaps a bit too dark? Nick chapsas wears dark clothing in a dark chair but has purple lighting in the background which makes it work very well. In any case, I really think this is a good improvement!

[@AntonOtto]

Dark looks better

[@JohnDeFalco68]

Dark background please

[@ToeShimmel]

Love the dark mode slides!

[@DOTNETMAN]

Can you make a video comparing Kafka and RabbitMq? Which one is better for queue messages, how to choose in dev purposes

[@CodeOpinion]

Check out this video and see if that answers some questions: kzbin.info/www/bejne/mqHPZauBoLWrfrs

[@sol-3uk]

Really informative, thanks for this

[@CodeOpinion]

Glad it was helpful!

[@vincentvogelaar6015]

Valuable

[@sushilb7994]

Nice video. How the dashboard is built?

[@JohnDeFalco68]

If it's the same as it was years ago, in your NSB endpoint you enable monitoring and then the endpoint will produce meta data information that the Particular Software ServicePulse product will pick up and interpret into that dashboard. You bring up a ServiceControl Monitoring instance and connect ServicePulse to it.

[@baseman00]

A big note: not all lag monitors are created equal - this will impact your ability to identify slow consumers.