Debezium - Capturing Data the Instant it Happens (with Gunnar Morling)

This week we’re looking at Debezium - an open source project that taps into a huge number of databases and lets you stream data to other systems in real time. It’s a huge project that covers a wide range of uses: Some people use it to replicate from Oracle to MySQL, others to do smart cache invalidation, and others to build a bridge from an existing relational database to the event-sourcing world. If you’re working on a system that has more than one kind of database, it may be an essential tool. But what exactly does it do, and how does it do it?
Joining us for a deep dive is Debezium expert and former project lead, Gunnar Morling. He takes us through all things Debezium, from who uses Debezium and why; which systems you can connect to and what data you get out from it; and how a project of this scope is developed.
Gunnar on Twitter: / gunnarmorling
Gunnar on LinkedIn: / gunnar-morling-2b44b7229
Gunnar’s blog: www.morling.dev/
Kris on Twitter: / krisajenkins
Kris on LinkedIn: / krisjenkins
Gunnar’s talk on the new incremental snapshot mechanism: events.bizzabo...
Getting into Real Time data: • Real Time Data - Why i...
Stripe’s talk at Flink Forward: www.slideshare...
Francesco’s “When JDBC Goes Wrong” talk: www.confluent....
#debezium #microservicesarchitecture #cdc #database #postgresql #oracle #mysql #eventsourcing #kafka #jdbc #realtime

[@davidshipman5964]

Awesome interview!

[@VolcanoDungeon]

Around 39:40, the question asked to Gunnar isn't really answered. I (also) get the feeling he has doubts on using debezium as a way to replicate databases from one DB-type to another. Still, very glad Jenkins noticed that, valuable in an interview like this. It got me curious: anyone got an idea why Gunnar hesitated there? One thing that comes to mind, you might have problems with datatype mapping?

[@HikarusVibrator]

How is a company supposed to automate DB upgrades? Every single part of all our infrastructure is automated, or in the process of being automated. But it’s almost impossible to automate if a Debezium connector is present. How in the hell are big companies doing it!?