Go serverless: Big data processing with Azure Event Hubs for Apache Kafka | Azure Friday

[@arankin2914]

Scott forgot to make an extra large duck face in the thumbnail.

[@mauricioriano1]

Wonderful , Apache Kafka too...

[@rajdeepsinghborana2409]

Informative ❤️

[@SamirTirmizi]

Excellent Presentation.

[@alessandroantoniodebrito1420]

Hi great presentation. I'm thinking to use this architecture to sync my SQL Server DB in IaaS instation in Azure to MySql Database. But, I should use Kafka Connect to caputure CDC events in SQL and put it on Event Hubs and also to update in MySql. Is it possible?

[@MicrosoftAzure]

Hello Alessandro! Yes, it should be possible to use CDC to sync SQL Server data it to MySQL via Event Hubs using Kafka Connect. Here is an example that demonstrates a similar pattern using Azure DB for PostgreSQL and Event Hubs - msft.it/6056Ta5yK Having said that, this is just one way of doing it, and we're assuming you've weighed other options including their pros and cons based on your use case and requirements. 🙂

[@MrPaulbm100]

Hi really good presentation. I wanted to try some of this architecture out to see if I should use Kafka Connect to capture events from a KAFKA topic and put them on a Event Hubs to update a CRM Dynamics instance. Is it possible?

[@NelsonGiraldo]

How did you solve it?

[@goranbacvar2907]

Scala....really? :D

[@thomasstumpp6061]

Does Kafka-Event Hub work bi-directionally?

[@MicrosoftAzure]

Hey there Thomas! For us to better answer this question, do you mind providing some additional information in regard to the use-case/scenario for "bi-directional" interaction between Event Hub and Kafka?

[@thomasstumpp6061]

@@MicrosoftAzure Using Kafka on prem to publish to EH, but have doubt data can make roundtrip from Azure back to on prem Kafka. I believe other tools needed than EH.

[@MicrosoftAzure]

Thank you so much for the additional context. You could use tools like Mirror maker to integrate on-premise Kafka with Event Hubs. Here's an example. msft.it/6057ThuND As far as on-prem to Event Hubs is connectivity is concerned, it is mostly related to how you might configure the networking stack to enable this. One of the options could be to connect Azure resources to on-prem network using site-to-site VPN as per this guide msft.it/6058ThuNE In your case, it might start with Event Hubs being a part of virtual subnet which is then connected to on-prem Kafka cluster.

[@jibin7277]

Scott's reactions look and sound fake LOL