The Serverless Real-time Lakehouse in Action

We will tackle the challenge of processing streaming events continuously created by hundreds of sensors in the conference room by a serverless web app (bring your phone and be a part of the demo). The focus of this session is on the system architecture, the involved products and the solution they provide. Which Databricks product, capability and settings will be most useful for our scenario? What does streaming really mean and why does it make our life easier? What are the exact benefits of serverless and how "serverless" is a particular solution?
Leveraging the power of the Databricks Lakehouse Platform, I will demonstrate how to create a streaming data pipeline with Delta Live Tables ingesting data from AWS Kinesis. Further, I’ll utilize advanced Databricks Workflows triggers for efficient orchestration feeding into a real-time dashboard. And since I don’t want you to leave with empty hands - I will use Delta Sharing to share the results of the demo we built. Join me in this hands-on exploration of cutting-edge data engineering techniques and witness the future in action.
Learn more about DLT
www.databricks...

[@alexandergauthier7824]

Great end to end demo.

[@AndreasTeroerde]

Love the phone-shaking part. Awesome demo Frank!

[@andre1488adjwidhx]

Amazing!

[@FreelacerHanifkhan]

That's good❤