Designing ETL Pipelines with Structured Streaming and Delta Lake- How to Architect Things Right

[@niklaslarsson7320]

Thank you so much for these videos. Really helping me getting into spark and Databricks. Your way of explaining is really impressive, you can see how much you enjoy this. Makes me happy just listening to you :) Awesome job, keep this going!

[@huilund9021]

This is a great video exactly like the title says "architect things right". I like the what & why & how thinking approach.

[@dannydk6]

Amazing run-through of common business/data scenarios. Thank you!

[@berkerkozan3659]

Great real world streaming scenarios. Enlightening

[@christianlira1259]

Thank you Tathagata for this great introductory video which I am fortunate to come across. I wish to see an updated version of this format and please let me know if you are planning on presenting one similar to his at the virtual Databricks summit soon.

[@harshaadigas]

Can you share the slides, please?

[@mansihrana87]

Hi Team, I am creating an ETL pipeline in which I have to read from the azure lake and write to the cosmos in a streaming manner, can I get some examples of the structured parallel stream.?

[@hariszhr]

25:00 did he burp? Lol

[@TathagataDas]

I might have :P