Merging your data in a modern lakehouse data warehouse

[@craigbryden3747]

Great Video. I'd love to see a future one addressing how to handle type 2 SCDs.

[@arthurcsp]

Great video! That's exactly what I was searching for early. Thanks a lot!

[@BooranJohnsonRishka]

Thank you for the video, this is amazing! I've been following this playlist of "Building a modern data lakehouse in Azure Synapse". Up to to this video demonstrates Inserts and Updates, but what about Deletes from the Bronze layer to Silver Layer? Can you please make a video about deletes in Synapse SQL, thanks.

[@gabrielmorais7312]

Great vid, Thanks guys! Let me ask you, is there any difference in the cost of execution when you run a notebook using PySpark or SQL?

[@stijnwynants7307]

Hi Gabriel, both use the same SparkAPI in the background so they should cost/perform about the same. The cost is the amount of time your cluster runs!

[@gabrielmorais7312]

@@stijnwynants7307 thank you very much Stijn!!

[@germanareta7267]

Great video.

[@nickleshkevich6153]

Supercool!

[@LandscapeInMotion]

Hi Stijn - how do you keep running the merge statement so that you get live data in your SILVER layer?

[@EmmanuelAguilar]

Question?. When my data merge with new data I need to re-build the data base in the workspace?, or the data base in the workspace read the delta file and have the changes?, please help me

[@avinashkanche2993]

Nice 👍

[@pini22ki]

Why delta is not supported in azure synapse dedicated sequel pool?

[@rohanbhattacharyya6600]

It's a sql analytics engine. Delta is an Apache spark feature.

[@prateekraina2781]

Cool 😎

[@bunnihilator]

It's not clear how this tie up to the first time data load to bronze.

[@aamoody81]

This is great stuff