Synapse Espresso: Introduction to Delta Tables

Welcome to the 9th video of the Synapse Espresso series!
In this video, Stijn is joined by Jovan Popovic, a Program Manager on the Serverless SQL team, to walk us through the basics of Delta Lake, such as what Delta Lake format is and how it enables us to update our data in the Lake. They will also show us how serverless SQL pool enables us to query data in Delta Lake format.
Delta Lake delta.io/
Querying Delta Lake format in serverless pool learn.microsoft.com/en-us/azu...
Jovan Popovic - Senior Program Manager
/ jovan-popovic
/ jovanpop_msft
Stijn Wynants - Fasttrack Engineer
/ stijn-wynants-ba528660
sql-stijn.com/
/ sqlstijn
#azuresynapse #serverless #sql #analytics #deltalake

[@ViniciusRibeiro-kz2pe]

Jovan gave us a very clear explanation about how we can travel in time with the data to read. Tks a lot!

[@bernardherrok9748]

Total commander on the taskbar. Respect, Jovan.

[@vijaykj1819]

simple & nice explanation of delta protocol how it works.

[@aditiiyer3476]

Very well explained, Thank you!

[@germanareta7267]

Great video.

[@SilvanoPaxia]

Great Video, very clear! Any chance of creating a video on how to manage SCD Type 2 in Delta Lake?

[@stijnwynants7307]

Hi Silvano, Let's see if we can set that up!

[@AlexWalton]

Were you able to set that up? I have the same question!

[@LaurentKoelink]

Wondering, if you have many changes to the source data, aren't you replicating the data that isn't changed often? Is there a recommended filesize (# of records) per parquet file? Are files split up when changes are made (all the old unchanged data, and a separate file for just the changes). Any recommendations / considerations? Could be "old school thinking" ;-) - Great video by the way!

[@lijnenjoost]

Thx! Will it be possible to timetravel with SQL scripts as well?

[@stijnwynants7307]

Hi Joost, at this point in time it is not possible

[@encryptedunlimited1094]

How do i get my own synapse tshirt. I love it

[@pini22ki]

Hiw can i read delta versions in serverless?

[@sid0000009]

Can an API hosted on an App service in anyway fetch Delta tables data ? thanks

[@avicool08]

Pls show how to connect to PBI too

[@AzureSynapse]

Abinash, check out this video: kzbin.info/www/bejne/jn7CZpaobd2SeLs. In the demo part related to Power BI datamart we show how to connect to Azure Synapse serverless SQL endpoint. And here is the whole Azure Synapse + Power BI Datamart video series: kzbin.info/aero/PLzUAjXZBFU9MQ1GEPcSv1hOgZ9r7dJodn.

[@advaithdenesh9906]

The best soft cos when ur stoned

[@omerturkoglu4259]

can we say that delta is based on parquet? So Delta is nothing but an advanced Parquet?