Synapse Analytics - Querying Delta Lake with Serverless SQL Pools

Back in the dawn of time, when the Azure Synapse Analytics preview first came out, we talked a lot about how great Serverless would be when it could query delta. It's taken longer than we thought, but we can finally query delta tables using the whizzy, super fast tool... but how efficient is it?
In this video, Simon delves into the preview delta functionality, looking at some common tasks when querying Delta and seeing what holes still exist in the preview.
More info is available on the preview here: docs.microsoft.com/en-us/azur...
As always, don't forget to like & subscribe - and let us know what you think!

[@drummerboi4eva]

nice video, clearly explains the value of serverless sql pools

[@EngineerNick]

Thankyou for the video :) I was super excited to try this feature, but turns out you cant do time travel queries from the SQL serverless ;( For me that really makes me question if delta is worth the extra complexity in synapse.

[@colinrippey1723]

Hi Simon, want to say again all of your videos are brilliant! Do you know if Synapse will add support for Delta ZOrdering and/or bloomfilter indexes? If Synapse does add support do you think that SQL On Demand will also make use of these additional Delta on disk artifacts?

[@madhur6504]

Hi Simon,Could you please advise if we should configure gateway when we are loading data from azure synapse (in cloud)

[@lukasu-ski4325]

gateway between what? Synapse and ...? If you have an ADLS then just create a linked service.

[@bolisettysunil]

Hi @Simon - I have question, do you know if querying Delta Lake files using Synapse Analytics serverless sql pool is supported ?

[@lukasu-ski4325]

Isn't it what he shows in the video?

[@crazybauns]

hi Simon, can we use delta tables as source for SSAS? i want to build a tabular model but cant connect to delta tables Can this be done?

[@lukasu-ski4325]

Maybe you could create views or external tables using Synapse serverless and build AAS on top of it? It wouldn't be so expensive I suppose.

[@darryll127]

How is this working or going to work with the Unity Catalog instead of reading from the Lake w/o it? Is the answer Delta Sharing? Or something else?

[@AdvancingAnalytics]

Hey Darryll! No sight yet of how Synapse will be able to integrate with Unity Catalog, Delta sharing could be an option, further things with Purview might be, fairly up in the air right now! Si

[@msr_atpeace]

hi simon , could you please explain about the creation of delta table / files which is generated from delta files by applying some sql over it.

[@ManishSingh-if9nj]

Hi Pal ..Thanks for such a informative video ..We are using serverless pool in Synapse platform ..Cost was one of the reason to choose serverless pool ..Now realizing it has got lot of limitation .1 Dynamic data masking not possible with serverless 2. all prebuild DMV you cant run on serverless ..3. Can't run script to do Workload Management ..Do you have any suggestion ..

[@sashankpappu2773]

That should be controlled and not be to considered beyond silver zone . This way we ignore those columns by being exposed

[@AndreasBergstedt]

1st again :)