Azure Synapse Analytics - Working with the Common Data Service with Synapse & Spark

[@bhaveshpatelaus]

Thanks Simon. I have tried the same example this week and it is an interesting integration. You are doing the work what Microsoft team supposed to do. Great work!

[@AdvancingAnalytics]

Hah - as long as they keep developing the products, I'm happy to do the nerdy talking about things :) Simon

[@SultanKhan-fq5jq]

How to check and update connector version on Synapse Analytics ?

[@LandscapeInMotion]

Hi Simon - nice vid mate! Any CDM connector for a Synapse SQL instance? Also, how do you update CDS CSV files with updated data? Delete and recreate CSV files?

[@abhimanyunaruka3679]

Hi Simon , thank you for this video . Going beyond this do you have any idea on how to create view/table on OnDemand sql using the CDM folders on data lake Gen2 as a source.

[@bertlemmens7451]

Another great video! Would you know, Once you load data into the CDM (ADLS) is it then also available as a powerapps entity so you can used it into an new canvas or model-driven app?

[@AdvancingAnalytics]

Hrrrm - good question! I've not actually looked into whether updates to the lake CDM actually get written back to the cloud/PowerApps CDS or whether it's a one-way sync. I'll see if we can add it to our backlog :) Simon

[@fabiocarello6542]

Thanks Simon, this wil help a lot of people. I have a question: once my CDS data has been pushed into the ADLS (let's say with the model.json pattern), which option we have in terms of querying them using a SQL Pool?

[@AdvancingAnalytics]

Honestly, don't know. Main use case for the common data store is shifting data over to the Power Platform side (Power BI, Power Apps etc). I've not looked into whether SQL On-Demand/Provisioned Pools can understand the CDS structure. I'll add it to my "to figure out" pile :) Simon

[@lofimixradio]

still in preview :(

[@NeumsFor9]

I almost feel as though Common Data Service (Dataverse) is the Azure cloud version of Master Data Services.

[@AdvancingAnalytics]

We've used it like that a couple of times in the past, but it feels fairly limited and is a pain if you need to maintain a PowerApp for business users to keep the data updated!

[@NeumsFor9]

@@AdvancingAnalytics It certainly appears that way. On another front, hopefully the Synapse Spark to Synapse SQL Connector is soon able to append to an existing SQL Pool table....although it seems more like a polybase issue than anything?

[@zycbrasil2618]

it is all about MDM

[@AndreasBergstedt]

1st again :)