Processing Slowly Changing Dimensions with ADF Data Flows

[@reckitt9173]

16:42 Correct me if I am wrong. This step will be prove bottleneck when data count is higher. Instead it would have added at 24:04 as lookup. We need a logic here for a data whose records found can be consider update and for other is insert.

[@abelfelleke7290]

Thank you it neat and briefly explained

[@vishal259]

It would be good if you can upload scripts you have used in demo. It would be a good reference for audience.

[@Sarabjitsethi]

how are u taking care,if same hash exists ?

[@terryliu3635]

Great intro! Thanks!

[@shivanityagi1073]

Can you please explain how to implement type 3 and type 2 scd in adf?

[@moesmael]

It was a very good explanation, but in Insert Sink, it will not insert newly updated rows with new Keys and new ActiveEnddate. Please make sure about the process, but I would like to thank you very much, it was a very good demo and helpful

[@rohitnath5545]

Why do you think it wont work

[@YTEEsenior]

On insert for uniqueidentifiers, how can you create a "new guid"?

[@bobrubocki5305]

Assuming you are loading to a SQL Server DB, you could create a default constraint and use the NEWID() function.

[@jagadishparale8632]

Can you share the files used in the demos

[@theownmages]

how would i quarry to get a view of a dataset looked like at a spesific date, if i structured it like this type 2?

[@srinin6252]

its great explanation ,can you provide me the source file which you used for current SCD Type one? will try for that

[@saswatibhattacharjee4992]

kzbin.info/www/bejne/Y5SqgaGEeZdrbpI

[@abelfelleke7290]

Can you make a video which shows how you transfered those data set files

[@bobrubocki5305]

For this demo, I manually uploaded the files with Azure Storage Explorer.

[@kal1leo]

how do I export and import a data factory including all the pipelines,data flows & data sets?

[@rameshchowdary6390]

You can go to resource group where you created your data factory and click on export. It generates json code then click on download. ARM Template will be downloaded to your local machine.

[@amitnavgire8113]

ITs just too slow and requires a lot of patience to watch this video...