11. Slowly Changing Dimension(SCD) Type 1 Using Mapping Data Flow in Azure Data Factory

  Рет қаралды 34,982

WafaStudies

WafaStudies

Күн бұрын

In this video, I discussed about Slowly changing Dimension Type1 using mapping data flows in azure data factory
Link for Azure Databricks Play list:
• 1. Introduction to Az...
Link for Azure Functions Play list:
• 1. Introduction to Azu...
Link for Azure Basics Play list:
• 1. What is Azure and C...
Link for Azure Data factory Play list:
• 1. Introduction to Azu...
Link for Azure Data Factory Real time Scenarios
• 1. Handle Error Rows i...
Link for Azure LogicApps playlist
• 1. Introduction to Azu...
#Azure #ADF #AzureDataFactory

Пікірлер: 25
@sagar_patro
@sagar_patro 4 жыл бұрын
Thanks a lot WafaStudies, really this is a great explanation for type-1 and eagerly we are waiting for SCD-2 part. Please post soon :) !!!!
@Extream917
@Extream917 4 жыл бұрын
Good use case with detailed explanation
@tech_studies2369
@tech_studies2369 2 жыл бұрын
Very clearly explained ,..loved your videos always, thank you Wafastudies 😊
@WafaStudies
@WafaStudies 2 жыл бұрын
Thank you Priya 😊
@a2zhi976
@a2zhi976 Жыл бұрын
This is good , no too many columns used in the jobs.
@vssrikanthgarnepudi5952
@vssrikanthgarnepudi5952 4 жыл бұрын
Really cool stuff and it’s very use full. Can you make tutorial on Azure service bus & datagrid.
@satyareddy8139
@satyareddy8139 2 жыл бұрын
Hi wafa!! Can I use upsert option available under copy activity for the same purpose
@shivanidubey1616
@shivanidubey1616 4 жыл бұрын
Sir pls share video related to Azure data warehouse and external tables
@srujankumar887
@srujankumar887 2 жыл бұрын
Hi, this is good. I followed these steps and did this using delta files in Data lake, it’s doing inserts & updates as expected. But, one thing we are missing is RecordCreatedDate & ModifiedDate columns. If weadd a created date as getdate, it’s updating each and every row since the time is changed now in that column. Can you please suggest how to capture the updated time in this scenario?
@sirojiddinsobirov5508
@sirojiddinsobirov5508 3 жыл бұрын
Hi Wafa, thanks for great videos, I have a question: what if you have 1 million rows in source and let's say 20000 rows in sink which has same value as source. In this scenario, will it update these 20000 rows again as well ( even if , it matches)?
@SushilChauhan
@SushilChauhan 3 ай бұрын
it should update the only the changes
@arun06530
@arun06530 3 жыл бұрын
very nice & explained well.
@WafaStudies
@WafaStudies 3 жыл бұрын
Thanks for liking
@souvikjana2993
@souvikjana2993 2 жыл бұрын
Thanks!
@WafaStudies
@WafaStudies 2 жыл бұрын
Welcome 😊
@himanshutrivedi4956
@himanshutrivedi4956 3 жыл бұрын
Hi Can you please put SCD type 2 video..it really helpful..and appreciate in advanced...
@jagrutipatra7584
@jagrutipatra7584 4 жыл бұрын
Thank you for this video. In the scd2 could you please try to explain the scd2 data flow template already present in Microsoft .
@Akshay50826
@Akshay50826 Жыл бұрын
Thank you :)
@mahammadshoyab9717
@mahammadshoyab9717 4 жыл бұрын
Good video wafa, the only point i absorb here is you are hard coding filename and table name,if you make parameterization ,that willbe most real time scenario.
@kalananr2884
@kalananr2884 2 ай бұрын
I have problem where are checking if sink has those data
@himanshutrivedi4956
@himanshutrivedi4956 3 жыл бұрын
Hi Wafa Studies please show incremental loading video as well.
@arpitbest
@arpitbest 4 жыл бұрын
🙏🏻
@insane2093
@insane2093 2 жыл бұрын
In SCD type 1 : if i want to update 2 column rest of 4column .is it possible?
@saikumar-it1gl
@saikumar-it1gl 4 жыл бұрын
Hai bro i have one scenario that i have to copy files from blob to sqldb where file size is greater than 20 mb how can i achieve that
@gowthamg2472
@gowthamg2472 3 жыл бұрын
Hi, is there any other way to get in touch with you regarding doubts?
12. Get Count of Files in Folder using Azure Data Factory
13:20
WafaStudies
Рет қаралды 26 М.
отомстил?
00:56
История одного вокалиста
Рет қаралды 5 МЛН
АЗАРТНИК 4 |СЕЗОН 1 Серия
40:47
Inter Production
Рет қаралды 1,4 МЛН
21. Dynamic Column mapping in Copy Activity in Azure Data Factory
23:43
Slowly Changing Dimensions(SCD) Types with Real time examples
27:10
The Data Channel
Рет қаралды 4,7 М.
61. Databricks | Pyspark | Delta Lake : Slowly Changing Dimension (SCD Type2)
20:03