Azure Data Factory || Slowly Changing Dimension || scd type 1 Concept and implementation

  Рет қаралды 8,619

Learn N Relearn

Learn N Relearn

Күн бұрын

Content : Azure live scenario example. Understanding the concept of SCD Type 1 and implementing through azure data factory.
1. data flow activity
2. source, ref table, sink
3. exist transformation
4. Alter Transformation
Next Video : Slowly changing dimension type-2 concept and implementation
Please share your feedback on this and subscribe to our channel.

Пікірлер: 18
@kandulagaming8186
@kandulagaming8186 2 жыл бұрын
Excellent .. Explanation _____ GOOD ..GOOD .. This is Wonderful 100 Percentage :: I have seen many persons Videos
@harishkonakandla
@harishkonakandla 4 жыл бұрын
Nice explanation, thank you for your videos
@learnnrelearn7553
@learnnrelearn7553 4 жыл бұрын
Thank you
@muraliyadav7601
@muraliyadav7601 4 жыл бұрын
Hi, we can use UPSERT option in the alter row transformation to accomplish SCD type 1 for both insert and update based on a key column, why do we need to Exists transformations here, can you explain.
@annekrishnavinod5482
@annekrishnavinod5482 3 жыл бұрын
@murali yadav - i agree your comment. can you share me your idea/video for scdtype2
@mr.prasadyadav
@mr.prasadyadav 3 жыл бұрын
Nice Lecture , Thank you
@sureshmekala2828
@sureshmekala2828 2 жыл бұрын
Well explained medam Tq
@zramzscinece_tech5310
@zramzscinece_tech5310 Жыл бұрын
Do we need to create one data flow for each dimension? any alternative?
@MrVivekc
@MrVivekc 3 жыл бұрын
nice tutorial...as per my understanding, this updateif logic will check for updates in all columns of tgt, if yes then i want to update only location, is there any way to implement such logic, like if empsrc==emptgt, then check if empSrcLocempTgtLoc (only change i want to track), then flag the row for update and then update only that column and dont check for all the column changes.. pls answer.
@deepakraj-gu2ij
@deepakraj-gu2ij 4 жыл бұрын
In this, update will happen for all IDs present in both source and target even if there is no changes in other column values? if I want to perform update only for those IDs for which values are changed in source. how will that work?
@madanl2208
@madanl2208 2 жыл бұрын
Uploaded more videos Madam..your teaching is very well..plz upload
@samuelrocha9079
@samuelrocha9079 4 жыл бұрын
Hi, very good explanation. I just have one question. in the Sink you clicked in "Allow Update", this doesn't mean that will update right? You are just granting a permission to update? I'm asking you this, because you used the AlterRow and set up as "Update If". Thank you for the video
@samuelrocha9079
@samuelrocha9079 4 жыл бұрын
Just to clarify my question, could I skip the AlterRow step? My update would work? Thank you!!
@learnnrelearn7553
@learnnrelearn7553 4 жыл бұрын
@@samuelrocha9079 You can not ignore the Alter Row transformation because if you are performing any delete, update or upsert activity, you need to add the alter row transformation to set row policy. Else you will get validation error.
@learnnrelearn7553
@learnnrelearn7553 4 жыл бұрын
Yes, data is getting updated in sink in that particular step.
@moesmael
@moesmael 4 жыл бұрын
Thank you for the presentation, but you did not mention how to define surrogate key, and how to manage date fields, you just insert it as string, can you clarify that please
@ramandeepsingh8227
@ramandeepsingh8227 3 жыл бұрын
Hi Mohammad, She created identity column for surrogate key in sql table. And it automatically update the surrogate key column
@kandulagaming8186
@kandulagaming8186 2 жыл бұрын
Simple -- English Language ::: Even anybody (NON-IT Persons ) is able to understand ..
Azure Data Factory Parametrization Tutorial
22:07
Adam Marczak - Azure for Everyone
Рет қаралды 181 М.
Wall Rebound Challenge 🙈😱
00:34
Celine Dept
Рет қаралды 19 МЛН
Quando eu quero Sushi (sem desperdiçar) 🍣
00:26
Los Wagners
Рет қаралды 14 МЛН
Правильный подход к детям
00:18
Beatrise
Рет қаралды 10 МЛН
Azure Data Factory Mapping Data Flows Tutorial | Build ETL visual way!
26:25
Adam Marczak - Azure for Everyone
Рет қаралды 232 М.
SCD Slowly Changing Dimension   An Ultimate Guide
13:05
RADACAD
Рет қаралды 3,7 М.
Generic Type 2 Slowly Changing Dimension using Mapping Data Flows
14:19
SCD: Slowly changing dimensions explained with real examples
25:43
Processing Slowly Changing Dimensions with ADF Data Flows
1:10:53
Pragmatic Works
Рет қаралды 28 М.
Wall Rebound Challenge 🙈😱
00:34
Celine Dept
Рет қаралды 19 МЛН