DP-203: 16 - Executing ADF pipelines

[@souvikdas811]

Please keep this course going. There are very less courses available that is as good as yours.

[@fekasng2010]

Thank you very much and may God give you more grace, strength to complete the series..

[@LATAMDataEngineer]

Excelente!!! I'm really impressed with the quality of these videos and the depth of knowledge they provide.

[@prabhuraghupathi9131]

Very useful video on triggers to understand clearly.!! Thank you !!

[@soumikmishra7288]

Another useful resource. I faced one issue though in storage event trigger, it was not auto populating/recognizing the "raw" container for my storage account even though i have a raw container in it. But anyway i learnt a lot. Thank you!!

[@rashashawky365]

thank you, this is realy useful

[@TybulOnAzure]

Glad it was helpful!

[@mohamedyengui5632]

Thank you very much for the hard work 🙂Why is the windowstartTime in the pipeline parameters and the trigger parameters don't have the same values (8:42 and 7:42)

[@TybulOnAzure]

Good catch! I guess that one of them was displayed in UTC and the other one in my local time (CET). So it was like this: 1. Trigger was defined using UTC time zone. 2. In the Trigger Runs we saw 8:42 - it was executed at 7:42 UTC = 8:42 CET. And I had local time (CET) configured in the UI. 3. In the Pipeline Runs (parameters) we saw 7:42 as that was the UTC time converted to a string. Please also note that it is possible to change a time zone that is used to display dates.

[@SarangKulkarni-b9i]

Hi Piotr, Could you please let us know that whether the course to clear DP-203 is finished, or is it still an on going course? The reason I am asking this is that I want to set a plan to cover everything, so that I can appear for the exam and clear it well. Hence, I wanted to know if the course is completed or not?

[@TybulOnAzure]

Hi, the course is almost finished - in total there will be probably 54 episodes.

[@shraddhachoudhary8048]

is setting up window start time in past will work for running the tumbling window for previous period?

[@TybulOnAzure]

Yes, take a look here for details: learn.microsoft.com/en-us/azure/data-factory/how-to-create-tumbling-window-trigger?tabs=data-factory%2Cazure-powershell#execution-order-of-windows-in-a-backfill-scenario

[@shraddhachoudhary8048]

Thanks much@@TybulOnAzure

[@KAshIf0o7]

Can we trigger storage events in sub folders too like i want to trigger storage event whenever a new file is uploaded to raw/ or raw/folder1 or raw/folder1/subfolder like that so i've to configure a new storage event for each folder or we can use the previous one with some configuration options available?

[@TybulOnAzure]

You can use subfolders but if you want to target only a subset of them, e.g. raw/folder1 and raw/folder2 (but not raw/folder3), then I think you would have to use two different triggers - each for every folder. Take a look here for more details: learn.microsoft.com/en-us/azure/data-factory/how-to-create-event-trigger?tabs=data-factory#create-a-trigger-with-ui

[@piotrczechowski5585]

Dzięki

[@zouhair8161]

❤❤❤❤

[@christianraouldjatio1738]

🙏🙏🙏💪