Azure Data Factory (ADF) Quick Tip: Reusable Data Flows A.k.a Flowlet

[@satyakanungo4176]

Excellent

[@dataplatformcentral3036]

Thanks Glad that you found it useful

[@vt1454]

Great Demo !!

[@dataplatformcentral3036]

Thanks Glad that it helped :) Feel free to like, share and subscribe

[@rajavarman4657]

Very detailed information with step by step demo. Great work !

[@dataplatformcentral3036]

Glad it was helpful! Feel free to like, share and subscribe :) Make sure you hit bell icon for getting notifications on future videos

[@yadhuram2808]

Was really helpful but in the demo why we are duplicating the input? We can use the aggregate with the input and use the same input for join as well right?. Please let me know if there is any other perfomance concerns for this trick. Would be really helpful.❤

[@dataplatformcentral3036]

How else will you pick out max date for each customer group and get entry corresponding to that? The logic used here is same as what you do in T-SQL query. There you use derived table to do aggregation and join to it. Here for the same purpose you duplicate input stream, aggregate and then join back.

[@yadhuram2808]

@@dataplatformcentral3036 we can use the initial input for finding the aggregate and join same input with the aggregate result without duplicating it. In T-SQL also we can use a alias select with group by for the same without creating an aggregate table. I have implemented a data flow in that manner and worked properly.

[@dataplatformcentral3036]

sorry didnt understand Can you share the pipeline? In T-SQL it's a derived table that you will create for the aggregation