65. Flatten Transformation in Mapping Data Flow in Azure Data Factory

[@mandavillivamsi8592]

Excellent explanation bro !!! Finally I have found very good tutor 😊

[@WafaStudies]

Thank you 🙂

[@Rafian1924]

Simplest explanation and demo. Keep up the good work bro.

[@WafaStudies]

Thank you 🙂

[@kromerm]

Well done, nice job!

[@WafaStudies]

Thank you for your kind words 😊

[@Kohatianayub]

Nice work, appriciated

[@WafaStudies]

Thank you 😊

[@aqshatagade693]

Just adding comment for people who has come in comments section looking for solution for multiple nesting in same file which is not shown in this video. There is new update by Microsoft where using one flatten activity you can unroll multiple arrays. I see when this video was created, the option was not available. @Wafa, great video. May be create one with new functionality for multiple unrolls.

[@nadeemrajabali3166]

Hi Wafa, I am using This($$) to flatten a complex XML file using rule based mapping, I have also ticked deep column traver to include all sub columns. Now the issue is I have so many duplicate subcolumn name therefore an error. Is there a way I can add Hierarchy Level name to sub column name using this($$) function. or any other data flow step I should use?

[@sashafroyland]

Thank you. Very helpful to see a live demo of the denormalization of a JSON (complex data type).

[@WafaStudies]

Thank you ☺️

[@paragpujari3961]

@@WafaStudies please provide the json file

[@francisfriel1242]

If you're going to use powerpoint, in your primary content slides use more graphics and align a topic point title with them, they don't have to be so verbose. Your demos are great! Great content and discussion. Thanks for sharing.

[@WafaStudies]

Thank you for valuable suggestions will work on it🙂

[@rohanchawla2670]

Hi I have use rule base mapping in flatten activity to flatten XML and choose the settings deep column traver it has mapped all the columns but which are of array data type is not populating correctly.So i have used another flatten to unroll that array but in my xml have more than 30 array and i am not getting correct data. Is I have to use 30 flatten for each array to unroll? Can you please help me is there any other way to handle this easily?

[@nadeemrajabali3166]

Hi Rohan, I have same issue but I also have duplicate sub column names. Therefore I need an expression or combination of expression and parameter to add Hierarchy Level name to sub column name. would you be able to help?

[@InathiM]

This is a great video, thank you. How do you flatten multiple files using a Dynamic Unroll by expression? All the files have "value" as the complex type with the nested columns

[@purushothamnaidu5544]

Hi Maheer, i tried by impoting json script into blob container and have created source stream in dataflow.While previewing the data it is showing nulls in column.Can you please advise me what might be the issue ?

[@venkateshthota5951]

it should be Array of documents in JSON settings

[@vinaysingh1]

Is it possible to get the array position too? for example: for 1st row, 1 .NET, 2nd row 2 Azure ?

[@kitsabee]

Nice video. Is it possible to have the source as an output of the webservice?

[@Imrannaseem818]

thanks for showing us thi trick cheers

[@vikasswain4434]

Good job.....can you please tell me how to flatten multiple levels of nested json?. I tried using sequence of flatten transformation, but it keeps on running in bebug mode and fails

[@tejasri5781]

Awesome bro

[@WafaStudies]

Thank you ☺️

[@sravankumar1767]

here address and contact columns are in complex , here there are subcolumns for address and contact. how can we see thesee details in csv format?

[@premgcp]

Can you please put video on XML transformation using ADF

[@WafaStudies]

Sure will plan

[@premgcp]

Thanks for your reply much appreciated

[@premgcp]

Congrs on getting job in Microsoft

[@premgcp]

May I request you to put some videos on interview questions ADF , ADB

[@chandandacchufan3242]

i need to split array and i wana select the 4th element in the array how can i do it ?

[@harikonka]

Hi I have below issue in SINK step. Source (JSON) ==> Flatten ==> SINK (Tried CSV and SQL DB) The following column(s) have a complex structure which can only be written to JSON, AVRO, and Cosmos DB datasets: 'Address', 'Contact'. Please remove the columns or update the sink dataset to JSON, AVRO, or Cosmos DB.

[@jj900805]

i have the same issue

[@paragpujari3961]

please provide the json file

[@MrDeedify]

can I have those data ?