45. Iterate over excel file sheets dynamically and copy them as a CSV file using Azure Data Factory

[@RAAMASHAAMYC]

Awesome bro - I got the exact question from one interview where I mentioned the same case with azure functions + fpreach copy but this is more informative but for failed activity part.

[@purvajpradhan8841]

Hello @WafaStudies: I do have scenario, in which I need to work with Excel of 250MB of size( multiple Sheets in it) Currently, the copy activity takes a lot of time, can you suggest in this case?

[@RageBaiter2000]

Excellent work bro. Thanks!

[@WafaStudies]

Thank you

[@rk-ej9ep]

Awesome explanation..great efforts..👏👏

[@chinmaykshah]

Hello do we have anyway to create json files for all documents available in cosmos mongo db api? I need to migrate data from cosmos mongo to google postgres any good way to achieve this?

[@saikrishnabudharapu1421]

I need all the output CSV files in single sheet one row below other, here the column header is same. could you please give me the solution for this

[@alaknandanadi-yk5pd]

Hi..if I want the name of the sheet in the filename.csv then what should I do

[@sanatkumar1497]

Is any direct way to convert from azure SQL tablets into Excel sheet.

[@PraveenkumarVinukonda]

What if there is any other error in copy activity

[@sudarshanthota3369]

Hi Anna from Kadapa. Your Videos awesome. How to copy each sheet at scheduled time. Example: I want to copy sheet 2 after 1 hour. Pls let me know if you have answer

[@Ravishanker.Muniasmy]

You can schedule the Trigger accordingly

[@sravankumar1767]

Hi bro, I have one doubt is this logic applicable to multiple excel files with multiple sheets to generate a csv file, could u please clarify my doubts

[@Sitaram-ek3cc]

@sravankumar1767 - Did you get the answer to your question? multiple excel files with multiple sheets to generate a csv file? if so pls share here

[@sravankumar1767]

​@@Sitaram-ek3ccin our we used Metadata configuration in that we have to mention sheet sheetnames in configuration then it will generate each sheet as csv

[@const71]

what if you want your pipeline to fail when legitimate errors occur?? this is such bad code

[@vijaybodkhe8379]

Yes Hi Maheer you we may need to find some different logic because if some other error occurs inside until activity you will not able to find or log.Anyway attempt was good and got learn alot all the best thanks for sharing.

[@anthony281190]

Wafa, how can do That with data flow and apply a transformation to any sheet?

[@anthony281190]

@WafaStudies

[@sravankumar1767]

Nice explanation bro 👍 👌 👏

[@WafaStudies]

Thank you ☺️

[@Sayon____bhattacharjee]

Sir my humble request please make video on microsoft interview process for azure data engineer role

[@dipalipatil-uc7ll]

nice work done by you

[@chaudhryalisalam3668]

Great job mate

[@CitizenIndia143]

Hi Dude, Where I can meet you?

[@SantoshKumar-yr2md]

great, I also encountered exact question

[@jamshedsalik8705]

Hi sir, I hope you're having a wonderful day. I have csv file with 3 columns ID Name Gender 1 Raja Male 2 Sara Female 3 Aksha Male 4 Ritu Female But i just want to read Female gender record and send to sink location Output: ID Name Gender 2 Sara Female 4 Ritu Female Can we achieve this in using Azure data factory?

[@picachu5979]

We can use Adf Dataflows filter transformation to filter Female records.

[@arameshkumar5072]

Good Effort sir

[@WafaStudies]

Thank you 😊