Append Files in Data Lake Using Azure Data Factory Flow

Created By: Muditha Pelpola
LinkedIn: / muditha-pelpola
#data #dataengineering #erp #datafactory #dataflow #datalake
This is my 6th KZbin video and this is a Data Engineering related topic .
In this video session I talked about how to push incremental data into Azure Data Lake using Azure Data Factory.
Here I selected an ERP system (Infor m3) that I worked with more than 5 years. I got business problem to push M3 ERP tables into data lake
with a file structure “ M3 File Name Year  Month  Date ( Based on M3 Last modified record) “. Without hardcoding values in Data Factory
to create file structure automatically based on M3 Last modified date was the challenge .
I solved it using Data Factory expression and this video is to share my experience with data community. #datalake #bigdata

[@qinser]

Thanks, this is what I need. Excellent video congratulations. Greeting from México

[@MudithaSQLBI]

You are welcome!