Azure Data Factory Full Course (From Beginner to PRO) | ADF Real-Time Scenarios

[@AnshLambaJSR]

Hey MY DATA FAM❤I am putting lots of efforts in making these videos. PLS SUBSCRIBE | LIKE | COMMENT and SHARE.

[@AlHasan-sh3il]

ok sir 🥰😍

[@devendranizare65]

Ansh bhai tum to hamare liye Data Engineering ke God Father banke AAye ho ,Thanks Lot your Efforts and HArd Work form Data engineering field student and working professional ,but one humble request to dont make it private and paid courses after some days ,your content is osm bro plz make it rugularly ,once again thanks lot GOD father in Data engineeing Field -Ansh bhai

[@maruthigowda2921]

I have been searching for adf course on KZbin for many days, but finally I got the best one. Thanks a alot 🙏.

[@AnshLambaJSR]

I am happy that you are learning and growing from my videos :)

[@Anuj-w3n7l]

Thanks! Ansh..Love your content and the way you entertain...you are a real gem..keep making long videos for future data engineers like me...😝😎😎Please try to cover videos on azure portal or fabric thing...

[@AnshLambaJSR]

Thank you for your kind words :) I'm happy that my videos are helping you in the world of Data Engineering. Happy Learning :)

[@rameeso1]

Thanks

[@AnshLambaJSR]

Glad you liked it:) Happy Learning

[@ranjithpower1891]

Fantastic explanation of Azure Data Factory! The step-by-step breakdown of concepts, along with real-world examples, made it so easy to follow and understand. I especially appreciated the demo-it really highlighted how powerful and versatile ADF is for data integration and transformation. Looking forward to more such detailed and insightful content. Great job! please provide more industry-level real pipelines for the next Azure data factory

[@AnshLambaJSR]

Thank you for your kind words :) I am happy that you learnt a lot from this Azure Data Factory Course. You can check my End-to-End Azure Data Engineering Projects for more real time pipelines :)

[@basabsaha6370]

Sir you are God gifted.. Please never make this videos private... Paid courses are nothing in front of your content.... Thank you Thanks a lot🥺❤️ Yes I subscribed with all my 4 accounts.

[@AnshLambaJSR]

Aww.. Thank you so much for your kind words:) I am happy that you found my videos better than paid courses :)

[@chandrag-l4w]

I liked your Azure Data Factory and Azure Data Bricks videos. Now I am eagerly waiting SQL full course

[@tusharsharma8256]

Ansh, you are a gem bro...seriously...I am newly transitioning to cloud and this is really helpful...in 3 hours...i got wtf ADF is doing and how pipelines are working...Thank you bro..

[@sandrasampath1505]

I'm glad I found this video. Was prepping for an interview, and this is the best I could ask for! Please make more videos!!!

[@AnshLambaJSR]

I wish you crack your interviews. Don't forget to give me the good news (Haha!)

[@RohitRaut-f9q]

the way u teach.. It is soo smooth and your video was my longest Attention span ed video in 2 years .. completed in one go

[@sivaprasad8639]

I just wanted to say a huge thank you for your excellent videos on Azure Data Factory. Your clear explanations and practical examples have been invaluable in helping me learn this powerful tool. I'm really grateful for your time and effort in creating these tutorials.🙇

[@AnshLambaJSR]

I am happy that my videos are helping you to learn and grow in the Data Engineering domain :)

[@kingsleyubani9263]

Thank you, Ansh! I’m thrilled to have come across your page-you absolutely nailed it!

[@AnshLambaJSR]

Glad you loved my video :)

[@nik54610]

Just finished the video, Thanks for your efforts and dropping for free. Please make more on ADF. your videos helped me a lot. Thank you!

[@AnshLambaJSR]

Thank you for your positive feedback. Happy Learning :)

[@CloudTech-d4n]

Hi Ansh, I hope you're doing well! I just wanted to take a moment to thank you for creating such an amazing platform to learn Azure Data Engineering. I have been following your videos for the past month, and they've been incredibly insightful. Your explanations are so clear and easy to understand, and I’m learning a lot from them. I'm really looking forward to the Python tutorial you plan to release in the future. I’m also a huge fan of your content, and I wish you all the best in your journey. I’m sure your dream of giving a TEDx speech will become a reality soon. Best of luck with everything! Happy New Year!

[@AnshLambaJSR]

Thank you so much for your kind words :) Means a lot!

[@ankitjilka4177]

Your explanations are excellent!!!..... Thanks to people like you, many others have access to free, high-quality education and knowledge. May you be blessed-keep up the great work!

[@AnshLambaJSR]

Thank you so much for your kind words. Glad to hear that you found my courses helpful :)

[@mandy6622]

you make the learning so much fun with little humour in between, awesome video!!!!

[@worldvolgs6342]

this is really helpful, I'm preparing for my interviews, and I learned a lot from this course

[@Harishkv_dataengineer]

28K views, only 13K subscribers? Guys. He is putting a lot of effort into providing an excellent tutorial free of cost. We won't lose anything if we subscribe.

[@shashigowdar7359]

Ansh, Ansh, Ansh.....Your teaching style is very engaging 👌🤞✌🙏👍🏻👏 Thank you so much for new course🙏🙌

[@AnshLambaJSR]

Aww.. thank you so much for your kind words. I am happy to hear this.

[@dondeigodollar7261]

Love your content Ansh, please keep up the good work! - Thank you, much appreciated!!

[@AnshLambaJSR]

I am happy that you found my video insightful. Thanks for cheering :)

[@khushboobegum7613]

Your videos are really helpful and i keep on watching all your videos back to back

[@sanilkumarbarik9151]

You just earned a life long subscriber 😊

[@AnshLambaJSR]

Thank you so much :)

[@vigneshtj8460]

Hi bro please don't stop posting videos Im looking for lot of resources for learning data engineering and everywhere i see a large amount to spend out there but with my current financial situation I can't spend money on that but i can spend my time and effort to upskill my data engineer. I only stick with your channel and videos please create a data engineer playlist with python of de full course and mastering sql and big data spack hadoop kafka mapreduce cloud pyspark and please make it in a sequence for all new comers in future they will be wondering how they Miss your Channel

[@AnshLambaJSR]

Thank you for your kind words :) Stay tuned!

[@NiteshKumar-yz7pd]

Thanks bro, in the last video I asked for ADF and here you uploaded!♥️

[@AnshLambaJSR]

I hope you love this video. Happy Learning :)

[@cvreddy369]

Hey Ansh, In very few days, your content on DE will be in trending on KZbin. Good Work 👍🏻. Thanks so much😍

[@AnshLambaJSR]

Aww.. thank you so much ::)

[@sivaprasad8639]

Eagerly waiting for your Azure Synapse Analytics Tutorial. Please do it in future. Thanks in advance🖖

[@AnshLambaJSR]

Stay tuned :)

[@PAWANSHAW-q2s]

Great content I don't know to thank you waiting for more adf scenario based content.

[@varindervashisht3359]

Way of your teaching…. made learning interesting and fun. Awesome bro… thanks for your efforts and time. 😇😇😇👍👍👍👍❤️

[@AnshLambaJSR]

Thankyou for you kind words :) Happy Learning!

[@vinayakraj7929]

One good thing is that I don't get bored watching your videos

[@AnshLambaJSR]

Why to feel bored when working in such a creative domain - Data Engineering :)

[@exystenze4719]

Bro is on a hunt for the best data engineering quality content on KZbin

[@AnshLambaJSR]

Haha! I am happy that you find the quality of my data engineering content the best :)

[@sowmyabalu8237]

Oh Ansh bro ,.. here you go again with other bang on topic , now sundays its like waiting for your videos and thanks for this wonderfull video once again.

[@AnshLambaJSR]

That's so sweet. I hope you would love this video :)

[@prasadmuthyala9625]

I'm new to azure but you're video really simple understandable way of teaching ❤ thank you

[@AnshLambaJSR]

That's what I want, in the world of complexities, let's learn with EASE :)

[@sam-uw3gf]

bro drops masterpiece every week..

[@AnshLambaJSR]

I am glad that you consider my content a masterpiece :)

[@sanketsrivastava]

Thanks for this one..I'm preparing for the DP-203 and I feel confident in ADF now.

[@AnshLambaJSR]

Glad to hear this. All the best!

[@michaelshepherdmunemo4414]

We love the video. you are a good teacher sir

[@vishalnaik5453]

Great content 💯 brother. Need end to end industry level projects 🙌

[@AnshLambaJSR]

Already created :)

[@SudhirNanaware-x5k]

Hey Ansh, It's really nice experience to watch your videos and the way you are explaining the things is simply awesome.. always excited for your upcoming videos.....Thanks a lot to make our study easy and interesting....all the very best bro❤

[@AnshLambaJSR]

Thank you for your positive feedback :)

[@VamsiKrishna-dy8ww]

Bro really became Fan of your Videos 😍

[@devanandgadekar-f3r]

Great Videos for Azure Data Engineer....Please make more videos for Data Engineer Community :)

[@fahadbawazir562]

Doing very good work-Ansh😊

[@AnshLambaJSR]

Thank you for your positive feedback :) Happy Learning

[@munikumarpoosala1264]

Nice Explanation...Thanks a lot ....Keep Rocking

[@hussainattari78652]

Amazing Video on ADF, Feeling great to Learn...

[@abhishekn786]

Hi Ansh Bhai, Just completed this video, all I can say is its top notch content, please come up with Advance concepts on the ADF. Thanks

[@AnshLambaJSR]

Thank you for your positive feedback. I am happy that you loved the content. Stay tuned and Happy Learning :)

[@shivadev9558]

My bro is back to rock... 🎉🎉

[@AnshLambaJSR]

I hope you learn a lot from this video. Happy Learning :)

[@VenkyVarieties05]

Bro… Thank you so much bro… couple of days before I ask you to make one video for Azure Data Factory…. Now you done… bro did it bro you did it…. Thank you so much ❤

[@AnshLambaJSR]

I hope you would love this video. Happy Learning :)

[@vamsikalayanreddymure8472]

You got another subscriber! 😀You are doing great work Ansh.

[@AnshLambaJSR]

Thank you so much. Happy Learning :)

[@WaseemPashaZ]

Always waits for your video 💯

[@sandipsarkar4555]

You’re doing a great job bro….If possible do a series on Apache Airflow and Python

[@chakravarthys1017]

@Ansh bro, you are too awesome in explaining i love it, and can feel your efforts to making such a informative videos, i must say again you are awesome,

[@AnshLambaJSR]

I am happy that you loved this Azure Data Factory course :)

[@062nanthagopalm6]

Just mind blowing bro ❤! Hatss offf

[@AnshLambaJSR]

Thank you for your positive feedback. Happy Learning :)

[@christabelSamuel-y8g]

You are an Amazing teach Ansh, Thank you so much. Am so grateful to God to have seen your videos 💟

[@AnshLambaJSR]

Thank you for your kind words :) Happy Learning

[@crixcel8388]

Bro u are going to become very big youtuber/data influencer

[@omkaaaar]

Subscribed due to your personality

[@AnshLambaJSR]

Thank you :)

[@sonianavale2708]

Thanks for all your efforts!!!

[@snehalgawari6756]

Hi I was going through Azure data -End to End which was posted 1 month back , but after congratulating ourselves for first part, i wasn't getting data bricks part(as I never used it). not this will really help me to learn ADF fully , then can learn Data bricks separately and back to previous course. Thank you

[@AnshLambaJSR]

Glad that you are learning a lot from my videos. Happy Learning :)

[@naveentammineedi1089]

Bro what a video really love the way you are explaining not able to resitct my self with out commenting

[@AnshLambaJSR]

I am happy that you loved the video :)

[@yasirwali8252]

Ansh brother plz plz plz next time make complete video on Azure synaptic analytics Love from Pakistan ❤

[@AnshLambaJSR]

Glad to see your excitement to learn more from my videos. Stay tuned :)

[@ravulapallivenkatagurnadha9605]

All the very best brother

[@AnshLambaJSR]

Thank you :)

[@vishalmane3139]

this guy is all i need nw 😎

[@AnshLambaJSR]

Happy Learning :)

[@varindervashisht3359]

Love project videos….cool…. please make more videos on different project for learning and practice.❤

[@AnshLambaJSR]

Already created :)

[@sunkamvenkatesh1086]

This is super cool ❤❤❤❤❤❤❤

[@AnshLambaJSR]

Thank you for you positive feedback :)

[@priyeshudawat]

Bro outstanding work. This was the first video that I watched of your channel, and everything was perfect. Your this way of teaching makes the content interesting. Keep it up. Also please make videos explaining daily life, projects, and how professional data engineers work in the company.

[@AnshLambaJSR]

Thankyou for your kind words. I am happy that you love my content. Stay tuned :)

[@JeevanKumarMula]

This is such a fantastic explanation with so much ease and fun. I appreciate your great work for putting all your hard work and creating this content to help lot of users. sometimes watching videos for long hours diverts our mind to something else but this video content is interesting and creates expectations like what's next :) Thank you, Ansh !! A quick question on Event triggers. when someone uploads the file in storage container and then ADF pipeline gets triggered and its expected to complete in 5mins. but when the second file was uploaded within 2mins and third file was uploaded within 4mins i.e. while the first pipeline execution is in still progress. How the ADF is going to handle this scenario? Is it going to skip reading those files? or Is it going pick them up as soon as the first run gets completed and sequential order ?

[@srijitbhattacharya6770]

good tutorial. built from ground up.

[@ajinkyakotwal1895]

1:05:29 should we be using http as https is more secure and safe. I also did GPT regarding this problem it suggest to not http if thats the case what should we use. could you give any approach other than http and through apis.. by the way great video

[@sudheerkumarkusoori]

Thankyou Very much Ansh for this videos making better understanding the concepts

[@sulthanmohiddin5294]

Mind-blowing Ansh..I was waiting for ur update ..it came like a boom ....Thanks a ton man. I am enjoying your all vedios you made learning very interesting and Fun.

[@AnshLambaJSR]

Thank you so much for your love for my video. Happy Learning :)

[@mayankjain4270]

nice content, its very insightful, pls upload more videos ansh!!

[@praulayar4805]

aaj hi start kiya 1st video se , aadha complete kiya 1st phase data ingestion with ADF aur bhai ne full fledge video upload kiya

[@AnshLambaJSR]

I am glad that you are learning a lot from my videos. Happy Learning :)

[@praulayar4805]

​@@AnshLambaJSR plz make video about azure fundamental for beginners for AZ900 ​

[@ajitpawar07]

Best content. More than paid content.

[@AnshLambaJSR]

I am happy that you found this video better than paid courses :)

[@U.R.-rx6fr]

Hi @AnshLambaJSR, thank you so much for these "Educational" videos. I have one question at the 03:05:30 mark in the "OnlySelectedFiles" pipeline I see this activity called "FilesValidation". I cannot find any reference of this activity. Can you tell us what the dataset is in settings? Thanks!

[@U.R.-rx6fr]

After failing with the "ProdPipeline" I came to the conclusion that the dataset settings of the "FilesValidation" activity in the "OnlySelectedFiles" pipeline is the "sink.csv" file in the destination folder 🤓 Now it works!

[@vidurbhardwaj4001]

Again, a best of best has come out in the market. Thanks @AnshLamba for this knowledge share. One Request: please make video on Py spark where we can create a generic script where we can perform cleaning steps which one should follow while moving from bronze to silver. How to handle huge data in Py spark and how to implement incremental load there.

[@AnshLambaJSR]

Check out my other videos on PySpark and Databricks for that

[@nileshjawle1703]

Hi Ansh, love your work and just a kind request if could you create a tutorial on using SSIS packages to move on-prem data to Azure Data Factory and Data Lake? It would be great if the video also includes a project using Azure Synapse to demonstrate end-to-end data engineering with Azure tools. Thanks for your excellent content!

[@AnshLambaJSR]

Glad that you love my content. FYI - I have already created End-To-End Data Engineering Projects. Happy Learning :)

[@ameetnaik3061]

the video is awesome ANSH

[@AnshLambaJSR]

Glad you liked this Azure Data Factory Course :)

[@michaelshepherdmunemo4414]

Hi Ansh what do you use to highlight the screen when presenting

[@VikashKumar0409]

man you are doing amazing, subscribed your channel from day 1, loving your content and your efforts ,Please continue to do the good work and just a request dont make your videos private .if you are planning to bring pai course please bring it asap,we would be happy to learn from it.

[@AnshLambaJSR]

Thank you for your kind words. I am happy that you are learning from my videos since day 1 :)

[@prashu25925]

You literally forced me to subscribe your channel with your quality content

[@AnshLambaJSR]

I am glad that you liked my content and thanks for subscribing :)

[@shreyasarkar6970]

Thanks a lot for such an awesome content . Subscribed with my 5 accounts.

[@AnshLambaJSR]

Aww.. Thank you so much for your support. Happy Learning :)

[@sahadparsani9571]

Thank you, Ansh! ❤ Can you make a video for the Azure sql database?

[@azeezayorinde878]

Nice shot @Ansh. Do you know how I can show case and incorporate my ADF projects to my project portfolio website? Or if you can make video on it.

[@ok0505]

Thanks dude❤

[@AnshLambaJSR]

I'm that you liked the video :)

[@varunsai2876]

Ansh, your content is awesome. Please do the masterclass video on Power BI as well

[@crixcel8388]

Hi Ansh, Can you make detailed videos on Integration runtime, SSIS and self hosted run times, just love your content

[@sandhyachauhan-b8w]

thanks for making this !

[@AnshLambaJSR]

I am glad that you found this video useful. Happy Learning :)

[@GAMER-zz4cc]

Hi Ansh Your explanation is too good and can you make one More video like adf and power Bi project it help for me❤❤❤

[@AnshLambaJSR]

Thank you for your suggestion. Stay tuned :)

[@pratikpatil8395]

You are really amazing sir

[@AnshLambaJSR]

Happy Learning

[@abhishekn786]

Thank you soooo muchhhhhh

[@AnshLambaJSR]

Glad you love this video. Happy Learning :)

[@ajaysuresh8856]

Hi Ansh these lectures are far better than udemy courses , if you could please like pyspark interview questions create Datafactory scenario and interview questions for experienced professionals it will be helpful.

[@pareshranjanrout9439]

Bro, I have some feedback for your video. When you created that 4-hour project, it was amazing, and your detailed explanation made it easy for even freshers to understand. However, when you're teaching or creating content like a project, try starting with basic with teaching strategies examples and gradually moving to advanced concepts. Also, explain the advantages in detail, provide good supporting documents, and thoroughly describe each role before introducing any service so freshers can fully grasp your video. You'll likely understand this better as you create more videos and gain experience as a KZbin creator.Your explanations are excellent ❤❤😊😊

[@AnshLambaJSR]

Thank you for your positive feedback :)

[@pareshranjanrout9439]

​@@AnshLambaJSR for an example : I asked quesation myself, but didn't cover it in detail and it should be cover for freshers: (its just a suggesation for you.😊) - In Azure Data Factory's Copy Activity, if you delete data from the source while the copy process is running, the data in the destination will not be affected by this deletion. Here's why: How it works: The Copy Activity reads data from the source and writes it to the destination. Once the data is successfully copied to the destination, Azure Data Factory doesn't track the source data anymore; it has already moved the data. Deleting the source data after the copy activity starts will not automatically remove or affect the already copied data in the destination. (Copy Activity transfers data but doesn't keep a live connection between the source and destination after the copy.)

[@jaykaryuvi6799]

Thank you so much bro❤

[@AnshLambaJSR]

I am happy that you liked the video :)

[@dhirendramaurya5361]

Awesome explanation bro ❤️

[@AnshLambaJSR]

Glad you loved it :)

[@SuprajaBijjigiri-o4s]

Thank you so much 💌

[@AnshLambaJSR]

Happy Learning :)

[@rajar1458]

I've doubted about 1:10:10, if we have multiple CSV files in the source location, and the same CSV file name along with files data needs to be copy target directory without provide files name in the pipeline how do we achieve? Conditions 1. I don't want directory structure from the source, but I need copy multiple CSV files specified target location, without specifying all files name in the sink pipeline?

[@JeevanKumarMula]

1. you can configure the file name in the pipeline parameter or activity parameter as default value and call them in source/sink during dynamic execution. 2. you can also store the file name in some text file or json file and read them using lookup and pass them to source & sink. How can it be possible to multiple files having the same name ? In this case, target file will be overwritten every time. Else you can just append datetime while writing to target within activity expression editor.

[@aniketghodake1366]

Nice video. One doubt - In storage event trigger, i added folder instead of filename, so it triggers the pipeline if ay new file is added in source folder. But how to get that newly added filename to use it in parameter in to use it in source/sink dataset ?

[@sanilkumarbarik9151]

Everything related to ADF is included in this masterclass except Integration Runtime. Any reason Ansh?

[@MrSonu1505]

Eagerly waiting for Azure Synapse.

[@AnshLambaJSR]

Stay tuned :)

[@rabink.5115]

Hi Ansh, If we have a source folder containing multiple CSV files like 9 total files with varying delimiters (3 pipe, 3 comma, and 3 semicolon files). You need to create an Azure Data Factory pipeline to ingest these files and store them in separate subfolders based on their delimiter. How can you achieve this dynamic file ingestion and folder separation?

[@SunnyKumar-qs5vo]

thank u so much ansh brooooo....

[@AnshLambaJSR]

Glad you love the video. Happy Learning :)

[@siddeshbb-o5q]

Thanks Ansh. can you please provide the roadmap who are new to data engineering field.

[@bheemanjineyulu5348]

Amezing content bro🥰