Microsoft Azure Data Engineering Complete Roadmap 2024 (Top 10 Services To Focus)

[@DarshilParmar]

Suggest some good video topics that you want to see in future, Also Don't forget to hit LIKE BUTTON :)

[@benjoanc]

More GCP project and services to focus on, python libraries used in data engineering

[@NAQAMYASHARAHLA]

PLEASE POST IN THE COMMENTS OR BELOW THE VIDEOS >>> LISTS OF THINGS YOU TALK ABOUT IN YOUR VIDEOS... THIS WOULD BE MUCH APPRECIATED👍 AND VERY HELPFUL!!!! THANK YOU FOR YOU EFFORTS HELPING US ALL OUT! BLESSINGS!🙏🙏

[@mohammedshabaaz9625]

similar video on gcp services

[@gsreenivasulu3246]

We are expecting azure databrcks projects and Gcp projects

[@s1998awe]

System Administrator Road Map

[@naren06938]

U explained very well bro, but small thing u forgot, try to make blurr on ur T-shirt AWS Logo while u explaining Azure or other providers....

[@longdatadevlog]

I love the way Microsoft offers the services to market. Extremely easy to use, I also can create simple data pipeline within 1 hour. Thanks for sharing this video!

[@DarshilParmar]

You are welcome

[@todayspecial9705]

What are the resources if someone wants to learn this from scratch

[@AmanVishwakarma-u2b]

Thanks Darshil for the roadmap I have cleared DP900 & DP203 Exams last month was confused how to explore these concepts, your video made it simpler for me to explore more.

[@MrCHATTERJEE01]

hi, I have no coding language knowledge can I learn DP900 & DP203 ? what is these about ? which software to use ?? or should I know some basic coding knowledge ??

[@gurmeetsingh598]

No coding is required for these. But as a data engineer u should be knowing python and spark

[@sonash4662]

Darshil, you are a star, your videos are super helpful to understand Azure Data services. I was just going in circle until now , and was not sure how should i plan my learnings of Azure data services but this video is really making things quite clear. thank you so much.

[@udaybhaskarsavvana8049]

Hi Darshil, please do similar video for AWS and GCP also that would be so helpful.

[@DarshilParmar]

Noted

[@brjkumar]

Thannks Harshil. Please make same video for AWS and GCP. Great work.

[@izhanabdullah]

Hey, Darshil Pramar, Data Expert! Your channel is exceptional and highly beneficial. I have learned so much from your content. I am now looking for more Azure projects, as there are many channels focusing on Azure, but your teaching style and projects are phenomenally excellent. Please consider sharing more about Azure projects and Microsoft Azure in your future content.

[@jnsskasyap1650]

Hi , what kind of challenges faced while working on azure data engineer project (databricks,ADF, Pyspark)and how do you resolve it?

[@talesgaurav]

Bhai ye hi search kr r tha and turant aapka video aa gya. Thanks bhai.

[@DarshilParmar]

🔥🔥🔥🔥

[@zouhair8161]

WE want more vidéo of azure thanks aws and loading end to end project and spark tutorial. Thanks darshil for efforts

[@DarshilParmar]

I will do my best to bring new content

[@Wzvmek]

love when you're talkin about azure with aws hoodie lmao

[@deepadevi682]

Please do a video on Azure DP-100 certification, how to learn and get certified. Looking forward to it. Thanks ❤️

[@bramha108]

do freshers get hired as data engineers? or is it necessary for them to work as data analyst in order to get some experience and then move to data enginerring roles after a couple of yrs?

[@RavijyotiBM]

hi..Can you make a video of complete roadmap to become Azure cloud engineer in few months and become ready for cracking job interview

[@gunjankothari7471]

Well presented important Azure data platform services And explained structured way to learn these services with cerificatipn Good Job 👍

[@DarshilParmar]

Glad it was helpful!

[@karthikmahi4818]

Hey bro, found your video very informative. Do one video regd Data engineering using AWS services. What are the python libraries needed to learn data engineering

[@amitjaiswal781]

Hi Darshil Please also make video on GCP Data Engineering Complete Roadmap

[@DarshilParmar]

Putting this on list

[@abhilashreddy9548]

Azure security, monitor and health. Should be included as security in data level is highly important.

[@ashwinir5110]

Hi Darshil, please do more videos on end to end projects, want to know the kind of projects you work...

[@usamusman47]

Hello Darshil, can I start Azure DE as a beginner? and whats the difference between data engineer and Azure data engineer? from where to start as a beginner to became a data Engineer? Give me response, I shall be very thankful to you for this act of kindness :)

[@DarshilParmar]

There is no difference between Data Engineer and Azure Data Engineer, as a data engineer you need to know one cloud platform, being an Azure Data Engineer means you know azure data services and things around it I have few courses to get started - datavidhya.com/courses This will help you to get started, I am building more courses

[@shipra959]

hi darshil please do one video for gcp data engineering and pls do explain one end to end project using gcp services

[@DarshilParmar]

Sure, I will see what I can do

[@niranjankashyap5452]

Bro make a video on how to set up Python for pyspark in Pycharm IDE on mac and windows.

[@AliHaider-xp6tl]

Great try your Microsoft Fabrics cover as a Data Engineer with strong Use case of project

[@DarshilParmar]

Sure

[@Rider-jn6zh]

Can you please update full course with all content along with project on Azure data engineering

[@allakashivakumar]

Darshal, give insights on data engineering and product manager combination. As i am currently planning to switch from business program manager to data product manager positons

[@satyamkumarjha4185]

what's role and resp. of a data prod manager bhai

[@invincibleindian7173]

Suggest a platform to learn all the topics you have mentioned

[@ragnarT3]

Hey darshil, what is the tentative launch date for Spark Course? Expecting it to have some complex projects. We know you have a lot of things on the plate and congrats on 100k.

[@DarshilParmar]

I am going to release early access this month for existing students

[@am5052]

very nice explanation , please post video of python in association with power bi analytics.

[@harrytan7443]

Can you make a video about AWS? Thanks

[@shyammaths5705]

i have 3 years of experience as a python developer. now thinking to move for AZURE DE. am i going on right path. or should i continue as a backend developer only. which fields i will have better carrier, scope, job opportunities, pays

[@rahulj080]

30 plus age can become data engineer. Is there any chance to make their career in this field. ?

[@siddeshbb-o5q]

Hi Darshil - is there Azure Data engineer courses available from your side?

[@ashutoshojha4244]

Please make a similar video for AWS too🙏🏼

[@KokkeOP]

As always great content. 2 requests for next time: 1) end to end project you suggested doesn't connect to Power BI. You might want to generate that last part of the project so it's truly an end to end. 2) would be very nice to have a second part for that same project where you show how we deal with inbound and outbound data in other to show how it actually work in an industry level escenario. Maybe a few made up needs from different areas of a fake business so we provide them solutions and show how to stablish the logics tailor made for those. Keep it up🎉

[@DarshilParmar]

PowerBI part is challenge that you guys have to do

[@prasanthbugga8381]

Darshil, pls do the same for GCP pls...

[@DarshilParmar]

I will put this in my list

[@ankursingh730]

Can you please make similar roadmap for AWA data engineering?

[@DarshilParmar]

I already have it please search it on my channel

[@ankursingh730]

@@DarshilParmar Got it! Thanks :)

[@prakashr0108]

Explaining Azure services with AWS t-shirt😂

[@mayankpatni5639]

Data engineer vs devops vs web development more job opening more package future growth

[@rudroroy1054]

I believe scala and pyspark knowledge is required to crack the dp-203 exam as well, not sure if they updated that.

[@giridharbasanaboina-e5p]

Sir , Please make a detailed video on Google cloud dataengineerimg

[@DarshilParmar]

I will put this on my list

[@ShivamYadav-nf9ow]

Please make a video for Aws as well

[@NagmaVeerani]

Can you also put some lights on One Lakes services provided by azure

[@apekshanaik5449]

Azure data engineering or IICS -> which is better?

[@bayoadegun]

@DarshilParmar, when are you launching the remaining courses on modern data engineering?

[@DarshilParmar]

Spark will be launched soon

[@venkatesha5634]

Hi I have 6 years java experience, I want switch to data engineer role is is best option or not

[@gokuls3000]

Thank you man

[@dewanjalikapse]

More project videos on Azure😃

[@Kumarisingamreddy]

how much time it will take to complete the course?

[@chanzaibabbasi5035]

something-went-wrong-and-were-unable-to-retrieve-the-draft

[@prateekdaniels]

Thanks mate🎉

[@DarshilParmar]

You are welcome

[@abhisheknair2680]

Hi bro I have 12 yrs IT experience in FMGC organization I'm has a IT operation so its possibilities to do azure data engineer

[@digvijaytalaste8170]

Without any degree can I become data engineer or cloud engineering devops with certificate course

[@abhinavchoudhary2581]

Hi, Where does Microsoft Fabric stands in the list

[@PriyaEsther-c6m]

Hey Darshil, Is this learning path suitable for college freshers?? I have been trying for job from last 6 months after following your content. please reply

[@DarshilParmar]

Yes ,you can start with this

[@dipeshsahoo8561]

Nice and informational video... I want to know what are the prerequisites for DP203?

[@DarshilParmar]

I have talked about it here - kzbin.info/www/bejne/fZmap2mOeK2Brrc

[@djsahu98]

Is this roadmap will work for the person with 3 years of experience in other domain and want to switch to Azure?

[@DarshilParmar]

Yes, this roadmap is for everyone

[@AIML-Insights]

Hi, darshil cloud training is available is mostly generic , not specific like Azure devoops, or data engineer etc

[@DarshilParmar]

Coursera course is good

[@DipakChavan-g7l]

Is there any fees for azure and databricks certifications

[@udaykumars3443]

Hi Darshil, Can I start directly by learning cloud services instead of on prime services, will that be good.

[@maliknauman3566]

Superb young man, keep going ❤

[@DarshilParmar]

Thank you, I will

[@sanbharas]

Good click bait

[@DarshilParmar]

Learning KZbin game slowly

[@mayankpatni5639]

Web development vs data engineer vs devops more job opening more package future growth

[@DarshilParmar]

DE > DevOps > WebDev All of them are equal tbh, not much difference, you can make good money if you become 1% on any of these

[@adparikhyt8859]

Tshirt aws and making for azure

[@khaleelbasha2761]

Bro, Which path do you recommend for a high package salary, first learning the spark, airflow, hadoop, kafka etc and then getting into a specific cloud or can I start directly with a cloud platform?

[@DarshilParmar]

Order doesn't really matter, you can start with cloud too, all you need to hear is START!

[@japheth_crepin]

Hello sir! I am new to data engineering and I recently got Microsoft certificate of DP-203, do you have a suggestion on how to make it in this field? and I would like if you make a video project on azure eventhub and power BI

[@DarshilParmar]

I have a project on Azure, you can check that, other than that there are so many good projects available on KZbin, you just need to search for it

[@aabhapandey4545]

Please make vidio on aws ..

[@DarshilParmar]

Sure

[@VenkatesanVenkat-fd4hg]

Superr insightful video, I think the coursera azure data engineering course is not free for audit....can you check & reply plz

[@DarshilParmar]

It is free for audit, to get labs and certification you need to make purchase

[@VenkatesanVenkat-fd4hg]

@@DarshilParmar I am still finding some money need to be paid, can you verify/I hav verified two times

[@rehanfazal7354]

My man promoting Microsoft Azure by wearing an AWS hoodie on a google platform.

[@DarshilParmar]

haha, planned it

[@sharma88rohit]

Cloud agnostic 😂

[@spaceenthusiasts8725]

You should include timestamps...

[@DarshilParmar]

Okay

[@syedazher5708]

Sir please tell me which one i do azure data engineer or snowflake with aws data engineer which one is best for present and future. Which one i study.

[@DarshilParmar]

All of them are different AWS and Azure are cloud computing platform and Snowflake is a Database. You can learn one cloud and snowflake, I have a course where I teach with AWS datavidhya.com/courses/datawarehouse

[@syedazher5708]

Yes I know but azure data engineer is best or snowflake data engineer is best for current market.which is more in demand.

[@atozaboutdata]

Azure promotion wearing AWS T-Shirt :)

[@yashpaunikar671]

Please make for AWS

[@DarshilParmar]

Putting this on list

[@ishaangupta4941]

I switched from Azure cloud to Aws cloud las month , Was that a good decision ? or did I make a mistake?

[@DarshilParmar]

No, you’ll learn more

[@Aakash_savant]

can we call Data Engineer as bigdata Engineer

[@navinkumar1990]

Whether BCA graduates can become data engineers or BE/BTech graduates can become data engineers?

[@DarshilParmar]

Yes

[@navinkumar1990]

BCA or engineering students?

[@umer_c0des330]

what about making the playlist of Microsoft azure?

[@DarshilParmar]

I have a project, I will make more of them in future

[@umer_c0des330]

@@DarshilParmar that would be great 👍

[@Kpkph]

Do i need to learn AZ-900 fundamental first or i can start Direct DP-203 please suggest.

[@DarshilParmar]

DP-203

[@2412_Sujoy_Das]

Darshil Sir, as you said... For entry level engineers, we need to know just the use cases of Machine Learning service on Azure right??? Or do we need to dig deeper into it?

[@DarshilParmar]

Just basic understanding is fine

[@2412_Sujoy_Das]

@@DarshilParmar ok sir... Just one more thing.... I am preparing for AZ-900 & DP-900... will those be a good addition to my career transition as an Azure DE?

[@DarshilParmar]

Yes

[@2412_Sujoy_Das]

@@DarshilParmar Thank you sir

[@AkashSingh-vl6pq]

bahiya is it possible for fresher to get in data engineer.

[@vijaytagad643]

Nice

[@rockstarzzzw200]

Can you please do one for GCP'

[@DarshilParmar]

Will do it

[@roshanshrestha79]

I am beginner can i start? How can i learn?

[@virendramahajan9516]

Hi Darahil, I want to know that how much important to learn the coding language before starting the microsoft azure data engineer. I want to know the sequence which should i start learning 1st python language or Microsoft Azure data engineer services. Please it will helpful yout advise Thanks

[@virendramahajan9516]

@Darshil waiting for your guidance

[@ayxxnshxrif]

What's for a fresher with no internship experience?

[@DarshilParmar]

You can do this to build your resume

[@SanjayKumar-s4v3v]

wearing aws , teaching azure

[@srikumarma]

Bro, Does this roadmap do it for the college final years as well? or do we need experience in the industry

[@DarshilParmar]

You can do this, good for college guys, you'll have something to show when you get in the industry

[@srikumarma]

Thank You!@@DarshilParmar

[@MrShubhambh18]

The university has purchased a new cloud-based software solution to help with student applications that needs integrated with our student record system. and we need to provide a data integration solution to this.. what would you suggest ? doing it with azure services including factory, databricks.. datalake and synapse.. or use Kafka and Java? please suggest me the best way to do so ?

[@DarshilParmar]

It depends on usecase, Kafka is mainly for real-time data streaming, I feel for university application that will be needed, start with very basic stuffs Do POC using Azure services if you are going with that, DataFactory can work on this case

[@MrShubhambh18]

@@DarshilParmar ok..so should I start with migrating the on prem to data factory and create data warehouse and utilize that using azure ? How does the testing and support be done after data integration then? Can you provide a little bit of an approach to it.

[@DarshilParmar]

Get some sample of data that you think needed for project, build some test pipeline from DF to Data Warehouse, if things goes fine then think about how you will do migration from Onpremp to Cloud and then replicate same steps

[@Seoul-gf5hl]

@@DarshilParmar Hello Darshil , I am really confused at zure data engineer and azure devops engineer , i am not good at coding, programming , currently working in cognizant completed 2 yrs, but i got project in july, wokrin in devops ci cd pipelines, just have az900 yet but i feel nothing is easy here. please help

[@John83118]

I'm in love with this content. I read a book with similar content, and I'm in love with it. "Mastering AWS: A Software Engineers Guide" by Nathan Vale

[@sagarm1875]

Is azure free for learning as AWS is free for a year?

[@DarshilParmar]

Check website

[@akshaychauhan545]

Make a course on azure cloud

[@DarshilParmar]

This will be done in future

[@averychen4633]

it is funny that you are wearing an AWS sweat shirt and promote Azure.

[@raghavendrakulkarni3920]

UNITY CATALOG

[@parthtrivedi318]

Aws and GCP certification

[@DarshilParmar]

On it!

[@alpeshpatil1621]

Hey Darshil, do confirm whether Synapse is actually used in the market as much as Databricks. Since Synapse is a lot more expensive, industry leaders tend to not use it and are currently using ADF + databricks as a combination for most of their use cases. Could you just confirm if market trend still dictates Synapse as a requirement?

[@ANJALISINGH-nr6nk]

microsoft purview

[@mdmehatab4479]

AWS ki hoodie aur tareef Azure ki🤣🤣😂😂

[@DarshilParmar]

Planned 🤣🤣🤣🤣

[@bharadwaz7]

looks like the voice is changed, u did some edit i guess

[@DarshilParmar]

Got the new mic

[@harryrichard-f4l]

gcp please

[@DarshilParmar]

I will put this in my list

[@officialpranjal]

Guy wearing aws hoddie and making video on azure 😂😂

[@rahulsukale6387]

😂