God Tier Data Engineering Roadmap (By a Google Data Engineer)

[@dotproduct763]

Have worked as a Data Engineer at Directi, can attest to this roadmap, it is exactly what i would come up with. Great Work!

[@JashRadia]

Thank you! Great to know 😊

[@c_y_b_e_r_b_o_ii]

Is it too complex?

[@sirajansari2848]

I have 10years of experience working as a Data Engineer in 4 different organizations, and I can testify with confidence that this is exactly the roadmap I would have suggested myself to follow when I was starting up in this field. Wonderfully explained and beautifully constructed !! Just a request, Can you please create such a Roadmap for Machine Learning as well ? :)

[@JashRadia]

Thank you and sure. I will add this in the backlog 😊

[@coderprakash]

kzbin.info/aero/PLLssT5z_DsK-h9vYZkQkYNWcItqhlRJLN If you complete this playlist this is perfect roadmap for machine learning

[@aviralsharma2005]

@@coderprakash the linked page doesn't exist bro. Could you repost it?

[@aathilahamed2120]

@@coderprakash the link is not working

[@coderprakash]

@@aathilahamed2120 basically this KZbin playlist is removed by them that's why the link is not working

[@sameerkerketta9996]

Man, you have my salute. No one in the entire KZbin have explained Data Engineering in such elegant and sober way although it's really a vast thing. Thank you. If somehow we met in the circular world of IT I wanted to hug you and want to say thank you brother you saved me.

[@JashRadia]

Thanks for the kind words man!

[@prico3358]

What have you done by know. Please be free to be detailed, i will reall all of it.

[@nilavnayan4521]

Bro a legit video like this is rare to come by! No gas, accurate, proper links to reading material, hands on stuff and even a DE project to work on!

[@JashRadia]

Thank you so much! 😊

[@adityantamarapu6239]

Where are you now bro...? Got into DE...?

[@prathuna9681]

Q❤qq😊❤😊😊❤😊❤❤😊❤❤😊😊😊😊😊😊😊😊😊

[@prathuna9681]

😊😊😊😊😊😊😊😊00

[@Kindness-ys8gl]

Finally found the roadmap where i feel confident to begin with Data Engineering. Thank you Jash:)

[@JashRadia]

Awesome to know! All the best 😁

[@tomx4278]

THIS IS EXACTLY WHAT I NEED. This video gives us a clear direction to someone likes me who wants to transition to data engineer as a data analyst. Now I know what skills I already had and learn those I'm lack of. Thank you Bro!

[@JashRadia]

Awesome! Glad it will be helpful 😊

[@wa7diniana51]

can you share with us the reason why you want to take the transition from analyst to data engineer?

[@chuchi3263]

same question @tomx4278 @@wa7diniana51 @tomx4278

[@nareshkumarnandyala5831]

Finally, I found the roadmap for Data Engineering. I feel confident and can start now with this.

[@premkumarkanapaka5464]

i am unble to downlaod is it paid ....?

[@SanidhyaSatpathy-13]

Im proud that my algorithm finally made me land here. Now if only I'd learn how it manages to do so. Maybe my algorithm isnt good enough yet. Kudos to your channel and everyone watching!

[@sam_temp]

1) Python, SQL, Linux 2) Data warehouse 3) Spark, pyspark (distributed systems) 4) Cloud 5) Orchestration (Airflow) 6) Databricks, Snowflake (Compute) 7) CI/CD (Jenkins/sonarqube) 8) Streaming (Kafka) 9) Docker (containers) 10) Building, training & deploying a ML model 11) Data visualization (tableau or PowerBi or Looker) 12) ETL/ELT tool: Matillion or Tailend 13) Kubernetes

[@JashRadia]

So finally I have created this video that was most requested on the channel. Really hope it is useful! Like it and share with anyone who might be interested ❤️

[@subhasispattanayak9584]

Loved it! The reply of Who are you? --> I'm a Data Engineer. :)

[@JashRadia]

Thanks 😁

[@rguez2332]

Ive been 4 months learning data engineering from youtube, this video was the most helpful

[@RohitKumar-ns8bm]

@@rguez2332 which videos you gone through

[@janahareesh6817]

​@@rguez2332Hi buddy. can you please suggest channels to learn Data engineering.

[@pdbelle]

Jash, I have gone through many roadmaps on DE and I would say this is one of the best. One can see the efforts you have put in preparing this one. I can see how clearly you have provided the resources and details. Wish to see more from you on this field. thanks

[@ahmetalperenyildirim6184]

Awesome content. I'm working as DA for one year and decided to change it as DE. I watched many videos about it but this was the ultimate road map and so spesific about what needed to be done. Thank you for sharing, it was clear and sharp!

[@ankursingh730]

Finally someone giving a clear instructions and steps to follow a roadmap. I personally like the reasons you provided for learning every level. Thanks so so much!!!!

[@shivayogihiremath4785]

Hi Jash, thank you so much for the detailed roadmap. This is exactly what i wanted. I'm sure this is helping many people like me. Keep up the good work. Thanks again. !

[@MahendraSingh-sw1th]

Wow... This is like setting a benchmark for quality content on KZbin. Thank you

[@JashRadia]

Most welcome! 😊

[@babymusicshow2858]

Starting my Data Eng journey, I am glad I came across this video.

[@seanpaulson9098]

Coming from someone not working in the field I've just been doing codecademy and all this stuff is what I actually see on job requirements...

[@bharatchaudhury]

Being a Hadoop Platform Engineer , have been struggling to see a proper road map to move to DE . I have come across this . Thanks a lot man . This gives me a clear picture where to go from where .

[@JashRadia]

Thanks 😊

[@Nick-du9ss]

Is Hadoop important in data engineering or we can learn spark

[@vishalkhati6684]

Thank You so much for creating a video on roadmap for data engineering. I was looking for such a video on KZbin and finally you uploaded it.

[@JashRadia]

Thank you for watching 😊

[@onegrapefruitlover]

This roadmap is extremely valuable for technologically-minded people looking to turn their life around (like me) Thank you so much, Jash 🙌

[@saikumarpydi4124]

started this course from scratch today, from zero i will complete all these courses and hopfully become a data engineer

[@JacksonNgari-t2e]

How it's going mate

[@michaelmuell]

Awesome video, exactly what I needed without looking for it! The KZbin algorithm is amazing.

[@aniedipeter7124]

This is very apt. I love the video, and I want to pick up a career in data engineering, because of your presentation. You have created an appetite in the world of data engineering! The video is actually for me. Kudos!

[@JashRadia]

Glad to know! All the best 🫡😊

[@tommy2117]

Clear and specific, the best DE road map i ever found on youtube. Thank you!!

[@JashRadia]

Thank you! Glad you liked it 😊

[@hasibulhayat9572]

Best Data Engineering Roadmap video ever. Period.

[@vivekkumar-pr3bq]

This is the best data engineer roadmap i have ever seen in KZbin ❤️ Thank you so much bro ❤️

[@JashRadia]

Thanks a lot 😊

[@anandp7777]

Thank you Jash. This is the most comprehensive path to data engineering that I have come across.

[@JashRadia]

Thank you, Anand 😊

[@debasisnath9860]

Perfect 🎉👌 As an experience SE/cloud engineer i can feel that this road map is authentic and well structured. I am following your road map Jash! Thanks for sharing 🙏

[@jubayerabdullahjoy2582]

Thanks man, currently working with Airflow for a project. This playlist gonna help a lot to dive-deep! Please continue making quality contents like this.

[@JashRadia]

Thank you for watching 😊

[@michaeltraynor456]

Hi Jash. Great video, and exactly what I was looking for at this point. I am mostly self taught so have picked up some of these skills along the way, mostly doing data analytics. I am transitioning more into a data engineering role now and while I have enough knowledge to move forward, I find I lack some of the more basic skills, like shell scripting for example. This video has given me a great roadmap for where I need to focus my energy with training. Thanks again!

[@JashRadia]

Great to hear!

[@tushargupta5122]

Thank you so much! Sir, This is the Best Roadmap Video to Become a Data Engineer, Most of the Other Roadmap videos I have seen by other KZbinrs on Data engineer is basically about the topics which we need to study. They never mention/direct about the correct resources to follow, from where we can study those topics which ultimately causes a lot of confusion and no clear direction. You've mentioned both the topics and the resources to follow. Clearly your lot of time and hard work can be seen in making this video. A BIG THANK YOU from my side. I will follow it and prepare accordingly, Just a small question, roughly how long would it take for one to become a data engineer if He/She follows your Roadmap whole heartedly, will it be 6 months? Thank you so much once again! for this amazing video. Wish you Good Luck!

[@JashRadia]

Thank you so much, it means a lot to get such response on my content! ❤️ and yes, 6 months is enough to cover everything from start. If you know some things already then 4 months will do, too!

[@tushargupta5122]

@@JashRadia Thank you so much, Sir for the response & Thank you once again for this wonderful Roadmap Wish you Good Luck! with your KZbin channel! Hope it reaches 1 Million+ subscribers super soon!

[@veenarinayat5835]

Best and most useful roadmap seen by far, being the most confused person, I am very sure about one thing that this is THE Best roadmap a person like me(complete noob) can use. Thankyou thankyou thankyou so much for this Jash, you are a life saver and time saver tooo, hope to get the answers of any confusion we'll get on the way. Keep creating content like this, much love❤️🤝🏼

[@JashRadia]

@@veenarinayat5835 thank you so much! 😊❤️

[@addarzful]

Greetings Thank you very much for sharing such a detailed and comprehensive roadmap for becoming data engineer. I had been searching in google and youtube about its guidance but couldn't find proper one until youtube algorithm recommended me your video and I am very blessed to find your youtube channel. Although I completed my Masters in Data Science and AI from UK but lots of companies are demanding that we should know some of DE engineering skills too. That's why I decided to learn some DE skills like how to build data pipelines, store in Data warehouse etc. As it's been more than 1 year since I graduated and unfortunately I am still yet to get a job related to my field. Once again, thank you very much for explaining in such depth. Jitni baar aapka shukriya ada karun utna hee kam hai. Huge regards and respect from Pakistan (your neighbour)

[@JashRadia]

Hi! It is great to know that my videos are helping out people. Couldn't be more grateful. Thank you for watching it and hoping that you get the job you're looking for asap 🤞😊

[@Bhushanghude-s7i]

Great snapshot of the data engineer roadmap, felt very confident about data engineering & practices after watching the video..Thanks a Ton to you..

[@competitionvlog4988]

Just a one stop video for aspiring and current data engineers

[@joshh6683]

Extremely excited and grateful to see this video pop into my feed. Your channel has been incredibly useful as I begin my journey as a data engineer. I will certainly be working with you soon through your topmate website! :)

[@JashRadia]

Wonderful to know and welcome aboard! Looking forward to helping you out :)

[@nu7493]

Thanks you so much for this video. I’ve been searching for months and just finding guys talking about countless tools and platforms you need to know with not correlation or structure. This is a well thought out pathway. Thank you!

[@JashRadia]

Good to know it helped 😊

[@Jammal15]

Thank you for the video. That’s exactly it. And so many ppl still thinking it’s python and machine learning first. But the roadmap isn’t what most of KZbinrs and even colleges are telling ppl. The roadmap is that one in this video.

[@SandeepYadav-or8pk]

Thanks Jash, this is really giving a very good insight specially for someone who is looking for a technology shift. Kudos !

[@JashRadia]

Thank you! 😊

[@ayophilip8997]

There are lots of roadmaps out there, man. But this is the best!

[@JashRadia]

Thank you! 😊

[@ayophilip8997]

@@JashRadia please maintain this sort of quality content and you'd be the go-to source of everything data engineering in the world.

[@naturesmusic-relaxingpeace6156]

I have gone through many Roadmap Video's and was not clear on things. But you my Friend, you are the Besttttttttttttt. Btw you have good Teaching skills. Thank you so much for taking time and helping other

[@JashRadia]

Thank you! 😊

[@santaw]

Exactly what I have been looking for. I have tried to find multiple learning sources and there are sooo many (both good and bad)... I will go through all of them and I really wish I will be able to shift my career to realm of Data Engineering in the future. Thank you again :D

[@rishovbarai]

Thank you very much, it reduces the confusion what to learn and what to learn first. It saves a lot of the time and confusion. Thank you again.

[@JashRadia]

All the best! 😊

[@rishovbarai]

@@JashRadia If you can share how to make a cv and hunt for job it will be very helpful. Not getting much calls , job less for more than 4 month

[@rajunaik8803]

Thanks Jash! Found this excellent road map after a deep research.

[@abdulsajidshaik4525]

Thank you, Jash. It's clear and explained the road map very neatly.

[@JashRadia]

Thanks 😁

[@_pratiksaShirke]

Finally I got the roadmap what I am looking for thank you for giving the links for hands on that's where I am lacking I am ETL developer , working on my skills to become data engineer, confused between the courses n what to start with but you have given the exact path Thank you so much

[@JashRadia]

All the best with your learning journey! 😊

[@ujjwalds]

This is Perfect! Thanks alot, I'm gonna follow this roadmap starting right now

[@JashRadia]

Great! All the best 😊

[@ankitranjan88]

I am really looking the Roadmap for Data Engineer and here i am. Really this video is very helpfull in every aspects.

[@harshtripathi0210]

Thank you so much sir.. I searching this from a month... This really help me a lot as a beginner..😊😇🤩

[@harshtripathi0210]

Sir, I am in first year (CSE - DS ) I learn java, so should I change language to python ??

[@akshaykumartelkar1567]

This would helps tremendously. Working as an on-premise DE was looking forward to upskill. Thank you so much ❤️

[@JashRadia]

Thanks for watching 😊

[@amankumarsingh3755]

Excellent intro, a birds-eye-view on this field. Thank you for sharing valuable information.

[@pratikbarot]

Very well curated video man! Planning to start this soob. Thanks a lot for the effort. Keep up the good work Jash.

[@JashRadia]

All the best! 😊

[@kais_lamine]

Great video! I just took a Data Engineering Internship offer with no prior experience whatsoever and it felt like a lot to take in This roadmap made it a lot easier for me to determine on which aspects I should focus on and improve I wish there was free alternatives tho, we barely get paid in internships in Tunisia so most those courses are out of limits

[@JashRadia]

I haven't come across any worthy substitutes of these paid courses. But you can wait for the sale

[@fawadmahdi]

Excellent video and resources.. one of the top data videos I've seen in a long time

[@JashRadia]

Thank you! 😊

[@takihasan8310]

I am a student and ML aspirant. I don't know in how many posts, I have been told how data engineering is integral to the data analyst, data scientist, or ml engineer's job but couldn't understand why. I came here mainly to get an idea why data engineering is valued and what it really consists of. There were many LinkedIn posts, videos and all, but only your video cleared my all doubt regarding what data engineering really consists of. Thanks for the video

[@JashRadia]

Awesome to know! Thanks. Just wait for my next video. Without spoiling anything, I would just like to say that it will be perfect for you and give you even more depth about data engineering and why is it needed.

[@madj0312]

thank you very much for the roadmap...i been learning for the last few months, without an order to become a data engineer some day/// your roadmap is well curated. i will comment my progress here in comments every month till i get a actual DE job :)

[@JashRadia]

Thank you! And all the best for your journey 😊

[@mlvprasadofficial]

Tq Josh, working as a azure data engineer... Following u.. To become a googler

[@JashRadia]

Let's manifest that I meet you one day at Google! 😊

[@giovannileon1063]

Thank you so much!! I have no idea about your channel, but I really like this video. Now I have a better understanding about what are the next steps to get into a Data Engineer. 😁

[@JashRadia]

Great! All the best 😊 and subscribe to the channel if you like it. More to come!

[@janicejose5809]

This was exactly what I needed !! cleared so many confusions by plotting precise path Thanks a lot❤

[@shuvoshihab9370]

Thank you a lot i was badly searching for a clear guide line.

[@enriqueeduardoguzmannolasc5092]

Excelente video, me ha dado una visión más amplia y el camino para poder convertirme en un gran ingeniero de datos, saludos desde Perú, muchas gracias Jash.

[@chandinivelilani2383]

Thank You for the clear explanations and easy-to-follow references.

[@JashRadia]

Glad it was helpful!

[@Anilsree-06]

Fabulous content Jash!! Whole market content is available from end-end. Thanks for your time and effort you put on this Jash.

[@JashRadia]

You are so welcome! 😊

[@chayanchoudhury6041]

What an outstanding piece of work !!! Hats off to you...

[@ritviktyagi9221]

One of the most insightful videos I have seen. Subscribed excited for the things to come.

[@JashRadia]

Thank you! Won't be disappointed 😌

[@gauravkumarpawar8386]

What a great roadmap. Thank you for sharing

[@everythingunitalian8367]

This is so clear, thanks a lot This roadmap has answered all of the questions I had

[@manjushrithorat9787]

Thank you for the roadmap for data engineer. This is helpful.

[@darshita1270]

this is truely a god tier roadmap! i was so frustrated with no one explaining the full map in a solid order till the end. they just throw in random technology names and their purpose but don't tell the sequence properly. thank you so much for this.

[@imedchaabouni7691]

After 4 years of development with Python, now I am looking to start my journey into Data area. This was exactly what I was looking for. Wish me best and #YNWA #LFCfan here :)

[@JashRadia]

All the best and #YNWA ♥️

[@kavyashreearavind5]

Thanks much for this! Been dwelling with n number of resources. Gonna start it off from scratch!

[@Hellbringer23]

Thanku for the guidance...I got placed as a data engineer and needed this roadmap for skill up.

[@JashRadia]

This was exactly my situation. I didn't have this back in the day hope it's useful to you! 😊

[@unclehugo3413]

I know where to start from now, watching this video is immense. Thank you #YNWA 🙏

[@GaiaNardella]

Hello Jash, thank you very much for this video, my dream is to become a Data Engineer at Google like you, and your channel is really helpful to understand what to study. Thank you very much for all the info you share, I love your videos!

[@JashRadia]

Thank you, Gaia! Hope you get to be here, soon! 😊

[@aishwaryaradia]

Loved the Intro Monologue 👌🏻 Keep it Up 😁

[@JashRadia]

Thank you so much! It took 3-4 tries to get it right in one take 😂

[@DataEngineeringArabic]

I'm enrolled in a Data engineering bootcamp. And i wish they followed your road map ., Because i feel completely lost (,I'm coming from non CS background).. I found out that i have to have good knowledge of python ,, RDBMS /SQL.. They started with Hadoop hive Kafka hbase .. and then python .. but python is another huge world .. so i paused the live session untill i finish learning python .. i discovered that many small doubts i didn't understood in the previous skills .. i found the answer in python .. .i would recommend also studying computer science fundamentals . Your road map is the best way to start learning this beautiful field . Thank you

[@JashRadia]

Really glad it will be helpful. And yes, I don't think learning hadoop or spark or kafka should be done first. You can follow the order I have mentioned 😊

[@satyajitrajbanshi3620]

Thank you so much.. I got on campus placement and got this role.. It's really helpful.

[@JashRadia]

All the best! 😊

[@satyajitrajbanshi3620]

@@JashRadia Thank you so much sir

[@jaladhithakur7567]

Great video, Jash. Very engaging intro😄

[@JashRadia]

Thank you ❤️

[@ishitasrivastava5923]

Thanks a lot for this video

[@sanketpatel8430]

This is amazing!!!! Thank you so much❤️ This is what I needed.

[@JashRadia]

Awesome. Glad you liked it 😊

[@ShagilIslam]

Absolutely spot on!

[@pydinaidu1]

Love you man .this is much helps for me

[@lwcrxft836]

Really valuable information. As an university student who aims to be a data engineer. I thank you a lot!

[@JashRadia]

Awesome to know! Thank you so much 😊

[@sandeepe1059]

Excellent info, thanks for providing the links. Really helpful for everyone.

[@JashRadia]

Thank you, Sandeep 😊

[@anujshah7614]

Really good one. That's exactly I was looking for. Thank you!

[@JashRadia]

Awesome! Glad to help 😊

[@fab-freshaquaponicbiospher6335]

Brother, this is damn good.. I would have paid someone for sharing these vital details.. This is gem of a video.. . I was GCP Data Engineer, laid off a month back and was panicking what to do.. This was really helpful..

[@JashRadia]

Thank you and I wish you all the best! Hope you find something good soin

[@MJ-gu6uu]

Thank you very much for the work you’ve done) very good structured and clear way to become DE ❤

[@JashRadia]

Thank you! 😊

[@maryreprado]

thank you so much!!!! i got inspired by your videos.. i´m changing careers from a non-cs-background and this road map will help a lot, i just will add some knowledge of IT Fundamentals because at the beginning it can be a little overwhelming..

[@JashRadia]

Thank you! I understand it can be overwhelming for sure. Spend more time in prerequisites and just know that everyone has their own pace. Just learn something everyday! 😊

[@Kim-zr2ss]

Thank you! I am going to follow the roadmap!

[@JashRadia]

All the best! 🫡

[@jeremiahworkman1631]

I think I'll just memorize your intro Spiel so that when people ask why my job is, I have a super complex-sounding explanation that will gloss over peoples' faces and make me sound super technical

[@JashRadia]

Awesome xD

[@niharranjanbehura4490]

Thanks Jash, This structure gonna be helpful for sure,

[@JashRadia]

Awesome to know!

[@satyasamal4270]

Thank you so much Jash for making this video.

[@JashRadia]

You're welcome! Glad you liked it 😊

[@edragon1412]

Haha. Like your intro, man. You got my sub. Great work!

[@lovaprasadgubbala]

Hey @Jash thanks for the fantastic video . .loved it n most informative.

[@prajwalsonawane6835]

Thank a lot for creating such content! Very insightful and informative

[@JashRadia]

Welcome!

[@secondsuraj]

Thanks Jash, learnt a lot.

[@Apple-cl5sj]

Thank you so much brother Loved it

[@EngineeringSprits]

Bro you are genius mtlb mind blowing superb pure youtube s kisi n dhng s nhi btaya sbb ana course bechre the thanks for helping me❤❤

[@editorsdunia1277]

Hi bro i am your regular viewer and supporter bro ❤️keep teaching ❤️(data engineer folks)

[@JashRadia]

Thanks a lot! Love to hear from my viewers 😊

[@majidmenouar2444]

Thank you! this was super helpful!

[@JashRadia]

Glad to know!

[@parwezattar4228]

Bro salute to you👏👏