The Ultimate Big Data Engineering Roadmap: A Guide to Master Data Engineering in 2024

[@amarjeetroy5369]

Summary 1. Any Programming Language (Python/Scala/Java) 2. Hadoop Ecosystem - Apache Spark ( Preprocessing Framework) - HDFS (File Storage) - Hadoop YARN (Resource Manager) - Apache Mesos 3. Storage System - SQL (RDBMS) - NoSQL (MongoDB, Cassandra) 4. Datawarehousing - Apache Hive - Snowflake 5. Real Time Data Preprocessing - Apache Kafka (Data Streaming and Preprocessing) - Apache Flink - Apache Storm 6. WorkFlow Management/Orchestration - Apache Airflow 7. Any Cloud Service (AWS, Google Cloud, Microsoft Azure) 8. Overall Knowledge- Data Modeling, ETL Pipeline 9. System Design 10. Sqoop 11 . Data Visualization - PowerBI, Tableau, Python Data viz 12. Competative programming/ DSA - Leetcode Practice

[@fawad_khan]

@@amarjeetroy5369 big thanks 🙏

[@devil_around_you]

Life Savor

[@kaustubhgupta12]

thanks

[@haryanaharyanvi782]

this can be for 3 domains (1) software engineer , (2) data analyst , (3) data engineer

[@mgdesire9255]

Yes bhaiya aap series banao..end to end data Engineering ki

[@theengineerguy_]

Kosis kr rha mai 🙌

[@princekumarrollno-1033]

​@@theengineerguy_hello bhaiya aap data engineer series bnaiye humlog support karaige 😊

[@kashifsadiq4145]

ap data engineer ka course shuru kren hindi me

[@alhasanmohammedbinquraish960]

Please sir 🥺

[@VaibhavSingh-kh3jr]

@@theengineerguy_ thanks bhaiya

[@zainfarooq9949]

Kindly make a series on Learning Data Engineering

[@amitkadam5698]

Yes , aap total data engineering ke upar tutorial series le aao

[@chinyu5934]

i know about mongo db ,linux,shell scipting, aws services , python and their libraries, advance excel ,power bi,mysql,sql server ,pl/sql, machine learning(superwised and unsuperwised), jira(WFM),microsoft fabric..

[@brohisarfaraz8750]

Dear kindly make videos on these technologies. Because the way you are defining things is amazing and a person can easily understand. And thank you so much for this ❤❤

[@ojaswighate2588]

Please provide tutorial from beginning to end with projects. Please Provide big data course

[@the._.pandeyji]

OG bhaiya ❤ .. Bss aap Playlist bna do from scratch Data Engineering ka

[@imnotfromIT]

Yes please make Playlist for Data engineering from scratch

[@charugera7654]

Very useful video. Can you please do a videos on Big data vs data engineer as a career choice, salary, future prospects etc.

[@Namangen]

Man this video is a no brainer . I exactly wanted this and my first click landed me to the right place.

[@SohailKhan-hd8gz]

Ye sabhi k resources per bhi ek video banayi sir . Free resources or paid jaha sey hum structure way mey padh kar apna time bacha sake ❤ very informative ❣️ Thank you 😊

[@wizardboigaming4023]

😊❤

[@chiranjivmansis1415]

Please make a tutorial on complete end to end data engineering courses sir

[@wagalprasad1869]

Nice video, make it complete video for cloud

[@sahilkarekar2875]

without time wasting...genuine info in short with depth knowledge :)

[@hardikkanak]

Superb explanation. could you please create end-to-end project in the single video with practical overview. it would be helpful for us. Thanks❤❤❤

[@Jaihindfitness-v3z]

Bhaiya ye bhi puchne ki baat h please lekar aayi inke tutorials ❤❤❤❤

[@NAYANPATIL-ri5ul]

Superb bro a perfect roadmap for freshers.

[@SuryaKiranK-j4c]

hello sir thank you so much for making this video , mene bohot logon ki videos dekhi hai koi itna clearly and simple way me bata nhi paya , you helped me a lot to get the whole picture , A new subscriber to your channel , I hope god bless you !❤

[@SATYARATHOD1799]

Yes you can

[@HKRajnish]

Bhaiya Code with Harry jaisa aap v ak end to end date engineer ka series bana dijiye. With Live project 🙏

[@helloabd123]

Mongodb toh bandh hone wala hey iska best alternative konsa hey phir

[@RahulKumar-q6h5k]

It is possible without degree..... Please reply bhaiya 🙏

[@mohammadthousif7439]

can you please make a report or something of that kind that has all the concepts and tools you mentioned in the video and resources where it can be learnt so it will be easy to follow through.

[@Zeus-th6uu]

Thanks alot sir this information was really helpful for me I am starting my journey of becoming a Data Engineering from today!!!!!

[@namohnaman]

Best video so far

[@x-6790]

Bro i am now in 5 th semester AI & Data science Engineering. From where should i start ?

[@FIROZkhan-ud2pt]

Yes Please start making detailed vedios with each and every topic related to data engineering actually i didnt find ant detailed vedio related to big data on youtube. so please start

[@hrushikeshkhonde7079]

Thanks ...😊❤

[@Buozberkien]

Please make a playlist on priority 🤞🏻 whatever skills you have mentioned in the video. I have seen a lot of videos on youtube but at the end i always got confused. How to start , what to do … so please make the playlist for every skills which is needed . And , please abhi ke liye at least Hadoop ecosystem pe videos bnado jo jo uske part hai jese Hdfs ,hive, and pyspark , ye sab apache kafka , airflow .

[@tech_Animus]

Can I completed it in just 6 months

[@xx-pn7it]

Bhaiya 4 month data engineering step by step roadmap bnado please 🙂

[@VarunRithvik-c5o]

Please explain your VISA process for working in London ..

[@DigiPathak7]

Please complete series banaiye DE ke liye

[@tanmaydas1146]

Sir I am from humanities background... Having 3yrs experience in BPS sector... But I want to be a data engineer..... CURRENTLY I'M LEARNING YOUR MENTIONED SKILLS... I'M doing post graduation degree in data science from IIIT, BANGALORE QUESTION:- IS MY PAST EDUCATIONAL BACKGROUND WILL IMPACT IF I'M GOOD TO LEARN THIS DATA ENGINEER TOOLS... PLEASE GUIDE ME...

[@varunthakkar6349]

Please tell best resources to learn al of these skills Paid or Free . Atleast tell ?

[@pujagopalpatil7502]

Sir mujhe sikane hai sabhi technology

[@shivapradhan431]

Hi sir, congratulations for Joining the JP Morgan Sir could please share or make a video on free platform to learn languages & all the topics you mentioned in the video because many of people or student who really wants to learn the data engineer but they can't afford the fee for the particular session or paid platforms A humble request from mine side to make video on this topic and Thanks for the road map this is very helpful me and for those who chooses their carrier towards the Data Engineer.😊

[@Self.Writer]

bca ke degree se jaa skte hai skill ke sath

[@viveksingh2733]

Bhai BCA student Data engineer ban sakte hai??pls reply sir

[@DataCoholic]

Which language you chosed for giving the DSA rounds?

[@Shruti_Gore]

Bhaiyaa kya aap har skills ko kitna time dena hai kya wo explain karoge kya?

[@Adeelkhan2112-h2h]

Why you did not mention R language sir ?

[@lokeshsairam8300]

bro can you help me by a video in connecting the pyspark in windows

[@inshorttalks]

Yes bro . please bring on the series

[@AkashVerma-ig5qv]

So insightful

[@Aman-lv2ee]

Arre bhai abhe 3~4 skills aur reh gye h, part 2 please.

[@infinitysoundmotivation9768]

Please tell how much required for freshers role

[@vatsalrathi9466]

I am a 2nd year college student from tier 3 college i should go for data engineering or fullstack development in this pls suggest me

[@shandeepraula]

Hello Bhai , can you suggest resume project?

[@mgdesire9255]

Bhaiya series hold pe hai kya...still waiting for video no.4

[@theengineerguy_]

Jald hi ayega

[@chakrabarti9634]

@@theengineerguy_ sir what should be the realistic time line to learn these technologies from scratch tell in hours ( like on an avg 4 hours for 3 months almost 300+ hours like in that way) please reply

[@hsrr136]

Pls reply which is best course for data science to get job

[@pavanbm2001]

databricks?

[@ashpreetsinghanand7260]

Bhaiya project bhi bata do apne jo banye

[@PrathamSingh-gr5wq]

Sir S a data science ke course me mujhe dsa kena jaruri hai kya python me

[@heighterses]

this is awesome but how can we practice and where should we learn these things what's your recommendation on this any course or any site you prefer??

[@dkr1998]

Have you used kafka in java or scala or python ?

[@SaniyaChamanshaikh-n1g]

Plz sir make videos..

[@parmarsunil8937]

Hii ... Dear You explain very well. Just i want to know, is any other field person can become data engineer?? Is it tough to learn those all thinga and become data engineer as well ad get good job in this field?

[@DEwithDhairy]

For Data Engineering Interview Preparation follow my KZbin channel ; www.youtube.com/@DEwithDhairy/playlists

[@priyadebnath4941]

Bhaiya kya aap mujhe guide kar sakte ho to crack product based company with data engineer and resume v bana lia check karnek liye

[@_AmitVlogs]

why you have not applied resources 😕

[@AncientWonders-g5q]

Please sir complete course

[@bhikhamkumar1384]

Bhaiya yar aap ne source nhi btaya kaha kaha se padhna hai

[@nayankumar5833]

But ye sb hum kaha se study krenge playlist bna se bhai aap

[@sushmitag528]

Intellipaat platform fake h kya achhi h vaha 6month ka course h wo bol rahe job mil jayegi? Plz help kro kuch batao na

[@shortinfovids2218]

sir, how much DSA is required . for DE interview ?

[@theengineerguy_]

If you can solve blind 75 set of problems from Leetcode then you’re good to go!

[@ShivamSingh-kb3ff]

Yes yes yes!!

[@brohisarfaraz8750]

Impressive

[@sahilabbas5712]

Bhai kuch chorna bhi hai...?

[@ujjawalanand5216]

Bhaiya kaha se course padh le cheap rate mein

[@manas9926]

Can you suggest industry ready projects in data engineering to start a career as a fresher??

[@shashikantverma7215]

Aap bataiye nahi ki aap ytube per bhi ho❤😊

[@ashwinidhomne4244]

Can freshers get n job as a Data Engineer?

[@JinnahClaus]

in india its easy at abroad its difficult for a fresher

[@rtk_here]

Itna jyda tool 3 se 4 mahine me kaise hoga Isse achha web dev kr lu 😅

[@palnitin25]

Bhai abhi Mera last year start hua hai BCA me or mene data analyst ke 5 project bna rakhe hai SQL, powerbi and excel use karke or merko data analyst ke tools and technology ati hai or merko abhi data engineer ban na hai batao ab kya karo

[@ejajahemad157]

bhai Maine btech nhi kiya h kya mai Data engneer ki taiyari kr skta hu nhi

[@vishalchauhan9832]

@@ejajahemad157 yes u can

[@AncientWonders-g5q]

Python seekh sakta hooooo

[@noob_2377]

I'm looking for peer person who can learn simultaneously, please reply for this comment.

[@nyalapallykeerthana]

@@noob_2377 hii.... I too wanna learn data engineering

[@noob_2377]

@@nyalapallykeerthana hi

[@noob_2377]

@@nyalapallykeerthana hi please share your telegram id

[@nyalapallykeerthana]

@@noob_2377 hello

[@EBKCS_SamarthGoyal]

Bhaia apka laptop kuch jyada hi purana h

[@zeeshansaud9535]

Data Engineer Job Role and AI Contribution: kzbin.info/www/bejne/hIOafWOKiKuniacsi=k7kdCGx65-gBvpb8

[@pudinhara8412]

How much DSA is needed and which data structures for cracking DE job role.

[@shaiknayeem3277]

Medium level leetcode is must

[@alhasanmohammedbinquraish960]

Apache kafka sir 🥺

[@abdullahsiddique7787]

Kaish bhai Salam is data engineering field high paying job ? Compared to data analyst or sata sceince or devops field ?

[@vaibhavshah4898]

Bhai referal de do j p morgan me 😅

[@vishalmane3139]

Roadmap nhi, resources bataya kr!

[@hrushikeshkhonde7079]

@@vishalmane3139 be respectful man...yhi bat pyar se bhi boli ja skti thi...🙏

[@rugvedpatil5604]

Bhai ye sab to bhout hai main just data engineer ka interview Diya hai or unhone python or SQL he pucha or basic etl vo bhi easy tha Or vo bhi fresher ke liye itna nhai mangte hai

[@theengineerguy_]

Very correct! Freshers ki hiring toh kewal DSA and projects se bhi ho jati hai. But you never know what’s coming. And these are the skills you’ll be working on as a DE. So I believe better prepare these skills for a bettter chance 🙌

[@rugvedpatil5604]

@@theengineerguy_ muze lekin dsa nhai pucha tha or me DSA focused padhta nhai hoon bhai me thoda project oriented hoon Ban ne me maja ata hai muze

[@uzaifquadri]

For which company bro

[@rugvedpatil5604]

@@uzaifquadri go digital

[@devanshdubey4588]

Bhai please mujhe bata do, mera interview he data engineer ka, kya puchega wo, python me kya kya pucha, aur sql me bhi

[@alhasanmohammedbinquraish960]

Sir apache kafka 🥺

[@dkr1998]

Any good sources to learn kafka ?

[@vickygupta4263]

No

[@sujayakumar2076]

Vaii jaise boLa deemag se ghus nehi rah hai itna saraaa hai , sab padhne ke Liye bol reh ho toh kiya padhe 😅😅😅😂

[@shrutisharma1764]

Issey Acha upsc Kr lo😂

[@abhinav7536]

@@shrutisharma1764 aapne crack kar li kya 🤣🤣🤣🤣🤣

[@abhinav7536]

Aaapne crack kar li kya🤣🤣🤣

[@shubhamkumar2224]

Thanks for the insightful info , I am starting learning data engineering and do switch from test engineer to data engineer , Hope i will make it. Thanks a lot again @theengineerguy

[@alhasanmohammedbinquraish960]

Apache kafka sir 🥺