The Ultimate Big Data Engineering Roadmap: A Guide to Master Data Engineering in 2024

{The Ultimate Big Data Engineering Roadmap: A Guide to Master Data Engineering in 2024} ****** 📕 Get a flat 15% Discount on all Geeksforgeeks courses. Use Coupon Code: KAISHGFG 👉👉Link: practice.geeksforgeeks.org/
This video is NOT sponsored. Some product links are affiliate links which means if you buy something we'll receive a small commission.
📒 Show Notes 📒
PW Skills Lab: lab.pwskills.com/lab-templates
Class-1: Learn Data Engineering: On Any Laptop [Class -1] PySpark Tutorial
Link: • Learn Data Engineering...
Class-2: Learn Data Engineering: PySpark Introduction [Class -2] PySpark Tutorial
Link: • Learn Data Engineering...
1️⃣ 📕 15% OFF SALE 📕 Get a flat 15% Discount on all Geeksforgeeks courses. Use Coupon Code: KAISHGFG 👉👉Link: practice.geeksforgeeks.org/
2️⃣ 📘 I actually host all high-traffic WordPress sites on Leapswitch, and it’s going great so far. But what about your website? ➡️ Try Leapswitch risk-free for 30 days: www.leapswitch.com
Our mission here at The Engineer Guy 2.0 is to help 100,000 students to get free online courses, internships, and jobs. Be a part of The Engineer Guy community and help each other.
Here is my last KZbin Channel with a student community of more than 50k Students:
⚡️The Engineer Guy: Watch our FREE KZbin videos here: / @theengineerguy
⚡️Get DataCamp Premium Subscription: • How To Get DataCamp Pr...
⚡️Learn Competitive Programming For Free
View full playlist➡️ • Learn Competitive Prog...
⚡️Coursera Free Online Courses | How To Get Coursera Courses For 100% Free With Online Free Certificates
View full playlist➡️ • Coursera Free Online C...
⚡️A Comprehensive Guide to International Academic Internships [Fully Funded]
View full playlist➡️ • A Comprehensive Guide ...
Connect with Kaish (The Engineer Guy 2.0) on Social Media:
➡️ theengineerguy.in/
➡️ / kaish114
➡️ / kaish114_
➡️ / theengineerguy_
QUESTION - Have a question about Online Courses, Internships, Technology, Jobs, Marketing, or Anything Else? Post in the comments section of this video!
Subscribe to The Engineer Guy 2.0➡️ / @theengineerguy_
Join Our Telegram Channel ➡️ telegram.im/@theengineerguych...
--------Cameras and Gear Used To Shoot This Video ------
Laptop: Predator Helios 300 (Link: bit.ly/2Of2Bcm)
Video: Canon M50 Mark II (Link: amzn.to/3ozUWDe)
Audio: Boya BY MM1 Mic (Link: amzn.to/3bG14Vy)
Audio: Maono Au-04 Mic (Link: amzn.to/3fzAM8A)
Music provided by Epidemic Sounds. Start your free trial here ➡️ Music
#theengineerguy #kaish114 #coffeewithkaish #dataengineer
About:
I’m Md Kaish Ansari Data Science Enthusiast and always tries to learn new things. 20 Years Old Computer Science Student. Interested in machine learning. Love solving algorithmic challenges, learning new algorithms, data structures, and building things from scratch.
Disclaimer:
video is for educational purposes only. Copyright Disclaimer Under Section 107 of the Copyright Act 1976, allowance is made for "fair use" for purposes such as criticism, comment, news reporting, teaching, scholarship, and research. Fair use is a use permitted by copyright statute that might otherwise be infringing. Non-profit, educational, or personal use tips the balance in favor of fair use.

[@amarjeetroy5369]

Summary 1. Any Programming Language (Python/Scala/Java) 2. Hadoop Ecosystem - Apache Spark ( Preprocessing Framework) - HDFS (File Storage) - Hadoop YARN (Resource Manager) - Apache Mesos 3. Storage System - SQL (RDBMS) - NoSQL (MongoDB, Cassandra) 4. Datawarehousing - Apache Hive - Snowflake 5. Real Time Data Preprocessing - Apache Kafka (Data Streaming and Preprocessing) - Apache Flink - Apache Storm 6. WorkFlow Management/Orchestration - Apache Airflow 7. Any Cloud Service (AWS, Google Cloud, Microsoft Azure) 8. Overall Knowledge- Data Modeling, ETL Pipeline 9. System Design 10. Sqoop 11 . Data Visualization - PowerBI, Tableau, Python Data viz 12. Competative programming/ DSA - Leetcode Practice

[@mgdesire9255]

Yes bhaiya aap series banao..end to end data Engineering ki

[@theengineerguy_]

Kosis kr rha mai 🙌

[@princekumarrollno-1033]

​@@theengineerguy_hello bhaiya aap data engineer series bnaiye humlog support karaige 😊

[@kashifsadiq4145]

ap data engineer ka course shuru kren hindi me

[@alhasanmohammedbinquraish960]

Please sir 🥺

[@VaibhavSingh-kh3jr]

@@theengineerguy_ thanks bhaiya

[@AkashVerma-ig5qv]

So insightful

[@Zeus-th6uu]

Thanks alot sir this information was really helpful for me I am starting my journey of becoming a Data Engineering from today!!!!!

[@imnotfromIT]

Yes please make Playlist for Data engineering from scratch

[@Namangen]

Man this video is a no brainer . I exactly wanted this and my first click landed me to the right place.

[@inshorttalks]

Yes bro . please bring on the series

[@the._.pandeyji]

OG bhaiya ❤ .. Bss aap Playlist bna do from scratch Data Engineering ka

[@zainfarooq9949]

Kindly make a series on Learning Data Engineering

[@chiranjivmansis1415]

Please make a tutorial on complete end to end data engineering courses sir

[@FIROZkhan-ud2pt]

Yes Please start making detailed vedios with each and every topic related to data engineering actually i didnt find ant detailed vedio related to big data on youtube. so please start

[@amitkadam5698]

Yes , aap total data engineering ke upar tutorial series le aao

[@mohammadthousif7439]

can you please make a report or something of that kind that has all the concepts and tools you mentioned in the video and resources where it can be learnt so it will be easy to follow through.

[@Buozberkien]

Please make a playlist on priority 🤞🏻 whatever skills you have mentioned in the video. I have seen a lot of videos on youtube but at the end i always got confused. How to start , what to do … so please make the playlist for every skills which is needed . And , please abhi ke liye at least Hadoop ecosystem pe videos bnado jo jo uske part hai jese Hdfs ,hive, and pyspark , ye sab apache kafka , airflow .

[@Funfunny820]

Please sir complete course

[@x-6790]

Bro i am now in 5 th semester AI & Data science Engineering. From where should i start ?

[@heighterses]

this is awesome but how can we practice and where should we learn these things what's your recommendation on this any course or any site you prefer??

[@DataCoholic]

Which language you chosed for giving the DSA rounds?

[@user-cc4nj4uw1d]

Please explain your VISA process for working in London ..

[@viewpoint857]

Please complete series banaiye DE ke liye

[@dkr1998]

Have you used kafka in java or scala or python ?

[@shivapradhan431]

Hi sir, congratulations for Joining the JP Morgan Sir could please share or make a video on free platform to learn languages & all the topics you mentioned in the video because many of people or student who really wants to learn the data engineer but they can't afford the fee for the particular session or paid platforms A humble request from mine side to make video on this topic and Thanks for the road map this is very helpful me and for those who chooses their carrier towards the Data Engineer.😊

[@rugvedpatil5604]

Bhai ye sab to bhout hai main just data engineer ka interview Diya hai or unhone python or SQL he pucha or basic etl vo bhi easy tha Or vo bhi fresher ke liye itna nhai mangte hai

[@theengineerguy_]

Very correct! Freshers ki hiring toh kewal DSA and projects se bhi ho jati hai. But you never know what’s coming. And these are the skills you’ll be working on as a DE. So I believe better prepare these skills for a bettter chance 🙌

[@rugvedpatil5604]

@@theengineerguy_ muze lekin dsa nhai pucha tha or me DSA focused padhta nhai hoon bhai me thoda project oriented hoon Ban ne me maja ata hai muze

[@uzaifquadri]

For which company bro

[@rugvedpatil5604]

@@uzaifquadri go digital

[@devanshdubey4588]

Bhai please mujhe bata do, mera interview he data engineer ka, kya puchega wo, python me kya kya pucha, aur sql me bhi

[@hsrr136]

Pls reply which is best course for data science to get job

[@manas9926]

Can you suggest industry ready projects in data engineering to start a career as a fresher??

[@Shruti_Gore]

Bhaiyaa kya aap har skills ko kitna time dena hai kya wo explain karoge kya?

[@DEwithDhairy]

For Data Engineering Interview Preparation follow my KZbin channel ; www.youtube.com/@DEwithDhairy/playlists

[@SohailKhan-hd8gz]

Ye sabhi k resources per bhi ek video banayi sir . Free resources or paid jaha sey hum structure way mey padh kar apna time bacha sake ❤ very informative ❣️ Thank you 😊

[@wizardboigaming4023]

😊❤

[@palnitin25]

Bhai abhi Mera last year start hua hai BCA me or mene data analyst ke 5 project bna rakhe hai SQL, powerbi and excel use karke or merko data analyst ke tools and technology ati hai or merko abhi data engineer ban na hai batao ab kya karo

[@shandeepraula]

Hello Bhai , can you suggest resume project?

[@ashpreetsinghanand7260]

Bhaiya project bhi bata do apne jo banye

[@xx-pn7it]

Bhaiya 4 month data engineering step by step roadmap bnado please 🙂

[@_AmitVlogs]

why you have not applied resources 😕

[@user-mr8bs8wj3t]

Plz sir make videos..

[@nayankumar5833]

But ye sb hum kaha se study krenge playlist bna se bhai aap

[@Adeelkhan-xz5mo]

Why you did not mention R language sir ?

[@sushmitag528]

Intellipaat platform fake h kya achhi h vaha 6month ka course h wo bol rahe job mil jayegi? Plz help kro kuch batao na

[@ejajahemad157]

bhai Maine btech nhi kiya h kya mai Data engneer ki taiyari kr skta hu nhi

[@ujjawalanand5216]

Bhaiya kaha se course padh le cheap rate mein

[@Aman-lv2ee]

Arre bhai abhe 3~4 skills aur reh gye h, part 2 please.

[@noob_2377]

I'm looking for peer person who can learn simultaneously, please reply for this comment.

[@shortinfovids2218]

sir, how much DSA is required . for DE interview ?

[@theengineerguy_]

If you can solve blind 75 set of problems from Leetcode then you’re good to go!

[@Funfunny820]

Python seekh sakta hooooo

[@mgdesire9255]

Bhaiya series hold pe hai kya...still waiting for video no.4

[@theengineerguy_]

Jald hi ayega

[@chakrabarti9634]

@@theengineerguy_ sir what should be the realistic time line to learn these technologies from scratch tell in hours ( like on an avg 4 hours for 3 months almost 300+ hours like in that way) please reply

[@shashikantverma7215]

Aap bataiye nahi ki aap ytube per bhi ho❤😊

[@vaibhavshah4898]

Bhai referal de do j p morgan me 😅

[@vishalmane3139]

Roadmap nhi, resources bataya kr!

[@ashwinidhomne4244]

Can freshers get n job as a Data Engineer?

[@Nature_lover_Bnda]

in india its easy at abroad its difficult for a fresher

[@pudinhara8412]

How much DSA is needed and which data structures for cracking DE job role.

[@shaiknayeem3277]

Medium level leetcode is must

[@abdullahsiddique7787]

Kaish bhai Salam is data engineering field high paying job ? Compared to data analyst or sata sceince or devops field ?

[@alhasanmohammedbinquraish960]

Apache kafka sir 🥺

[@dkr1998]

Any good sources to learn kafka ?

[@vickygupta4263]

No

[@alhasanmohammedbinquraish960]

Sir apache kafka 🥺

[@sujayakumar2076]

Vaii jaise boLa deemag se ghus nehi rah hai itna saraaa hai , sab padhne ke Liye bol reh ho toh kiya padhe 😅😅😅😂

[@alhasanmohammedbinquraish960]

Apache kafka sir 🥺