Map Reduce explained with example | System Design

  Рет қаралды 128,384

ByteMonk

ByteMonk

Жыл бұрын

In this video I explain the basics of Map Reduce model, an important concept for any software engineer to be aware of. This will help you identify and apply Map Reduce related questions during your System Design Interviews
Map Reduce Paper: static.googleusercontent.com/...
Follow me on LinkedIn: / bytemonk
System Design Interview Basics Playlist:
► • System Design Intervie...
AWS Certification:
►AWS Certified Cloud Practioner: • How to Pass AWS Certif...
►AWS Certified Solution Architect Associate: • How to Pass AWS Certif...
►AWS Certified Solution Architect Professional: • How to Pass AWS Certif...

Пікірлер: 60
@shriyaananthanarayanan
@shriyaananthanarayanan Жыл бұрын
thank you so much, today i went to my first day of internship as a 15 year old girl and didn't get the complicated words they explained me but u thought me in a way I will never forget in my whole life. thank you so much!!!!
@chanwoopark5397
@chanwoopark5397 5 ай бұрын
where in the world are 15-year olds doing internships that involve map-reduce?? that's wild
@jasonwang-wg8wu
@jasonwang-wg8wu 4 ай бұрын
15 is the new 18 (pause)@@chanwoopark5397
@backslash8874
@backslash8874 2 ай бұрын
15 year olds, doing internships, and dealing with MapReduce and distributed systems. My 25 years old senior software engineer @$* not being able to comprehend the situation. Which world you live in mah lil sister?
@shriyaananthanarayanan
@shriyaananthanarayanan 2 ай бұрын
@@chanwoopark5397 I did the internship in my brothers company so... It wasn't that hard for me to get in...
@shriyaananthanarayanan
@shriyaananthanarayanan 2 ай бұрын
@@backslash8874 brotha, it's just like 3 months internship wasn't that hard, my brother is the owner of the company so he just accepted to let me in. I was told to do a couple of work and understand d the concept first, I tried my best to go to internship coz I wanna become a senior like you. And see, that's the difference, I will introduce myself as a intern not a senior like you. 🤗🤗 I really admire you guys,🤗🤗 I waiting to finish my education and I wanna work! Infact I'm kinda girl who watches "the office"😂😂
@fishfanaticgokul4758
@fishfanaticgokul4758 6 ай бұрын
Most excited video of 2023 for an diagrammatic representation and clear cut explanation ❤❤❤ really great. College staff wants people like you to teach.
@user-cn1vt9qo9e
@user-cn1vt9qo9e Ай бұрын
The professors we want in Indian engineering colleges ❤
@nanaarhin5567
@nanaarhin5567 8 ай бұрын
The most complex name explained with the most simplest scenario. I understand this better now
@mikedelta658
@mikedelta658 Жыл бұрын
What a wonderful explanation!
@ethanxie2737
@ethanxie2737 11 ай бұрын
finally i know what is MapReduce, thanks !
@abasahebbhingardeve5464
@abasahebbhingardeve5464 Жыл бұрын
Very clear and understanding explanation.
@p33yush
@p33yush Жыл бұрын
Thank you for awesome explanation!
@johnnyc5467
@johnnyc5467 Жыл бұрын
This is a great video. Thank you!
@Sanjaysview
@Sanjaysview 7 ай бұрын
What a quality sir, hand off
@kunalsoni7681
@kunalsoni7681 8 ай бұрын
this video made a complex topic in a very simpler way ♥️☺️💯
@user-yk9rr5ir7v
@user-yk9rr5ir7v 11 ай бұрын
Thank you for this! I have a data engineering interview tomorrow and the example really helped me understand the concept well enough to be able to explain it myself if I am asked.
@ByteMonk
@ByteMonk 11 ай бұрын
my latest video on data platform might also help you prepare for the interview, all the best!
@aymanelouazzani4245
@aymanelouazzani4245 8 ай бұрын
thank you so much for this sample , beautiful and benefiting explanation
@samathaea8264
@samathaea8264 Жыл бұрын
Very helpful. thank you:)
@nikhilpathak1948
@nikhilpathak1948 3 ай бұрын
I watched many videos but your's 🔥🔥. I understood, thankyou!! 👏😊
@zabinoori49
@zabinoori49 11 ай бұрын
nice explanition with all the details thanks bro 💕💕
@ilhemwalker9145
@ilhemwalker9145 8 ай бұрын
thank you so much it's clear and well explained you answered all my whys and whats
@thedragonforce2210
@thedragonforce2210 Жыл бұрын
i lost my jaw when i saw this video , bravo , nicely done men 👍
@dhaneshpt8641
@dhaneshpt8641 4 ай бұрын
Super presentation.. Thank you sir.
@HLearningFun
@HLearningFun 7 ай бұрын
very nice and informative and detailed. thanks.
@dimon_z
@dimon_z Жыл бұрын
Bro you are awesome 👍
@NassimDAIKH
@NassimDAIKH 10 күн бұрын
Excellent video I was looking for a simple explanation like this
@emmanuelyaro8322
@emmanuelyaro8322 13 күн бұрын
thank you so much, very clear
@landocodes
@landocodes 3 ай бұрын
Amazing explanation!
@avasingh764
@avasingh764 Жыл бұрын
His Voice ❤❤️🔥🔥
@codernew3191
@codernew3191 Жыл бұрын
This is what I wanted
@cynthiabock9104
@cynthiabock9104 7 ай бұрын
Thank you for this super helpful video! What I have not understood yet is, how can I turn the process back? For example, if I am looking at the output file, how do I know in how many of those input files has the word 'apple' been? From what I understood, it could have been twice in the first (or second) file or once in each.
@vaibhavahuja4001
@vaibhavahuja4001 Жыл бұрын
great vid. thanks
@samerrawashdeh1351
@samerrawashdeh1351 Жыл бұрын
Thanks!
@yashthakur5712
@yashthakur5712 6 ай бұрын
Excellent explanation
@Veigaburame
@Veigaburame 9 ай бұрын
the example is pretty straight forward
@nizarhabib4352
@nizarhabib4352 4 күн бұрын
Very nice explanation
@teddybear0116
@teddybear0116 7 ай бұрын
Great video! Now do spark!
@shaikhuzma786
@shaikhuzma786 25 күн бұрын
Tqsm ☺️
@jasonwang-wg8wu
@jasonwang-wg8wu 4 ай бұрын
@ByteMonk dank video, very clear and concise but I've got a question: at 8:20 you say we're tasked with finding all the videos with a certain number of likes. Do we really need to go through ALL of the metadata if we're just looking for the condition "number of likes >= [some amount]"??
@hermanheinz33
@hermanheinz33 9 ай бұрын
very good video
@abhinavkrishna449
@abhinavkrishna449 4 ай бұрын
Love you broo
@siyaram2855
@siyaram2855 Жыл бұрын
🔥
@sawdawyah
@sawdawyah 6 ай бұрын
Thanx 😊
@neostark4564
@neostark4564 Жыл бұрын
His voice 🗿
@ByteMonk
@ByteMonk Жыл бұрын
I am assuming that's a compliment :)
@JayaramB-kw6rs
@JayaramB-kw6rs 8 ай бұрын
​@@ByteMonkyes it is😅
@kartikraj1779
@kartikraj1779 5 ай бұрын
@@ByteMonknah man, although you tried so we appreciate it
@mohsenkheirabadi8211
@mohsenkheirabadi8211 3 ай бұрын
I can't focus 😂
@InvincibleMan99
@InvincibleMan99 Ай бұрын
Amazing explanation sir. Would like to know how FB store likes and comments. Suppose user from India likes a video, and another user from the USA likes the same video, are they stored in same place or in a sharded db (country wise), would like to know your perspective
@lucaterraneo7274
@lucaterraneo7274 10 ай бұрын
nice!
@ByteMonk
@ByteMonk 10 ай бұрын
Thanks!
@flameyt3721
@flameyt3721 3 ай бұрын
Failure nodes in classic mapreduce
@sweethasridharan4782
@sweethasridharan4782 9 күн бұрын
Damn you're voice🤌🏼
@complexity5545
@complexity5545 3 ай бұрын
Is hadoop dead? Who is still using that.
@ByteMonk
@ByteMonk 3 ай бұрын
Hadoop, in its original form, has reached a mature stage. It's less of a buzzword and more of a foundational technology upon which other systems are built. Many companies heavily invested in Hadoop infrastructure during its peak years and still rely on it. For example Yahoo! likely still has large-scale Hadoop systems for storage and batch processing. Facebook has also Built a huge Hadoop infrastructure for data warehousing and analytics. While they've moved a lot of processing to newer systems, legacy Hadoop clusters probably remain. These companies probably don't use Hadoop in exactly the same way they did during its peak. They likely have layered newer technologies like Spark or cloud-based analytics on top of their Hadoop foundations.
@TheBoDuddly
@TheBoDuddly 7 ай бұрын
Excellent explanation!! Thank you.
Scale Cube and Microservices | System Design
3:07
ByteMonk
Рет қаралды 3,7 М.
Children deceived dad #comedy
00:19
yuzvikii_family
Рет қаралды 2,2 МЛН
Just try to use a cool gadget 😍
00:33
123 GO! SHORTS
Рет қаралды 84 МЛН
System Design: Why is Kafka fast?
5:02
ByteByteGo
Рет қаралды 1 МЛН
MapReduce - Computerphile
6:41
Computerphile
Рет қаралды 250 М.
Map Reduce Paper - Distributed data processing
9:26
Defog Tech
Рет қаралды 48 М.
What is RabbitMQ?
10:10
IBM Technology
Рет қаралды 307 М.
Learn MapReduce with Playing Cards
9:44
Jesse Anderson
Рет қаралды 343 М.
How Web Sockets work | Deep Dive
10:22
ByteMonk
Рет қаралды 5 М.