Map Reduce explained with example | System Design

In this video I explain the basics of Map Reduce model, an important concept for any software engineer to be aware of. This will help you identify and apply Map Reduce related questions during your System Design Interviews
Map Reduce Paper: static.googleu...
/ bytemonk
• System Design Intervie...
• System Design Questions
• LLM
• Machine Learning Basics
• Microservices
• Emerging Tech
AWS Certification:
AWS Certified Cloud Practioner: • How to Pass AWS Certif...
AWS Certified Solution Architect Associate: • How to Pass AWS Certif...
AWS Certified Solution Architect Professional: • How to Pass AWS Certif...
#mapreduce #SystemDesign

[@shriyaananthanarayanan]

thank you so much, today i went to my first day of internship as a 15 year old girl and didn't get the complicated words they explained me but u thought me in a way I will never forget in my whole life. thank you so much!!!!

[@chanwoopark5397]

where in the world are 15-year olds doing internships that involve map-reduce?? that's wild

[@jasonwang-wg8wu]

15 is the new 18 (pause)@@chanwoopark5397

[@backslash8874]

15 year olds, doing internships, and dealing with MapReduce and distributed systems. My 25 years old senior software engineer @$* not being able to comprehend the situation. Which world you live in mah lil sister?

[@shriyaananthanarayanan]

@@chanwoopark5397 I did the internship in my brothers company so... It wasn't that hard for me to get in...

[@shriyaananthanarayanan]

@@backslash8874 brotha, it's just like 3 months internship wasn't that hard, my brother is the owner of the company so he just accepted to let me in. I was told to do a couple of work and understand d the concept first, I tried my best to go to internship coz I wanna become a senior like you. And see, that's the difference, I will introduce myself as a intern not a senior like you. 🤗🤗 I really admire you guys,🤗🤗 I waiting to finish my education and I wanna work! Infact I'm kinda girl who watches "the office"😂😂

[@nanaarhin5567]

The most complex name explained with the most simplest scenario. I understand this better now

[@LG-qz8om]

Thank you for making this video. It saves so much time on what is a simple concept. You don't know how many times i have searched for informational videos on a subject only to have it drag out as if I'm in Elememtary School. I can't spend that much time getting to the point. I'd rather scan thru a book and pick up the data faster myself. But yor video coverted the subject concisely without wasting my time. I'll be looking for a lot more of your quick subject videos in the future. Thanks again.

[@fishfanaticgokul4758]

Most excited video of 2023 for an diagrammatic representation and clear cut explanation ❤❤❤ really great. College staff wants people like you to teach.

[@MarkGuz-d2r]

Thank you for this! I have a data engineering interview tomorrow and the example really helped me understand the concept well enough to be able to explain it myself if I am asked.

[@ByteMonk]

my latest video on data platform might also help you prepare for the interview, all the best!

[@ethanxie2737]

finally i know what is MapReduce, thanks !

[@nikhilpathak1948]

I watched many videos but your's 🔥🔥. I understood, thankyou!! 👏😊

[@malikhashim3846]

Thanks sir for the brilliant explanation 😊

[@classifiedytfanclub]

Good job bro in 9 minutes i can score 20 marks easily 😂👍👍

[@Sanjaysview]

What a quality sir, hand off

[@thedragonforce2210]

i lost my jaw when i saw this video , bravo , nicely done men 👍

[@MihirNaidu-n5v]

The professors we want in Indian engineering colleges ❤

[@abasahebbhingardeve5464]

Very clear and understanding explanation.

[@kunalsoni7681]

this video made a complex topic in a very simpler way ♥️☺️💯

[@NassimDAIKH]

Excellent video I was looking for a simple explanation like this

[@AlayDhagia]

Thanks for sharing. Nice introduction to the topic

[@ByteMonk]

Glad you liked it!😊

[@rookie2048]

I love you man Such a clean explanation

[@ilhemwalker9145]

thank you so much it's clear and well explained you answered all my whys and whats

[@Jan_Be]

Very well illustrated 🎉

[@zaidkhan-rx4bb]

Amazing way of explanation

[@dhaneshpt8641]

Super presentation.. Thank you sir.

[@prashantsalgaocar]

great explanation of map reduce.

[@HLearningFun]

very nice and informative and detailed. thanks.

[@manmeetworld]

Best one I've seen yet

[@SarthakBhutani-f2m]

Amazing explaination!

[@TheBoDuddly]

Excellent explanation!! Thank you.

[@zabinoori49]

nice explanition with all the details thanks bro 💕💕

[@avasingh764]

His Voice ❤❤️🔥🔥

[@azuretutorialclouddesignan8173]

love you bro, u made it easy.

[@data-eng-work]

thank you so much for this sample , beautiful and benefiting explanation

[@landocodes]

Amazing explanation!

[@mikedelta658]

What a wonderful explanation!

[@nizarhabib4352]

Very nice explanation

[@p33yush]

Thank you for awesome explanation!

[@johnnyc5467]

This is a great video. Thank you!

[@suryanarayanan8472]

better then my teacher

[@jasonwang-wg8wu]

@ByteMonk dank video, very clear and concise but I've got a question: at 8:20 you say we're tasked with finding all the videos with a certain number of likes. Do we really need to go through ALL of the metadata if we're just looking for the condition "number of likes >= [some amount]"??

[@prathyushk5228]

map reduce function where key deals with the like parameter from the metadata. Faster to search the cluster

[@teddybear0116]

Great video! Now do spark!

[@neostark4564]

His voice 🗿

[@ByteMonk]

I am assuming that's a compliment :)

[@JayaramB-kw6rs]

​@@ByteMonkyes it is😅

[@kartikraj1779]

@@ByteMonknah man, although you tried so we appreciate it

[@mohsenkheirabadi8211]

I can't focus 😂

[@DummyAccountqwerty]

@@ByteMonkyour voice is very clear. I like how you don’t rush through the material and explain everything clearly. It was easy to follow. Thank you for your video. Btw, some people are just pricks. Ignore them ❤

[@Veigaburame]

the example is pretty straight forward

[@emmanuelyaro8322]

thank you so much, very clear

[@dimon_z]

Bro you are awesome 👍

[@asimnayakawadi4396]

He made it so easy

[@ByteMonk]

Thansk☺️

[@yashthakur5712]

Excellent explanation

[@samathaea8264]

Very helpful. thank you:)

[@codernew3191]

This is what I wanted

[@cynthiabock9104]

Thank you for this super helpful video! What I have not understood yet is, how can I turn the process back? For example, if I am looking at the output file, how do I know in how many of those input files has the word 'apple' been? From what I understood, it could have been twice in the first (or second) file or once in each.

[@shaikhuzma786]

Tqsm ☺️

[@InvincibleMan99]

Amazing explanation sir. Would like to know how FB store likes and comments. Suppose user from India likes a video, and another user from the USA likes the same video, are they stored in same place or in a sharded db (country wise), would like to know your perspective

[@hermanheinz33]

very good video

[@SagesseValdesDongmoVoufo]

thank you so much, but maybe explain the example directly after the motivation next time.

[@darkmatter2958]

he is literally piercing with his voice

[@vaibhavahuja4001]

great vid. thanks

[@sawdawyah]

Thanx 😊

[@abhinavkrishna449]

Love you broo

[@lucaterraneo7274]

nice!

[@ByteMonk]

Thanks!

[@flameyt3721]

Failure nodes in classic mapreduce

[@samerrawashdeh1351]

Thanks!

[@sweethasridharan4782]

Damn you're voice🤌🏼

[@complexity5545]

Is hadoop dead? Who is still using that.

[@ByteMonk]

Hadoop, in its original form, has reached a mature stage. It's less of a buzzword and more of a foundational technology upon which other systems are built. Many companies heavily invested in Hadoop infrastructure during its peak years and still rely on it. For example Yahoo! likely still has large-scale Hadoop systems for storage and batch processing. Facebook has also Built a huge Hadoop infrastructure for data warehousing and analytics. While they've moved a lot of processing to newer systems, legacy Hadoop clusters probably remain. These companies probably don't use Hadoop in exactly the same way they did during its peak. They likely have layered newer technologies like Spark or cloud-based analytics on top of their Hadoop foundations.

[@bindukhadka]

✨

[@siyaram2855]

🔥

[@DaniaIrfan-r1z]

perfecttttttttttt

[@adrianadev]

5:00

[@timur2887]

Looks like author is sleeping all the video)

[@ByteMonk]

Looking back at this video, I feel the same :D