What is DATABASE SHARDING?

  Рет қаралды 941,300

Gaurav Sen

Gaurav Sen

Күн бұрын

Пікірлер: 704
@UlfAslak
@UlfAslak 3 жыл бұрын
Notes to self: * Sharding is basically a hiearchical way to index databases. * One problem is that you have to split the database somehow. What do you split on? * You only shard shards when the shard grow too big. * When shard fails you use the master/slave architecture. Writes always go to master, reads are distributed across the slaves. When the master fails one of the slaves become master.
@rishabhrastogi6076
@rishabhrastogi6076 2 жыл бұрын
Nicely put :)
@석상주
@석상주 2 жыл бұрын
I think another important question to ask is what happens if your shard exceeds its capacity. The way it works is that it further splits the shard into smaller shards (DynamoDB does this behind the scenes)
@sarathbaiju6040
@sarathbaiju6040 2 жыл бұрын
What will do when both master and slave failed?
@GvSharmaBKP
@GvSharmaBKP 2 жыл бұрын
@@sarathbaiju6040 replicate them atleast 3 (general practice)
@prateekgautam7398
@prateekgautam7398 2 жыл бұрын
@@석상주 I just have one question. When we further break a shard into multiple shards, does those shards again go into different database servers? Or they reside in the same database server?
@satyagunnam6324
@satyagunnam6324 5 жыл бұрын
I am a non-tech person, looking to learn system design concepts. You do a phenomenal job explaining these concepts & also super fun. Great job Gaurav & thank you very much!
@gkcs
@gkcs 5 жыл бұрын
Thank you!
@pavithranravichandiran6720
@pavithranravichandiran6720 6 жыл бұрын
Can't just believe, you're uploading this for free... Please continue and we sure do want to sponsor the channel if that is in the cards!
@dhruvilpatel856
@dhruvilpatel856 5 жыл бұрын
I see 67 likes so far. I doubt all 67 people are going to donate. XD
@ruhinapatel6530
@ruhinapatel6530 5 жыл бұрын
Keep doing what you're doing..You explain too nicely...and your channel is the most handy updated and to the point..learning was never so easy..
@ishannigam7352
@ishannigam7352 3 жыл бұрын
@@dhruvilpatel856 12k likes :)
@juggernaut420
@juggernaut420 6 жыл бұрын
You could be a greater asset to this country if you pour yourself into research. I studied this course from the best of the best faculty in my college, who literally knows things, but you! Hands down man :)
@gkcs
@gkcs 6 жыл бұрын
Thanks 😍
@avinashdwivedi2015
@avinashdwivedi2015 5 жыл бұрын
You should have learned from best in world from internet..
@martintourneboeuf5282
@martintourneboeuf5282 4 жыл бұрын
He could be a teacher in your University, but I wouldn't see him from Chile. Very nice videos in general. The intro of this one !!! Good job !
@Shomerful
@Shomerful 2 жыл бұрын
lol research. you can be an asset in the industry as well.
@tusharrebaca
@tusharrebaca 2 жыл бұрын
Now I seriously doubt about your College Quality :P :P :P - You should have more focused during your JEE time. :P
@official_roboGOD
@official_roboGOD 5 жыл бұрын
Your System Design Playlist is my favorite. I've got so much to learn. Thank you!
@gkcs
@gkcs 5 жыл бұрын
Glad to hear that 😁
@ashishkumarg5
@ashishkumarg5 5 ай бұрын
You are not only a good teacher, but also a good actor
@stanlyjohnson5999
@stanlyjohnson5999 5 жыл бұрын
You know you're a programmer when you count pizza slices from zero :P
@gkcs
@gkcs 5 жыл бұрын
Hahaha!
@sardorbekomonkulov6379
@sardorbekomonkulov6379 4 жыл бұрын
Or really hungry
@mohammeddanishreza4902
@mohammeddanishreza4902 4 жыл бұрын
U r wrong... Person might be a Matlab programmer where count doesn't strts with zero.
@anktrj
@anktrj 3 жыл бұрын
​@@gkcs Did you said "No we're not going to learn RDBMS" at t=40? BTW a great video Thanks!
@MattDeLuco
@MattDeLuco 3 жыл бұрын
You know you’re a DBA when you count them from one ;)
@theonlyarjun
@theonlyarjun 4 жыл бұрын
For the first time in life I'm actually enjoying theory
@AyushRaj-so3zh
@AyushRaj-so3zh 3 жыл бұрын
I had to stop the video immediately and come down here in the comments section 😊..what an intro...what a playlist..kudos Gaurav for these amazing videos
@lien3723
@lien3723 5 жыл бұрын
That little skit at the beginning is so funny lol. Thank you for making these system design videos, they're really helpful!
@AnuragSharma-pk9pr
@AnuragSharma-pk9pr 4 жыл бұрын
I am an Oracle database developer. I loved your content man. Learned something new today. Thanks. Greetings from your new subscriber.👌👌😊
@sharathkumar1978
@sharathkumar1978 4 жыл бұрын
The initial reaction of you saying sharding and your expression is awesome which makes someone really remember the video and the content by just imagining while asked in interview. Thanks gaurav :)
@1125ram
@1125ram 5 жыл бұрын
I can't able to resist myself without commenting after I see your enthusiasm to teach to unknown people around the world... Hats off to all the vloggers who are sharing knowledge freely through KZbin.
@kshitizsharma5469
@kshitizsharma5469 4 жыл бұрын
You are simply amazing man. I used to dread system design, but just because of you, slowly getting comfortable with it. I have actually allotted a particular share of my daily todo, just to watch your videos everyday.
@sj_wanders
@sj_wanders 6 жыл бұрын
You are too good brother. Your passion towards computer science can be clearly seen.
@gkcs
@gkcs 6 жыл бұрын
Thanks Sandeep!
@timothy6966
@timothy6966 Жыл бұрын
This channel is a gold mind for entrepreneurs in the pizza-business.
@davidpham6330
@davidpham6330 4 жыл бұрын
Never been so interested into database sharding just from that intro. You rock! Thank you for the videos
@gkcs
@gkcs 4 жыл бұрын
😁
@rajeshseptember09
@rajeshseptember09 Жыл бұрын
I literally lost a system design round by not saying "sharding" when asked for an optimization technique. Not that I didn't know of it, but I couldn't actively think during the interview. Yes, by just saying "sharding" and explaining sharding as a concept, one can make a big impression during the interview.
@rupal9267
@rupal9267 3 жыл бұрын
You make life simple! The intro had me hooked in till the very end! Bravo!!! 👏
@ecandil
@ecandil 3 жыл бұрын
I don't know how I didn't come across your videos before! What an easy way to learn, well done mate!!
@2devanshi
@2devanshi 6 жыл бұрын
good precise and short. exactly what is required in tutorial video with a bit of fun element in start.. awesome job
@summasumma
@summasumma 3 жыл бұрын
Nice video. Main problem i faced with Sharding is when you want to scale horizontally without impacting live system performance or creating downtime
@gkcs
@gkcs 3 жыл бұрын
Absolutely. That's almost as hard as a live DB migration.
@thenavigtor6867
@thenavigtor6867 4 жыл бұрын
Last line is ethusiastically official way of building interest in users...very well explained sir.
@chandrabhattasriram9475
@chandrabhattasriram9475 6 жыл бұрын
The way you slipped the "Like & Subscirbe" part into the video, just one word - S L I C K
@moulimallina7501
@moulimallina7501 4 жыл бұрын
You are an amazing person with amazing talent. Once you happened to come our clg NIT raipur, that was wonderful lectures. Please make videos frequently
@gkcs
@gkcs 4 жыл бұрын
Thanks 😁
@rounakkolya7350
@rounakkolya7350 3 жыл бұрын
OMG!!!Today's interview went exactly like this!!!!! except the sharding which led me to this video!!!!!
@kiran-nambiar
@kiran-nambiar 2 жыл бұрын
I got sharing vs partitioning question in an interview. This image & whiteboard notes flashed in my head instantly, I did crack the interview but got better retention offer. Thanks man ! PS - I should've used pizza as an example starting with 0 index, maybe next time...
@saurabhsharma7123
@saurabhsharma7123 6 жыл бұрын
That interview clip with doppelganger was awesome!
@gkcs
@gkcs 6 жыл бұрын
Hahahaha! He's almost as good as me 😋
@saurabhsharma7123
@saurabhsharma7123 6 жыл бұрын
He can easily send shivers down the spine of an interviewee, that's for sure 😅
@samart3010
@samart3010 Жыл бұрын
Initially I was not able to catch this concept when I watched this video 2-3 years back. But as of now I am with a base knowledge I able to understand. The problem with me was not really a base knowledge, but a lack of perspective towards these system, I was sticked to my perspective and was trying to build over it, so sometimes it is better to gain knowledge with clear slate.
@pradeeppradyumna601
@pradeeppradyumna601 3 жыл бұрын
I like the way you present all the topics. It's so captivating, and it shows how passionate you're at solving System Design problems. Thank you for sharing your knowledge.
@interviewsortout2165
@interviewsortout2165 3 жыл бұрын
First time I was watching some video tutorials and I did not sleep.
@SupGhostly
@SupGhostly 5 жыл бұрын
I love this play list and I'm learning so much but it the humor 😂 and your jokes that keep me learning great job man! Do you have a book recommendation on system design?
@rohan1456
@rohan1456 4 жыл бұрын
Your creativity and content just get's better.
@Hotmustardgas20
@Hotmustardgas20 4 жыл бұрын
I just discovered your channel and I'm a huge fan. I have been studying to get certified in AWS and your videos have been helping me understand larger concepts.
@gkcs
@gkcs 4 жыл бұрын
Thanks! Interesting name you have there, Hotmustardgas :P
@Hotmustardgas20
@Hotmustardgas20 4 жыл бұрын
@@gkcs Lol thanks I'm glad that you like it. Do you have any experience with the major cloud platforms that are out there? If so you should make a video on them.
@seanpowers7132
@seanpowers7132 3 жыл бұрын
This cat is smart. Thanks for dumbing it down for me. This is fantastic stuff Gaurav!
@MohammadbinIsmail
@MohammadbinIsmail 3 жыл бұрын
Went to Yogita"s videos ,came back here again , both are excellent masha allah
@ypucandeleteit
@ypucandeleteit 4 жыл бұрын
I recently found your channel and I just want to say I love your work. Thanks for creating fun informative content like this
@gkcs
@gkcs 4 жыл бұрын
Thank you 😁
@catman8623
@catman8623 2 жыл бұрын
Love the explanation. Digestible while still retaining the core information of this utility and its implications.
@Anurag7376
@Anurag7376 6 жыл бұрын
Your videos are really good. Editing and delivery are on point! Keep it up.
@gkcs
@gkcs 6 жыл бұрын
Thanks!
@0ManishSharma0
@0ManishSharma0 6 жыл бұрын
This inspired me to watch all of your videos. Subscribed
@christophersanders7483
@christophersanders7483 4 жыл бұрын
Thank you for this great video again. Better than many university professors.
@gkcs
@gkcs 4 жыл бұрын
Thank you!
@vaibhav1302
@vaibhav1302 4 жыл бұрын
Simple explanation and to the point. Keep up the good work bro. Cheers
@hidayatullahkhan6194
@hidayatullahkhan6194 6 жыл бұрын
Woah opening was super cool
@aakashjain3498
@aakashjain3498 6 жыл бұрын
I find your videos educating and entertaining as well.... Well done
@gkcs
@gkcs 6 жыл бұрын
Thank you Aakash!
@sprihadeshpande2204
@sprihadeshpande2204 4 жыл бұрын
You are one of the best. I can't wait to watch all your tutorials for system design! :) Keep going!
@mohammedzubairkhan3451
@mohammedzubairkhan3451 6 жыл бұрын
last line was cherry on the top.
@gkcs
@gkcs 6 жыл бұрын
😋
@sharthakghosh970
@sharthakghosh970 5 жыл бұрын
"indexing is cute" hahahaha
@saravanprathi6956
@saravanprathi6956 4 жыл бұрын
I had to pause the video and laugh for that :D
@Jonathan-qz9td
@Jonathan-qz9td 4 жыл бұрын
Cracked me up 😂😂😂
@nikhilkolhe7513
@nikhilkolhe7513 3 жыл бұрын
Me spending days to implement indexes 😭
@asawari520
@asawari520 2 жыл бұрын
that interview part was toooo good. especially when you say , we are looking for somethig more serious , we have huge hugeeeeee data. :-)
@shivamtiwari8914
@shivamtiwari8914 4 жыл бұрын
The topics covered were organized,relevant to me, and easy to follow . I loved it so much
@paridhijain7062
@paridhijain7062 2 жыл бұрын
Well Explained concept. 👍Understood it easy with those visuals in the starting of this video. It made the concepts more practical to understand. 🙌🙌
@deeraj3069
@deeraj3069 5 жыл бұрын
The ending was superb ...Enjoying the series very much
@ahmadalzoubi769
@ahmadalzoubi769 2 ай бұрын
I genuinely laughed at the intro! Well done keep it up
@gkcs
@gkcs 2 ай бұрын
Thank you :D
@abbhi1609
@abbhi1609 3 жыл бұрын
Intro is awesome man!! Love it
@Toy8610
@Toy8610 2 жыл бұрын
You are a living legend Gaurav! I learned more from your videos than any of my previous teachers
@manojmajumdar3815
@manojmajumdar3815 4 жыл бұрын
I am thinking about the 255 others who have disliked this video, now who on earth would dislike such a well explained video!!!
@ChocolateMilkCultLeader
@ChocolateMilkCultLeader 2 жыл бұрын
Clean and simple explanation. Great work
@darshathakkar
@darshathakkar 5 жыл бұрын
Thank you for sharing this Gaurav. It means a lot.
@adnanqz4974
@adnanqz4974 Жыл бұрын
You’ve explained this concept so well! At work, I’ve always heard my manager use this word when explaining his responsibilities with MongoDB but I’d never understand it. Now I do, thanks to you dude! PS: LOVED the ending 😂
@abhijeetsoni1978
@abhijeetsoni1978 3 жыл бұрын
Clear & crisp, to help understand the core concept of Sharding😊. And no, I wasn't able to click Like & Subscribe at a time, so had to do it sequentially. 😁
@monikakrishn
@monikakrishn 2 жыл бұрын
oh god! the reaction when said "Sharding" by interviewee is humourous man :D
@boopiechot
@boopiechot 5 жыл бұрын
That's exactly how my System Design interview went down. I got the job too. 😉
@gkcs
@gkcs 5 жыл бұрын
Congratulations!
@kumarshubhesh7382
@kumarshubhesh7382 5 жыл бұрын
What a confidence bro.nd Ur way of teaching Nd expressing is super bro.keep it up 😊😊😊
@gkcs
@gkcs 5 жыл бұрын
😁
@umarraza5533
@umarraza5533 4 жыл бұрын
O bhai kahan sy le aye ho itni age ma itna knowledge. I really wanna know your learning strategies. Great man! Thumbs up, form Pakistan
@harshdusane8687
@harshdusane8687 5 жыл бұрын
Excellent example to understand sharding.
@gkcs
@gkcs 5 жыл бұрын
Thanks!
@akankshagarg2204
@akankshagarg2204 4 жыл бұрын
God I so miss eating Pizza in pre-lockdown days!! I have just started watching your videos for an upcoming interview and I am finding them quite useful. Thank you so much :)
@sumitlahiri209
@sumitlahiri209 6 жыл бұрын
I watched this yesterday night. Sorry, couldn't comment then. The explanation is awesome. Liked this video.
@gkcs
@gkcs 6 жыл бұрын
A Blockchain group doesn't apologize 😉
@SahilKhan-xn5ne
@SahilKhan-xn5ne 4 жыл бұрын
Liked the video in the first minute, came over here to comment and then continue the video.
@krishnagubili1724
@krishnagubili1724 4 жыл бұрын
Very simply explained.
@DeepakSingh-fi9tx
@DeepakSingh-fi9tx 4 жыл бұрын
Hi Gaurav, Your videos are really very helpful. Apart from videos the references you have provided are mind blowing. Thank you so much.
@rahulshetty3738
@rahulshetty3738 6 жыл бұрын
This is really fun to watch!
@GruntXIII
@GruntXIII 4 жыл бұрын
"Let's say you have pizza, and you can't have the entire thing by yourself..." you've obviously never seen me eat pizza...
@rajiv8k
@rajiv8k 4 жыл бұрын
8:45 🤣 I hit that notification button. The only other channel I have that turned on for is Kurzgesagt.
@gkcs
@gkcs 4 жыл бұрын
Thank you!
@NikPnchl7
@NikPnchl7 4 жыл бұрын
Cassandra uses consistent hashing out of the box to reach the shard that contains the data you're looking for. It uses the partition key part of the primary key
@RahulDevanarayanan
@RahulDevanarayanan 3 жыл бұрын
“The key thing is we couldn’t finish the pizza by ourselves, we needed friends” As an American I feel uniquely equipped to refute this assertion 😂😤😅
@vibhors
@vibhors 4 жыл бұрын
Bhaai toone toh rock kar diya, thank you , love you
@deactivated6737
@deactivated6737 4 жыл бұрын
Amazing explanation on database sharding, thank you for sharing.
@rembautimes8808
@rembautimes8808 3 жыл бұрын
Actually its a cool cold start. Worth watching. Thanks for this easy intro, btw I am in the corporate sector but a secret programmer by nite.
@ChandanKumar-wb9vs
@ChandanKumar-wb9vs 6 жыл бұрын
Starting part of the video was cute and hilarious 😂. Keep up that thing.
@gkcs
@gkcs 6 жыл бұрын
Hahaha thanks!
@sriharshasamana
@sriharshasamana 3 жыл бұрын
You have made it look easy! Thanks bro. I want to hear more from you :)
@AnubhavShrivastava
@AnubhavShrivastava 5 жыл бұрын
Wao..role playing an interview is an awesome concept
@gkcs
@gkcs 5 жыл бұрын
😎
@AdityaDodda
@AdityaDodda 5 жыл бұрын
The first minute was Killer!
@sasidharnote6450
@sasidharnote6450 5 жыл бұрын
Very nicely explained. Thanks Gaurav.
@gkcs
@gkcs 5 жыл бұрын
Thanks Sasidhar!
@ranzort
@ranzort 5 жыл бұрын
Going through some of the videos. I can definitely see they are more entertaining as they go.
@ranzort
@ranzort 5 жыл бұрын
Hitting like and subscribe button was pretty easy for me therefore sharding is ..?
@noobninja4882
@noobninja4882 4 жыл бұрын
First thing, i will never call my friend to help me finish the pizza, i can eat the pizza alone🤣🤣🤣 thanks a lot for such an awesome content for free
@Surajkocool
@Surajkocool 4 жыл бұрын
Awesome explanation, expecting more form you. I am big fan your computer science, knowledge...
@ALOKKUMAR-vt8bs
@ALOKKUMAR-vt8bs 5 жыл бұрын
Sir,Your Work is too much Valuable and appreciated, Thank you so much for Doing this amazing work.
@BusinessTechBliss
@BusinessTechBliss Жыл бұрын
editing is too good
@SwapnadeepMukherjee
@SwapnadeepMukherjee 3 жыл бұрын
Interesting and helpful video. A smart way to end it. :)
@greene8595
@greene8595 3 жыл бұрын
This was actually helpful .
@rajpern
@rajpern 3 жыл бұрын
I am surprised at the number of dislikes you get. I think u are brilliant not only at knowledge but your humble style is also brillent. I can't think of any reasons for dislikes.... I mean if some doesn't like your style they simply move on but to hit the dislike button, there should be a convincing reason and I keep looking for it but haven't found it yet.
@gkcs
@gkcs 3 жыл бұрын
Thanks, I think the ratio is normal when compared to similar KZbin videos. Cheers 😁
@rajpern
@rajpern 3 жыл бұрын
@@gkcs I do watch alot on KZbin. Sometimes the influencer is bragging about alot, sometimes the contents are dragged just to extend the length of the video and sometimes the contents are not worth the time spent watching on it and some very good content providers when get famous they kind of just keep uploading the videos without putting much effort in it. And hence become ordinary. But your videos are full of knowledge and you yourself don't feel like being pompous any such thing so I am just baffled that's all... You are much much younger then me yet you are one of guys I look up to. One day I would like to someone like you. Wish you all the best 👍
@gkcs
@gkcs 3 жыл бұрын
@@rajpern thank you 😁
@sandipbhaumik
@sandipbhaumik 5 жыл бұрын
Awesome video Gauarv
@srishtijain9458
@srishtijain9458 2 жыл бұрын
lovely start of the video!! haha, mast!!
@XenonSchneizel
@XenonSchneizel 4 жыл бұрын
Love your vids. The way you deliver your information is really clear and concise. Amazing quality content!
@amitkumarkit2
@amitkumarkit2 3 жыл бұрын
thanx gaurav. great way of explanation.
@anuritarawat8422
@anuritarawat8422 3 жыл бұрын
Thank you soo much bhaiya your video helped me crack the interview in LinkedIn 😁🥳🥳 I don't know how to thank you , you are the best.
@gkcs
@gkcs 3 жыл бұрын
Thanks Anurita, and congratulations!
@anuritarawat8422
@anuritarawat8422 3 жыл бұрын
Ohhh wow you replied 😍🙈 btw I am Priyanshi 😅 my moms mail id
@gkcs
@gkcs 3 жыл бұрын
@@anuritarawat8422 Hahaha, thanks Priyanshi 😁
@AlfredDHull
@AlfredDHull 3 жыл бұрын
Great video! This was informative but also funny!
@KrishnaDasPC
@KrishnaDasPC 5 жыл бұрын
Good video here are my questions 1. How do you make a practical application without Joins? 2. Any code example of the concept?
@suniljokare9958
@suniljokare9958 2 жыл бұрын
unique way to teach , nice
@nikhilraov100
@nikhilraov100 4 жыл бұрын
Nice video . Keep going young man .
Caching in distributed systems: A friendly introduction
11:25
Gaurav Sen
Рет қаралды 7 М.
System Design: TINDER as a microservice architecture
36:41
Gaurav Sen
Рет қаралды 1,2 МЛН
2 MAGIC SECRETS @denismagicshow @roman_magic
00:32
MasomkaMagic
Рет қаралды 36 МЛН
Ice Cream or Surprise Trip Around the World?
00:31
Hungry FAM
Рет қаралды 16 МЛН
The Ultimate Sausage Prank! Watch Their Reactions 😂🌭 #Unexpected
00:17
La La Life Shorts
Рет қаралды 6 МЛН
When Cucumbers Meet PVC Pipe The Results Are Wild! 🤭
00:44
Crafty Buddy
Рет қаралды 37 МЛН
Database Sharding and Partitioning
23:53
Arpit Bhayani
Рет қаралды 96 М.
Introduction to NoSQL databases
26:18
Gaurav Sen
Рет қаралды 783 М.
What is an API and how do you design it? 🗒️✅
15:26
Gaurav Sen
Рет қаралды 742 М.
7 Must-know Strategies to Scale Your Database
8:42
ByteByteGo
Рет қаралды 127 М.
They Enabled Postgres Partitioning and their Backend fell apart
31:52
Hussein Nasser
Рет қаралды 43 М.
Database Indexing for Dumb Developers
15:59
Laith Academy
Рет қаралды 71 М.
What is Database Sharding?
26:56
Be A Better Dev
Рет қаралды 159 М.
Data Consistency and Tradeoffs in Distributed Systems
25:42
Gaurav Sen
Рет қаралды 191 М.
2 MAGIC SECRETS @denismagicshow @roman_magic
00:32
MasomkaMagic
Рет қаралды 36 МЛН