Consistent Hashing | Algorithms You Should Know #1

  Рет қаралды 325,881

ByteByteGo

ByteByteGo

Күн бұрын

Пікірлер: 266
@ByteByteGo
@ByteByteGo 2 жыл бұрын
Subscribe and leave a comment, we read them all :)
@praenubilus1980
@praenubilus1980 2 жыл бұрын
hope you can update more requently 😄
@matthayden1979
@matthayden1979 2 жыл бұрын
Yes! I already did. Difficult concepts explained in such an easy way.
@AdityaDodda
@AdityaDodda 2 жыл бұрын
Amazing video! Can you make a video comparing this to Rendezvous Hashing please.
@pajeetsingh
@pajeetsingh 2 жыл бұрын
Service mesh.
@chrisfrancisbass
@chrisfrancisbass Жыл бұрын
You know when you try hard to understand something that just doesn't make sense to you, then you find an explanation so clear and simple that it actually makes you chuckle... For me, that's this video.
@RajeevSoni007
@RajeevSoni007 2 жыл бұрын
Hats down. This channel is really a blessing for the software engineers. This is the most simplified video on consistent hashing i have seen till now 👍
@ByteByteGo
@ByteByteGo 2 жыл бұрын
What algorithms should we talk about next?
@mdwakil7263
@mdwakil7263 2 жыл бұрын
Can you please cover architectural design patterns like Saga etc?
@igboman2860
@igboman2860 2 жыл бұрын
cryptographic algorithms? Huffman, RSA etc
@muddhitbaid2831
@muddhitbaid2831 2 жыл бұрын
Quad tree
@helloworld7313
@helloworld7313 2 жыл бұрын
Bloom Filter
@eliyahubasa9401
@eliyahubasa9401 2 жыл бұрын
Bloom Filter or hash function under the hoods
@shoooozzzz
@shoooozzzz 2 жыл бұрын
Watching your channel should be a requirement for anyone in software engineering. Love the variety of topics
@amitchoraria5737
@amitchoraria5737 8 ай бұрын
I cant get my head around the fact that this channel is having less than a million subscribers. It deserves much more than that!!!
@PrevalentAA
@PrevalentAA 2 жыл бұрын
This is one of the best teaching styles I've personally encountered on KZbin. Would be absolutely amazing if you could make a playlist for beginner software engineers starting with the core concepts. I would definitely pay for such a playlist/course. Thank you for all the time and effort you put into these videos, the visualisations definitely help to drive the point home like no others.
@abhimanyusood3933
@abhimanyusood3933 4 ай бұрын
Struggled with understanding consistent hashing for 40 minutes (from sources like educative course, stackoverflow, google etc.) Then found this video and understood the topic completely in 8 minutes. The explanation so concise and elegant that perhaps for the first time ever, I didn't even have to make notes! For revision, I can just rewatch 5 minutes of this video which will be faster than studying any notes that I can make.
@skdevv
@skdevv Жыл бұрын
Teaching style of Sahn Lam is the best I have come across in KZbin.. his way of teaching is evenly paced, pleasant & clear. Thank you.
@dsinkey
@dsinkey 2 жыл бұрын
I read the chapter on consistent hashing in System Design Interview, and didn’t feel like I understood it completely. This video helped so much. I’d love to see walk throughs of some of the systems on this channel.
@ByteByteGo
@ByteByteGo 2 жыл бұрын
Thank you for the feedback. We agree videos augment text and they could be very useful. The chapter length videos take a lot of efforts to make. We will try to make one once a month, or maybe every two months.
@AditiAgarwal1695
@AditiAgarwal1695 2 жыл бұрын
You explain each concept so well with just the right amount of detail. An added bonus is your way of speaking which is so calming and peaceful. Thanks for this amazing content you put out and wishing you the very best for the future!
@sumanshekhar8110
@sumanshekhar8110 2 жыл бұрын
Man, you should bring out an entire series, It takes too much effort to come up with a video where you show too many concepts in a short amount of time. you are a saviour for legion like us.
@AlphaTheSkunk
@AlphaTheSkunk 2 жыл бұрын
I agree, and furthermore, I am willing to pay if it helps bring a series with this level of quality and information density. Especially your videos on systems design are a blessing.
@cristianb.3683
@cristianb.3683 Жыл бұрын
Best explanation of consistem hashing I have found so far! Keep it up!
@jordanweir7187
@jordanweir7187 2 жыл бұрын
The amount of genius in the ideas here, the ring, someone did an insane job there at some point. also great explanation
@sundevai
@sundevai 9 ай бұрын
I feel joy when I see this presenter. Def one reason is his videos are simple and have lots of animation other at human level he seems to be pretty descent person.
@ashuthe1
@ashuthe1 6 ай бұрын
The value your chanel is providing is immense.
@glebbondarenko67
@glebbondarenko67 2 жыл бұрын
I really liked that explanation. I didn't know that server are also using the same hash function. And this workaround with virtual nodes is awesome
@derekyingzhi8009
@derekyingzhi8009 2 жыл бұрын
The best system design video ever. I wish you could make more videos like this available on youtube. Thank you!
@ByteByteGo
@ByteByteGo 2 жыл бұрын
Thank you for the feedback. We’ll definitely make more videos like this. Let us know if you have specific topics you’d like to see.
@davidwilliams6089
@davidwilliams6089 2 жыл бұрын
Found this via a Hacker News post. While I don't have any background in computer science, your explanation of the implementation approaches, issues, leading to virtual nodes in consistent hashing was clear and made sense to me. Thank you!
@komalkungwani4625
@komalkungwani4625 2 жыл бұрын
I was never able to properly understand what consistent hashing is, but after watching this video it seems so clear now. Thank you so much for such videos. Please keep it up and upload more videos . We are here to support. 🎉
@ameliasundman2388
@ameliasundman2388 Жыл бұрын
I don't know where I would be without this video, thank you. So much effort was clearly put into this and it was so worth it. Very easy to understand.
@theRenjie
@theRenjie 2 жыл бұрын
The illustration is the best I have seen for the virtual nodes. Thank you so much for the clear explanation.
@larryd9577
@larryd9577 2 жыл бұрын
I found your blog through Twitter and swallowed it whole. Your videos are even better. Keep up the great work!
@freud6343
@freud6343 2 жыл бұрын
I am not sure whether I should comment on the excellent explanation or mind-blowing presentation.
@ketandixit
@ketandixit 2 жыл бұрын
This is the best and most concise explanation !! Very impressive !! 👏
@vickylance
@vickylance 5 ай бұрын
This video was extremely useful just when i was about to implement self routing varnish cluster with consistent hashing. Awesome video
@lucasnoetzold
@lucasnoetzold 2 жыл бұрын
dude your content is simply outstanding you synthesize very complex subjects in the amount of explanation that is just right for understanding without getting lost how come I've not seen you earlier?
@cyboticIndustries
@cyboticIndustries 2 жыл бұрын
Such clarity and brevity to this and all your videos. Many of these topics are of little use to me, but I watch and learn anyway due to your teaching style. Fantastic! Thankyou ! 🙏
@thisaintmyrealname1
@thisaintmyrealname1 2 жыл бұрын
Thank you! I came across consistent hashing while reading the chapter on Metrics Monitoring from System Design Vol. 2. I had never heard the concept, so I searched it on youtube, and there you were as the 1st result! Great explanation. Now back to the book 👋
@mailnrajesh
@mailnrajesh 2 жыл бұрын
Finally, I was able to understand what consistent hashing is!!!
@gsenthilkumar8139
@gsenthilkumar8139 9 ай бұрын
01:01 Consistent hashing evenly distributes data in distributed systems. 02:02 Consistent hashing ensures even distribution of hashes and allows flexibility with server changes. 03:03 Consistent hashing ensures objects stay assigned to the same server despite changes 04:04 Consistent hashing uses a hash ring to map servers and objects efficiently. 05:05 Consistent hashing minimizes key redistribution when adding or removing servers. 06:06 Consistent hashing can lead to uneven distribution of objects on servers. 07:07 Using virtual nodes for load balancing in consistent hashing 08:04 Consistent hashing is used in real-world systems like NoSQL databases, high-end delivery networks, and load balancers. Crafted by Merlin AI.
@YashSharma0605
@YashSharma0605 Жыл бұрын
I das reading the book and then came across this video. The visual really helps to drive the topic home. Nicely done.
@diyoptics1387
@diyoptics1387 Жыл бұрын
I know explanation is good when I have questions and immediately the answer is narrated! Well done!
@yash7891
@yash7891 2 жыл бұрын
What an amazing explanation. Please keep producing more content
@DreckbobBratpfanne
@DreckbobBratpfanne 11 ай бұрын
1) Great explanation 2) Its oddly satisfying when he says "the other keys are unaffected"
@deepakbhoria4172
@deepakbhoria4172 Жыл бұрын
i read cassandra docs but couldn't understand virtual nodes, your video taught me so simply.
@wiri2391
@wiri2391 2 жыл бұрын
Wow, super clean animations and the explanations are on point!
@rhtcguru
@rhtcguru 2 жыл бұрын
Stumbled on your videos recently. I really like your style. Animations are great and the summaries are clear and concise. Keep up the great work!
@kapilshekhar
@kapilshekhar 2 жыл бұрын
Unambiguous, clear and simple explanation .. this channel is full of wisdom !
@DevendraLattu
@DevendraLattu 6 ай бұрын
You mentioned two NoSQL DBs use consistent hashing for data partioning. What about other SQL and NoSQL DBs? What are some tradeoffs with those?
@distrologic2925
@distrologic2925 2 жыл бұрын
Thanks, this is what the world needs. Quick and digestable instructions on useful algorithms.
@DanielTorres-gd2uf
@DanielTorres-gd2uf 2 жыл бұрын
These just started popping up in my feed. Very cool. Love the production quality on these videos keep em coming!
@biju2848
@biju2848 2 жыл бұрын
Great way of simplifying and explaining the concepts. Great work! Will recommend this channel to every software engineers
@_cocoalabs
@_cocoalabs 2 жыл бұрын
Fantastic, clear, and concise explanation!
@anastasianaumko923
@anastasianaumko923 Жыл бұрын
Thank you so much! Very elaborate explanation. Great work!😌
@dishantchauhan4775
@dishantchauhan4775 2 жыл бұрын
Content is so awesome and well explained, that every new video release sticks to the mind until you watch it. Please keep up the great content delivery.🙌
@gui1221000
@gui1221000 2 жыл бұрын
That's the kind of quality content that I was looking for!
@godsaab1
@godsaab1 4 ай бұрын
One of the best videos on this topic
@joanagomes635
@joanagomes635 2 жыл бұрын
This video was extremely helpful! I have an exam next week on distributed systems and consistent hashing will be on it. With this video, I feel like I will ace this part of the exam! Thank you!!
@1shadyholic
@1shadyholic 11 ай бұрын
this channel is a game changer. I love it!!!
@amithreat
@amithreat 2 жыл бұрын
simplest explanation I found to date...gr8 work!!
@Akahatoo
@Akahatoo 2 жыл бұрын
Just found out your channel, it's incredible how you easily teach with graphical assistance. It helps a lot bringing down complex topics, awesome videos!
@priyankverma7434
@priyankverma7434 10 ай бұрын
Very well explained and easy to understand. You made this concept so easy to understand that anyone can implement this. Thanks for the good video.
@SHUBHAMKUMAR-ij7cx
@SHUBHAMKUMAR-ij7cx Жыл бұрын
Thanks @ByteByteGo team, for explaining an important concept like Consistent Hashing in such an easy manner.
@uppner147
@uppner147 Жыл бұрын
Love this channel! Perfectly explained, relevant and beatiful.
@agatapysz1628
@agatapysz1628 Жыл бұрын
I really like the way you explain different topics in your videos. The images and animations are very helpfull to visualise and understand the concepts. Waiting for new ones!:)
@kaidollarsense
@kaidollarsense 2 жыл бұрын
Very concise video in explaining the concept. Keep it coming, you've earned yourself a new sub!
@RahulPuls
@RahulPuls 2 жыл бұрын
Awesome content like always. Again please share the tools you use for creating such cool animations. I'm a BIG fan!!
@ByteByteGo
@ByteByteGo 2 жыл бұрын
Thanks. Illustrator and After Effects
@zahidulislam2068
@zahidulislam2068 2 жыл бұрын
Your channel is a must watch
@funnyclipz520
@funnyclipz520 2 жыл бұрын
this video is truly golden... keep em coming...
@sanjarcode
@sanjarcode 7 ай бұрын
Amazing video, especially the uneven sizes and virtual nodes part.
@donaldcheung3193
@donaldcheung3193 2 жыл бұрын
This explanation is simple and clear! Amazing!
@wilfredv1930
@wilfredv1930 2 жыл бұрын
I just recently subscribed to your newsletter, and this channel is also awesome.
@abhisheksitar
@abhisheksitar 2 жыл бұрын
Brilliant way to teach such a concept! Thanks to you!
@theyayaa
@theyayaa Жыл бұрын
I just read this topic in the first book volume. Great explanation, thank you!
@zdravkochorlev8540
@zdravkochorlev8540 2 жыл бұрын
The videos are perfect - short and well explained.
@Galakyllz
@Galakyllz 2 жыл бұрын
This was great and to the point. The only confusion that I had was about how the ring was constructed, but I figured that it must be the possible hash values. A quick example of "server 1's hash is 1234, so it goes here on the ring. The other server hashes place them at points in the ring in exactly the same way" would have been more clear. Thanks for the video!
@mahdidi96
@mahdidi96 Ай бұрын
Best explanation out there and new fan, thanks!
@andriidanylov9453
@andriidanylov9453 2 жыл бұрын
Cool, thanks. I have read Your first book and now thinking about buying volume 2.
@igorkudryk2199
@igorkudryk2199 2 жыл бұрын
Which tools are you using to create such a cool amimation?
@ManojKrVerma-vw4dx
@ManojKrVerma-vw4dx 2 жыл бұрын
The video I was waiting for .. will see on Saturday evening... Currently busy in thesis ppt preparation ... I like yours video without watching... ThankYou sir...
@gigakoresh
@gigakoresh 2 жыл бұрын
Amazing content, I am gonna recommend these books be bought by the company and put to premises where people can read them to understand these concepts. I have a suggestion for a video btw: can you explain CPU metrics and throttling on container systems? There is lots of misunderstanding especially with Kubernetes resources like "millicores" about what it actually means and how the usage is calculated and when throttling is performed on Kubernetes nodes and how. Also what are the implications of these metrics and quotas on CPUs with many cores and the difference between nodes running on hypervisor vs bare metal. It's a hole can of worms of course, but I think just starting with the quotas and throttling would already clear things up a lot.
@karwanautiyaal1202
@karwanautiyaal1202 2 жыл бұрын
Loving this series, Database Sharding and Database Indexing.
@JohnnyRotten-uf6xw
@JohnnyRotten-uf6xw 8 ай бұрын
Why th are all of your videos so good? Omg
@karlnikolasalcala8208
@karlnikolasalcala8208 4 ай бұрын
The use of virtual nodes is so smart
@sureshiva4605
@sureshiva4605 Жыл бұрын
All the video is good...the part where hash table should be considered as ring is little not well...just a few seconds part ...others channel got it easy....but virtual servers part is awesomely explained...better than other channels and neat...thank you
@ozzyfromspace
@ozzyfromspace 2 жыл бұрын
Wow, this presentation on consistent hashing was absolutely beautiful 🏆💯❤. Even though you didn't' write any code, the principle was so clear that most people could probably implement such an algorithm. Bravissimo!
@liftingisfun2350
@liftingisfun2350 2 жыл бұрын
Incredible visuals and fantastic information
@MrBidi1992
@MrBidi1992 2 жыл бұрын
Another amazing video ! Thank you so much 👍
@programming6881
@programming6881 Жыл бұрын
Simple and excellent explanation. Thanks.
@Zmey5656
@Zmey5656 6 ай бұрын
Thank you, very simple and understandable explanation for me.
@ReflectionOcean
@ReflectionOcean Жыл бұрын
The core problem that consistent hashing trying to solve in the presence of frequent node addition and removal are: 1. even data distribution 2. minimum data movements 2 insights: 1. Distribute data to nodes on the hash ring rather than use modular function to minimize data movements because of changes of cluster memberships 2. Use virtual nodes to improve data distribution
@NikolaJanevski
@NikolaJanevski 2 жыл бұрын
Love the video and the animation. Keep them coming.
@praveenX
@praveenX 2 жыл бұрын
Awesome video 👏loved the animation and explanation. A side question: Animation on your channel is just awesome, which tool you are using?
@matthewfala
@matthewfala 2 жыл бұрын
Beautiful graphics! Love the explanation
@AmitKumar_kumanoit
@AmitKumar_kumanoit 2 жыл бұрын
Awesome video. Love the way you explain concepts in so simple manner using such a nice animation. Which tool do you use to create animations?
@ByteByteGo
@ByteByteGo 2 жыл бұрын
We have some talented editors for illustration and animation, with the help of tools like Adobe After Effects, Adobe Illustrator.
@mooseyard
@mooseyard 2 жыл бұрын
This isn’t just used in servers. Many peer-to-peer networks, like Kademlia, use a similar “hash ring” to determine which peers should hold which keys/values. They usually put in quite a bit of redundancy, spreading data among multiple “nearby” peers, since peers come and go so frequently.
@javisartdesign
@javisartdesign 2 жыл бұрын
Very graphical and simple explanation! thanks
@clapathy
@clapathy 2 жыл бұрын
Super nice presentation, thank you!
@gautam4934
@gautam4934 Жыл бұрын
Brilliantly explained!
@vigneshu5119
@vigneshu5119 2 жыл бұрын
Great Videos !! Can you create a video on multitenant design
@HikeWithUsMagarFamily
@HikeWithUsMagarFamily 2 жыл бұрын
good good, thanks for the content, precise, clear. liked the way you connect with real world products as well
@MrEW1985
@MrEW1985 Жыл бұрын
I learned something new. Thank you very much.
@Nicolas-jx3oo
@Nicolas-jx3oo 2 жыл бұрын
Impressively clear and concise, good job!
@hiteshklalwani
@hiteshklalwani Жыл бұрын
I love your explanation, it is very clear and core concepts covered in so less time and words :)
@TheNilesh00
@TheNilesh00 10 ай бұрын
Awesome content as always. I'm a paid blog subscriber as well as have the annual pass for the System design course. I'm amazed by all the graphics used in this video. Is there a particular tool you use that you can share for our own presentations?
@delta3979
@delta3979 2 жыл бұрын
Such an interesting and important algorithm that I didn't even knew I needed.
@hichamboudounit4813
@hichamboudounit4813 2 жыл бұрын
thank you for this amazing explanation
@VinodKumar-wh1mq
@VinodKumar-wh1mq 2 жыл бұрын
Animations are awesome :) please keep the good contents coming!
@duyphan1452
@duyphan1452 2 жыл бұрын
Visualization helps me understand it easily.
Consistent Hashing | The Backend Engineering Show
23:54
Hussein Nasser
Рет қаралды 42 М.
It’s all not real
00:15
V.A. show / Магика
Рет қаралды 20 МЛН
20 System Design Concepts Explained in 10 Minutes
11:41
NeetCode
Рет қаралды 1,1 МЛН
Why is Kubernetes Popular | What is Kubernetes?
9:52
ByteByteGo
Рет қаралды 85 М.
Proxy vs Reverse Proxy (Real-world Examples)
5:17
ByteByteGo
Рет қаралды 602 М.
What is CONSISTENT HASHING and Where is it used?
10:50
Gaurav Sen
Рет қаралды 821 М.
Back-Of-The-Envelope Estimation / Capacity Planning
8:32
ByteByteGo
Рет қаралды 99 М.
3 Types of Algorithms Every Programmer Needs to Know
13:12
ForrestKnight
Рет қаралды 511 М.
HTTP 1 Vs HTTP 2 Vs HTTP 3!
7:37
ByteByteGo
Рет қаралды 346 М.
System Design Interview: A Step-By-Step Guide
9:54
ByteByteGo
Рет қаралды 756 М.