Consistent Hashing | Algorithms You Should Know #1

Weekly system design newsletter: bit.ly/3tfAlYD
Checkout our bestselling System Design Interview books:
Volume 1: amzn.to/3Ou7gkd
Volume 2: amzn.to/3HqGozy
Other things we made:
Digital version of System Design Interview books: bit.ly/3mlDSk9
Twitter: bit.ly/3HqEz5G
LinkedIn: bit.ly/39h22JK
Animation tools: Illustrator and After Effects
ABOUT US:
Covering topics and trends in large-scale system design, from the authors of the best-selling System Design Interview series.

[@ByteByteGo]

Subscribe and leave a comment, we read them all :)

[@praenubilus1980]

hope you can update more requently 😄

[@matthayden1979]

Yes! I already did. Difficult concepts explained in such an easy way.

[@AdityaDodda]

Amazing video! Can you make a video comparing this to Rendezvous Hashing please.

[@pajeetsingh]

Service mesh.

[@RajeevSoni007]

Hats down. This channel is really a blessing for the software engineers. This is the most simplified video on consistent hashing i have seen till now 👍

[@chrisfrancisbass]

You know when you try hard to understand something that just doesn't make sense to you, then you find an explanation so clear and simple that it actually makes you chuckle... For me, that's this video.

[@shoooozzzz]

Watching your channel should be a requirement for anyone in software engineering. Love the variety of topics

[@PrevalentAA]

This is one of the best teaching styles I've personally encountered on KZbin. Would be absolutely amazing if you could make a playlist for beginner software engineers starting with the core concepts. I would definitely pay for such a playlist/course. Thank you for all the time and effort you put into these videos, the visualisations definitely help to drive the point home like no others.

[@ByteByteGo]

What algorithms should we talk about next?

[@mdwakil7263]

Can you please cover architectural design patterns like Saga etc?

[@igboman2860]

cryptographic algorithms? Huffman, RSA etc

[@muddhitbaid2831]

Quad tree

[@helloworld7313]

Bloom Filter

[@eliyahubasa9401]

Bloom Filter or hash function under the hoods

[@amitchoraria5737]

I cant get my head around the fact that this channel is having less than a million subscribers. It deserves much more than that!!!

[@AditiAgarwal1695]

You explain each concept so well with just the right amount of detail. An added bonus is your way of speaking which is so calming and peaceful. Thanks for this amazing content you put out and wishing you the very best for the future!

[@glebbondarenko67]

I really liked that explanation. I didn't know that server are also using the same hash function. And this workaround with virtual nodes is awesome

[@freud6343]

I am not sure whether I should comment on the excellent explanation or mind-blowing presentation.

[@cristianb.3683]

Best explanation of consistem hashing I have found so far! Keep it up!

[@dsinkey]

I read the chapter on consistent hashing in System Design Interview, and didn’t feel like I understood it completely. This video helped so much. I’d love to see walk throughs of some of the systems on this channel.

[@ByteByteGo]

Thank you for the feedback. We agree videos augment text and they could be very useful. The chapter length videos take a lot of efforts to make. We will try to make one once a month, or maybe every two months.

[@komalkungwani4625]

I was never able to properly understand what consistent hashing is, but after watching this video it seems so clear now. Thank you so much for such videos. Please keep it up and upload more videos . We are here to support. 🎉

[@abhimanyusood3933]

Struggled with understanding consistent hashing for 40 minutes (from sources like educative course, stackoverflow, google etc.) Then found this video and understood the topic completely in 8 minutes. The explanation so concise and elegant that perhaps for the first time ever, I didn't even have to make notes! For revision, I can just rewatch 5 minutes of this video which will be faster than studying any notes that I can make.

[@lucasnoetzold]

dude your content is simply outstanding you synthesize very complex subjects in the amount of explanation that is just right for understanding without getting lost how come I've not seen you earlier?

[@jordanweir7187]

The amount of genius in the ideas here, the ring, someone did an insane job there at some point. also great explanation

[@ameliasundman2388]

I don't know where I would be without this video, thank you. So much effort was clearly put into this and it was so worth it. Very easy to understand.

[@skdevv]

Teaching style of Sahn Lam is the best I have come across in KZbin.. his way of teaching is evenly paced, pleasant & clear. Thank you.

[@cyboticIndustries]

Such clarity and brevity to this and all your videos. Many of these topics are of little use to me, but I watch and learn anyway due to your teaching style. Fantastic! Thankyou ! 🙏

[@derekyingzhi8009]

The best system design video ever. I wish you could make more videos like this available on youtube. Thank you!

[@ByteByteGo]

Thank you for the feedback. We’ll definitely make more videos like this. Let us know if you have specific topics you’d like to see.

[@ashuthe1]

The value your chanel is providing is immense.

[@theRenjie]

The illustration is the best I have seen for the virtual nodes. Thank you so much for the clear explanation.

[@ketandixit]

This is the best and most concise explanation !! Very impressive !! 👏

[@thisaintmyrealname1]

Thank you! I came across consistent hashing while reading the chapter on Metrics Monitoring from System Design Vol. 2. I had never heard the concept, so I searched it on youtube, and there you were as the 1st result! Great explanation. Now back to the book 👋

[@davidwilliams6089]

Found this via a Hacker News post. While I don't have any background in computer science, your explanation of the implementation approaches, issues, leading to virtual nodes in consistent hashing was clear and made sense to me. Thank you!

[@vickylance]

This video was extremely useful just when i was about to implement self routing varnish cluster with consistent hashing. Awesome video

[@sumanshekhar8110]

Man, you should bring out an entire series, It takes too much effort to come up with a video where you show too many concepts in a short amount of time. you are a saviour for legion like us.

[@AlphaTheSkunk]

I agree, and furthermore, I am willing to pay if it helps bring a series with this level of quality and information density. Especially your videos on systems design are a blessing.

[@dishantchauhan4775]

Content is so awesome and well explained, that every new video release sticks to the mind until you watch it. Please keep up the great content delivery.🙌

[@anastasianaumko923]

Thank you so much! Very elaborate explanation. Great work!😌

[@biju2848]

Great way of simplifying and explaining the concepts. Great work! Will recommend this channel to every software engineers

[@RahulPuls]

Awesome content like always. Again please share the tools you use for creating such cool animations. I'm a BIG fan!!

[@ByteByteGo]

Thanks. Illustrator and After Effects

[@sundevai]

I feel joy when I see this presenter. Def one reason is his videos are simple and have lots of animation other at human level he seems to be pretty descent person.

[@larryd9577]

I found your blog through Twitter and swallowed it whole. Your videos are even better. Keep up the great work!

[@yash7891]

What an amazing explanation. Please keep producing more content

[@Akahatoo]

Just found out your channel, it's incredible how you easily teach with graphical assistance. It helps a lot bringing down complex topics, awesome videos!

[@wiri2391]

Wow, super clean animations and the explanations are on point!

[@gui1221000]

That's the kind of quality content that I was looking for!

[@diyoptics1387]

I know explanation is good when I have questions and immediately the answer is narrated! Well done!

[@ozzyfromspace]

Wow, this presentation on consistent hashing was absolutely beautiful 🏆💯❤. Even though you didn't' write any code, the principle was so clear that most people could probably implement such an algorithm. Bravissimo!

[@rhtcguru]

Stumbled on your videos recently. I really like your style. Animations are great and the summaries are clear and concise. Keep up the great work!

[@kapilshekhar]

Unambiguous, clear and simple explanation .. this channel is full of wisdom !

[@deepakbhoria4172]

i read cassandra docs but couldn't understand virtual nodes, your video taught me so simply.

[@distrologic2925]

Thanks, this is what the world needs. Quick and digestable instructions on useful algorithms.

[@YashSharma0605]

I das reading the book and then came across this video. The visual really helps to drive the topic home. Nicely done.

[@DreckbobBratpfanne]

1) Great explanation 2) Its oddly satisfying when he says "the other keys are unaffected"

[@agatapysz1628]

I really like the way you explain different topics in your videos. The images and animations are very helpfull to visualise and understand the concepts. Waiting for new ones!:)

[@gigakoresh]

Amazing content, I am gonna recommend these books be bought by the company and put to premises where people can read them to understand these concepts. I have a suggestion for a video btw: can you explain CPU metrics and throttling on container systems? There is lots of misunderstanding especially with Kubernetes resources like "millicores" about what it actually means and how the usage is calculated and when throttling is performed on Kubernetes nodes and how. Also what are the implications of these metrics and quotas on CPUs with many cores and the difference between nodes running on hypervisor vs bare metal. It's a hole can of worms of course, but I think just starting with the quotas and throttling would already clear things up a lot.

[@sanjarcode]

Amazing video, especially the uneven sizes and virtual nodes part.

[@praveenX]

Awesome video 👏loved the animation and explanation. A side question: Animation on your channel is just awesome, which tool you are using?

[@_cocoalabs]

Fantastic, clear, and concise explanation!

[@SHUBHAMKUMAR-ij7cx]

Thanks @ByteByteGo team, for explaining an important concept like Consistent Hashing in such an easy manner.

[@joanagomes635]

This video was extremely helpful! I have an exam next week on distributed systems and consistent hashing will be on it. With this video, I feel like I will ace this part of the exam! Thank you!!

[@kaidollarsense]

Very concise video in explaining the concept. Keep it coming, you've earned yourself a new sub!

[@godsaab1]

One of the best videos on this topic

[@karlnikolasalcala8208]

The use of virtual nodes is so smart

[@DanielTorres-gd2uf]

These just started popping up in my feed. Very cool. Love the production quality on these videos keep em coming!

[@mailnrajesh]

Finally, I was able to understand what consistent hashing is!!!

[@priyankverma7434]

Very well explained and easy to understand. You made this concept so easy to understand that anyone can implement this. Thanks for the good video.

[@DavidsKanal]

Hey, awesome video! One suggestion: The text in the top left corner is a bit confusing to me. I know it's meant as the title of the video, but I often interpreted it as "the title of the current slide" which was confusing. I say either remove the text (because it's already stated in the video title) or make it act as a heading for the current subtopic.

[@NickolasCavagnaro]

If a node crashes, how does the system know which entries need to be transferred? And how do we retrieve the data that belonged to a crashed node to redistribute it to a new node?

[@igorkudryk2199]

Which tools are you using to create such a cool amimation?

[@abhisheksitar]

Brilliant way to teach such a concept! Thanks to you!

[@uppner147]

Love this channel! Perfectly explained, relevant and beatiful.

[@amithreat]

simplest explanation I found to date...gr8 work!!

[@donaldcheung3193]

This explanation is simple and clear! Amazing!

[@rohitjain9381]

Great video! Superb explanation 👌 Which software did you use for making this video?

[@gsenthilkumar8139]

01:01 Consistent hashing evenly distributes data in distributed systems. 02:02 Consistent hashing ensures even distribution of hashes and allows flexibility with server changes. 03:03 Consistent hashing ensures objects stay assigned to the same server despite changes 04:04 Consistent hashing uses a hash ring to map servers and objects efficiently. 05:05 Consistent hashing minimizes key redistribution when adding or removing servers. 06:06 Consistent hashing can lead to uneven distribution of objects on servers. 07:07 Using virtual nodes for load balancing in consistent hashing 08:04 Consistent hashing is used in real-world systems like NoSQL databases, high-end delivery networks, and load balancers. Crafted by Merlin AI.

[@1shadyholic]

this channel is a game changer. I love it!!!

[@Zmey5656]

Thank you, very simple and understandable explanation for me.

[@mooseyard]

This isn’t just used in servers. Many peer-to-peer networks, like Kademlia, use a similar “hash ring” to determine which peers should hold which keys/values. They usually put in quite a bit of redundancy, spreading data among multiple “nearby” peers, since peers come and go so frequently.

[@MrBidi1992]

Another amazing video ! Thank you so much 👍

[@zdravkochorlev8540]

The videos are perfect - short and well explained.

[@Galakyllz]

This was great and to the point. The only confusion that I had was about how the ring was constructed, but I figured that it must be the possible hash values. A quick example of "server 1's hash is 1234, so it goes here on the ring. The other server hashes place them at points in the ring in exactly the same way" would have been more clear. Thanks for the video!

[@JohnnyRotten-uf6xw]

Why th are all of your videos so good? Omg

[@ManojKrVerma-vw4dx]

The video I was waiting for .. will see on Saturday evening... Currently busy in thesis ppt preparation ... I like yours video without watching... ThankYou sir...

[@duyphan1452]

Visualization helps me understand it easily.

[@theyayaa]

I just read this topic in the first book volume. Great explanation, thank you!

[@vigneshu5119]

Great Videos !! Can you create a video on multitenant design

[@AmitKumar_kumanoit]

Awesome video. Love the way you explain concepts in so simple manner using such a nice animation. Which tool do you use to create animations?

[@ByteByteGo]

We have some talented editors for illustration and animation, with the help of tools like Adobe After Effects, Adobe Illustrator.

[@wilfredv1930]

I just recently subscribed to your newsletter, and this channel is also awesome.

[@karwanautiyaal1202]

Loving this series, Database Sharding and Database Indexing.

[@sureshiva4605]

All the video is good...the part where hash table should be considered as ring is little not well...just a few seconds part ...others channel got it easy....but virtual servers part is awesomely explained...better than other channels and neat...thank you

[@andriidanylov9453]

Cool, thanks. I have read Your first book and now thinking about buying volume 2.

[@go_better]

Thank you! Very interesting episode. And in general you explain things very clearly! Great series.

[@MrEW1985]

I learned something new. Thank you very much.

[@funnyclipz520]

this video is truly golden... keep em coming...

[@javisartdesign]

Very graphical and simple explanation! thanks

[@delta3979]

Such an interesting and important algorithm that I didn't even knew I needed.

[@Nicolas-jx3oo]

Impressively clear and concise, good job!

[@infinite639]

Please make a full playlist for system design And please examples of system design full Thank you

[@hiteshklalwani]

I love your explanation, it is very clear and core concepts covered in so less time and words :)

[@TheNilesh00]

Awesome content as always. I'm a paid blog subscriber as well as have the annual pass for the System design course. I'm amazed by all the graphics used in this video. Is there a particular tool you use that you can share for our own presentations?

[@gautam4934]

Brilliantly explained!

[@antonneuman6381]

Thanks a lot! I just realize that I didn't understand how does it work before this video

[@DevendraLattu]

You mentioned two NoSQL DBs use consistent hashing for data partioning. What about other SQL and NoSQL DBs? What are some tradeoffs with those?

[@kacy6014]

This was beautiful. I just wish you would've mentioned how the the virtual node positions get decided.

[@riskyferyansyahpribadi6984]

Woow, thank you for the explanation. Can you also please explain about rendezvous hashing ?

[@ekle]

> Rendezvous hashing is both much simpler and more general than consistent hashing, which becomes a special case (for k = 1 {\displaystyle k=1} k=1) of rendezvous hashing. en.wikipedia.org/wiki/Rendezvous_hashing

[@zahidulislam2068]

Your channel is a must watch

[@HikeWithUsMagarFamily]

good good, thanks for the content, precise, clear. liked the way you connect with real world products as well

[@programming6881]

Simple and excellent explanation. Thanks.