18. Load Balancer & Different Algorithms - System Design | Static & Dynamic Load Balancing Algorithm

➡️ Notes link: Shared in the Member Community Post (If you are Member of this channel, then pls check the Member community post, i have shared the Notes link there)
➡️ Join this channel to get access to member only perks:
/ @conceptandcoding
In this Video, i have covered about:
- Load Balancer and its types (Application and Network Load Balancer)
- Load balancing algorithms like
Round Robin, Weighted Round Robin, IP Hash , Least Connection, Weighted Least Connection and Least Response time
Chapters:
00:00 - Introduction
01:29 - L4 and L7 Load Balancer (Types of LB)
04:11 - Round Robin Algorithm
06:37 - Weighted Round Robin Algorithm
11:26 - IP Hash Algorithm
15:26 - Least Connection Algorithm
18:13 - Weighted Least Connection Algorithm
19:37 - Least Response Time Algorithm
Complete LLD Playlist:
• Low Level Design from ...
Complete HLD Playlist:
• High Level Design from...
JAVA Playlist:
• JAVA from Basics to Ad...
To. connect 1:1 with me: topmate.io/concept_coding
To contribute for the channel UPI id: shrayansh8@oksbi
Join this channel to get access to perks:
/ @conceptandcoding
#systemdesign #loadbalancer #amazon #softwareengineer #interviewquestions

[@kapiltewari4369]

Nicely Explained

[@ConceptandCoding]

Thanks

[@xskrish]

NICE I LOVE THIS

[@ConceptandCoding]

Thank you

[@nithishr2266]

Thanks sir, Your Playlist is really awesome, Helped a lot in understanding the System Design, I loved your Explaination ❤️

[@ConceptandCoding]

Thanks buddy, pls do share it with your connections

[@nithishr2266]

@@ConceptandCoding sure thing :)

[@anantakumarsahu2658]

Yes please upload more videos.

[@ConceptandCoding]

Sure

[@karanbangia14]

can you pls explain how caching takes place at L7 load balancer and how to invalidate cache, it would be good if you can provide and example

[@FazilKhan-vr6sw]

Hi, what about consistent Hashing to distribute the traffic. .?

[@Umashankar14412]

Appreciate your hard work, 🙏🏼. Ak request hai ager possible ho system design pe thoda jaldi videos dale.

[@ConceptandCoding]

I will try my best buddy

[@Umashankar14412]

@@ConceptandCoding Thanks ❤️, one of best system design content.

[@manugupta0110]

Disadvantage: "TCP connections can be ACTIVE but possible have no traffic" => This might not be true. Sure connections b/w clients and servers are kept alive, however in case of LB, and this specific Algorithm, the LB might not be having warmed up connections which are not serving any traffic IMO. Also, we can clarify that in case of L4 Load Balancers, there are two TCP connection for one request 1. Client LB, 2. LB Server. If we don't clarify this information, people might get confused in this. I really liked you LLD videos and they were super awesome, however for some reason felt in High Level Design, there are some scope of improvement. I hope you take this positively. Doing a good work. Keep it up :D

[@ConceptandCoding]

Points noted. Yes i am taking this positively and really thanks a lot for the feedback Manu.

[@AbhishekJha-sx2yv]

but if you terminate the connection and not having warmed up connection for the next time if we are getting the request from same client it will take some time to establish a new connection. either ways you will be dealing with some latency.

[@AbhishekJha-sx2yv]

having a pool of pre-established connection could be a better strategy to reduce the latency at last it all depends on the type of system you're working with.

[@sahibog]

Thank Sir

[@ConceptandCoding]

Thanks 👍

[@raghav_1997]

Hi Shreyansh, waiting for the rest of HDL playlist.

[@vamsiprasadkumili1237]

Can a load balancer be a single point of failure? If not, then what measures are taken for it not to be a single point of failure.

[@bobbysadhwani991]

Very well explained Sir 🚀.... Can you please attach the ppt in the description, it will be helpful. Thank you.

[@ConceptandCoding]

Sure will do

[@ramprasadthakur1682]

Hi Shrayansh do TTFB and latency are same things?

[@VishalSingh-ly9vh]

Hello Shreyansh, can you please explain how does consistent hashing fit into this picture?

[@ashishgulati9539]

+1

[@vishalghanghav748]

Hello Shreyansh ,Are you planning to cover Docker /Kubernetes /Cloud in near future or will it take time.

[@ConceptandCoding]

I have this in my bucket list, but some imp other topics need to cover first

[@vishalghanghav748]

Hello Shreyansh ,Maine tumhari playlist start se shuru kii thi ,aur bhot sahi jaa raha tha .Par suddenly tumne completely English pe switch kar liya .Any specific reason ,Maine specifically isliye ye channel choose kiya tha kyunki tum akele the jo System Design Hindi main sikhaare the .Aur sahi se dekhe to tabse channel ki viewership bhi decline hui hain . Just a feedback

[@nikrajput3512]

Are inko South vaale bando se msg aare the ki switch to English .Accha khasa channel mila tha Hindi main .English main dekhne ka mann nai karta na...

[@ConceptandCoding]

thanks Vishal for your honest feedback. I really respect that🙏 To be honest, i got a 100s of request from engineers who do not understand Hindi and wanted me to switch. And its was a very tough decision for me whether to switch or not and i discussed the same with one of my friend and couple of points which help me take this decision is: - More than Hindi or English what important is way of teaching and explaining. Whatever language i choose my way of explaining should not change. - Every software engineer knows basic English (as you know we have to work with different clients and team members in different city and country, so English is the common language in each IT company as far as i know) - My confidence and my English also improving by teaching in it. With all these points taken into consideration, i decided to switch to english buddy. And regarding viewership decline, what can i say, its also a part of the journey and its not an easy journey, i am working toward it and It will increase for sure, i am being optimistic :)

[@vishalghanghav748]

@@ConceptandCoding Are it's Okay yaar .2months ago ,main cricbuzz ke liye interview diya ,both DSA rounds clear kiye and System design round tha (Mujhe laga LLD puchega usne HLD ke questions puche),Jo main nai bta paya .Usne puche hue saare questions ,tum cover kiye ho .Jitna basics tha vo sab tum hindi main cover kiye ho ,to baaki case studies chaltay ab English main .Par dekhna agar subtitles se manage ho paaye English Audience.Tumhaare liye bhi bada mushkil decision raha hoga😊. Mere POV main Hindi main connect jyada hotay and long hours aap beth sakte ho video dekhte hue . In the end ,Thank you so much itne acche videos banane ke liye .Meko almost 250% hike milra hain jo tumhaare(Design) aur Aditya verma(DSA) ke bina nai ho paata

[@ConceptandCoding]

@@vishalghanghav748 congratulations 🎉👏 buddy really happy for you. Way to go 🚀

[@zmxncbv95]

I didn't understood this about Least Connection - "Connection is active but no traffic", what does this mean?

[@girishanker3796]

I am not sure but Inthunk what he meant maybe is like http long polling, where the connection is kept alive till the client receives any response from the server or may be an SSE which uses Http protocol which rely on TCP.

[@sakshamsrivastava6280]

What it means here when we say active connection Shreyansh? Could you elaborate a little.

[@ConceptandCoding]

Between Client and server, first thing happens is connecting making, you might have heard of 3 ways handshaking (Syn , Syn + Ack, Ack). That's will make one active connection. Hope it is clear now, let me know pls.

[@sakshamsrivastava6280]

@@ConceptandCodingdoes that mean, load balancer maintain some kind of table to track this active connection? If yes, initially when a request comes to loadbalancer, if interacts with who all servers, and somehow keeps track of active connections and then when a fresh request comes it sees in the table about the number of active connection and decides on where it wants to route the request to?

[@ConceptandCoding]

Depends Saksham. Generally Load balancer regularly send test request to servers and collect some data and take decision based on that data. Also they have capability to maintain cache, in which they can save response or other information about the server which can help them to take decisions.

[@girishanker3796]

​@@ConceptandCodingDo Load Balancers also have the two way heartbeat mechanism?

[@ghayoorhussain8930]

Sir Should I Start with LLD or HLD Kindly help

[@ConceptandCoding]

For less than 2yr of exp, LLD is imp, for more than 2Yr Both can be done in parallel

[@sairohithareti823]

First View :)

[@ConceptandCoding]

Thanks a lot buddy