Load balancing in Layer 4 vs Layer 7 with HAPROXY Examples

  Рет қаралды 162,345

Hussein Nasser

Hussein Nasser

Күн бұрын

Пікірлер: 258
@hnasr
@hnasr 2 жыл бұрын
Learn the fundamentals of the backend, scaling and load balancing with my Introduction to NGINX udemy course nginx.husseinnasser.com
@bahaaeldeen4699
@bahaaeldeen4699 4 жыл бұрын
this playlist just keep getting better and better honestly it may be the greatest channel in the tech field
@hnasr
@hnasr 4 жыл бұрын
Glad you enjoy it! Thanks Bahaa
@anamulkabir1014
@anamulkabir1014 3 жыл бұрын
"More we repeat more we learn!" that's the way to teach - thank you so much Nasser, you are the best!
@siddharthshukla9832
@siddharthshukla9832 3 жыл бұрын
dude, i simply love the way you articulate. It is like listening to a story. I tried to look up some other videos on this topic. But frankly speaking, the difference between Layer 4 and 7 was never explained so easily. Hats off to you Hussein
@amitbist2k2
@amitbist2k2 4 жыл бұрын
Great, I am a unix sysadmin and you helped me understand some old stuff making it easier. Those good old days!
@robertluong3024
@robertluong3024 2 жыл бұрын
I randomly came here from your NAT video just for fun. I didn't expect to leave with a clear understanding of this. You're awesome.
@aniekutmfonekere740
@aniekutmfonekere740 3 жыл бұрын
the best channel ever with real-world application of tech
@aarthydesikan9939
@aarthydesikan9939 4 жыл бұрын
Very well explained, thanks so much! Your way of explaining with an intent to capture audience attention but the same time not compromising the technical details is very nice.
@richardmaduka4747
@richardmaduka4747 4 жыл бұрын
Your content is gold.
@sebschrader
@sebschrader 3 жыл бұрын
Most load balancers (and especially HAProxy and nginx!) still use two different TCP connections in L4 mode with potentially different timeouts, window sizes etc. There are load balancers that simply forward packets (e.g. Linux ipvs) and only have a single end-to-end TCP connection between the client and the backend, but these are more uncommon.
@JuanManuelMunozBetancur
@JuanManuelMunozBetancur 11 ай бұрын
Hi, could you please share any documentation to verify this information
@arunsatyarth9097
@arunsatyarth9097 4 жыл бұрын
29:50 "I dont want the load balancer to look at my data." Sir, the fact that you dont have a million subscribers is a crime on humanity.
@esra_erimez
@esra_erimez 3 жыл бұрын
Agreed
@chiefolk
@chiefolk 3 жыл бұрын
I think the data here is URL u just entered in the browser which gives IP address so doesn't make sense if you don't want to see them this URL for privacy reasons
@tikz.-3738
@tikz.-3738 3 жыл бұрын
Was just looking for websockets ended up watching 7hrs in a row ur awesome and ur just the teacher I wanted no 5min videos tho it was quite hard to click on those 40min videos once I did it didn't felt like I was watching something for 40mins well it's just interest and great content quality but dude heads off to u thanks for all this awesome knowledge at once place
@hnasr
@hnasr 3 жыл бұрын
❤️❤️ that is awesome 👏 thank you for your kind words and glad you enjoyed the content 🙏🙏
@tikz.-3738
@tikz.-3738 3 жыл бұрын
@@hnasr still counting, after learning from all the linked and suggested videos I'm finally seeing the first video of websockets for which I initially came 😂 came for websockets became network engineer and more aware back-end engineer ur awesome dude I have no words for the content quality and availability
@SunilRana-tm8lm
@SunilRana-tm8lm 3 жыл бұрын
Hi Hussein! I recently came across your channel and now I wish I had found this earlier. Thanks for the amazing informatic videos.
@iammjpops
@iammjpops 3 жыл бұрын
I dont know if I would have understood L4 and L7 R-Proxy better... THANKS A LOT! Bow to you!
@davidlira8853
@davidlira8853 3 жыл бұрын
this helped me have a better understanding of the difference between a Layer 4 Load Balancer and a Layer 7 Load Balancer. Now I understand that an ingress is a Layer 7 Load Balancer
@ujemvi
@ujemvi 4 жыл бұрын
He killed me with the "pew pew pew" at the round robin demonstration
@xavierk99
@xavierk99 5 ай бұрын
A great explanation with a lot of energy. Love it!
@fireystella
@fireystella 2 жыл бұрын
Ur content is super great! And ur narration 😂 just when I’m losing my attention you say something funny and then I’m paying attention again 😆😆 many thanks!
@eraldkeshi3645
@eraldkeshi3645 3 жыл бұрын
HI Hussein ! I'm so happy to have found a channel with such a great content. I have noticed that besides the videos, your slides are also very clear and concise. It would be really helpful if you could also share a link to them ! Keep up the good work
@hnasr
@hnasr 3 жыл бұрын
Glad you like them! thanks Erlad!
@Iliasbhal
@Iliasbhal 4 жыл бұрын
BTW, you are clearly the best teacher on youtube. I think you can teach anything actually ;). You are making learning so much joyful.
@hnasr
@hnasr 4 жыл бұрын
Iliasbhal aww 😊 thank you so much I am glad you enjoy the content
@jeetendrashinde2855
@jeetendrashinde2855 4 жыл бұрын
An excellent demostration of difference between the 2 Load balancers, good job Hussein !!
@hnasr
@hnasr 4 жыл бұрын
Thanks Jeetendra!! appreciate it
@SinghGaurav9
@SinghGaurav9 4 жыл бұрын
Hey man, thanks for the video, it was informative. Your funny style made it even more interesting.
@rishabhjain5459
@rishabhjain5459 3 жыл бұрын
Thanks for making our life easy and also for making your videos a lot more entertaining. :D
@ezekielchoke2580
@ezekielchoke2580 4 жыл бұрын
What you're describing around the 30 minute mark - sharing the pool of connections - is exactly what nginx does. It's sometimes called multiplexing. In our case, this causes an issue, since the application behind the LB needs to recognize the client and attempts to set a very long cookie, which the client truncates.
@DevOpsEnver
@DevOpsEnver 3 жыл бұрын
MashAllah you are so good and professional in your area.
@icbm7
@icbm7 3 жыл бұрын
was the page not changing at 21:37 was because of the browser cache?
@smartstack
@smartstack 2 жыл бұрын
very crisp & informative
@Obsi995
@Obsi995 4 жыл бұрын
guys not only is he extremely helpful but he also loves The Office :'( amazing
@hnasr
@hnasr 4 жыл бұрын
If you are an office fan You will like this http/2 video kzbin.info/www/bejne/nIeugaV6p6qqiqs
@subhamprasad1373
@subhamprasad1373 3 жыл бұрын
thank you, for your hard work. you are such an amazing person, sharing all this wonderful knowledge.
@ArdhenduShekhar-sw4uy
@ArdhenduShekhar-sw4uy 3 ай бұрын
HE PUT A THAT'S WHAT SHE SAID JOKE IN THERE. ABSOLUTE LEGEND.
@briansaunders4745
@briansaunders4745 3 жыл бұрын
Can you create a video about the Denial of Service features of a load balancer, and talk about how an ADC is the same or like a load balancer? Very cool delivery and the humor is appreciated and very good!
@hnasr
@hnasr 3 жыл бұрын
Thanks Brian, I talked about DOS here kzbin.info/www/bejne/anqapYONbdSZaMk
@COOL-rt5ex
@COOL-rt5ex 2 жыл бұрын
Good to see configuration in the video
@r3jk8
@r3jk8 3 жыл бұрын
Thumbs up for the clear explanation of this topic and also for the super funny comment “that’s what she said.” 14:11
@animatrix1851
@animatrix1851 4 жыл бұрын
I have a small question, also thank you for answering my question on your other video!!! So essentially, my thinking is that you'd need to balance your load if one server is .. well being overloaded. So in this instance, if i do setup a load balancer that doesn't redirect me but actually funnels the data through itself. Then, what's preventing the load balancer from being overloaded itself ? It's handling all the tcp connections of both the servers in your example right ? Sure, it's not doing cpu work but there's some I/O throttling that'll happen eventually right ? I'm just confused here because if that's the case would you put a load balancer to that load balancer, there's still going to be a single point of failure if the balancer dies/overloads. Correct me if i'm assuming that I/O load could be high, maybe funneling bytes isn't that tiring and the load balancer could do it no problem. (or) maybe the tcp connection splits away after the initial hit and the data doesn't go through the balancer anymore ? I'd love for you to answer this since i've not been able to wrap my head around this part.
@chandanapericharla
@chandanapericharla 4 жыл бұрын
Your concerns are totally valid. If there are too many concurrent connections, it can throttle the load balancer itself bringing down the overall availability of the system. Hence, heavy traffic applications like Google and Facebook opt for distributed load balancing where the load balancer is not a single server. Google offers one such service called GCLB-Google cloud load balancer. You can find some info on it here:landing.google.com/sre/workbook/chapters/managing-load/
@vjmathew6962
@vjmathew6962 3 жыл бұрын
may be you would have found your answer, if not, see keepalived video of Hussein. You will get an idea Edit : keywords VIP ( virtual ip ), VRRP
@pajeetsingh
@pajeetsingh 3 жыл бұрын
How does actual forwarding works? Create new socket between RP and Server? There has to be at least two open socket invoked in client to backend, is not it? It is just the RP makes it look like one TCP connection.
@DYamanoha
@DYamanoha 3 жыл бұрын
Yeah I was a bit confused about the '1 tcp connection' pro that was called out for Layer 4 LBs. The only way this could work is if you had 2 sockets for each logical connection. One for the client connection, and one for the back-end server connection. As soon as the proxy accepts a client connection it must store that socket along with a new socket connection to which ever back-end server was chosen. Bytes just get copied between the receive and send buffers of the socket pairs. All this ip swapping is automatically done through the socket API abstraction. The same would have to happen for layer 7 LBs. Afaik, the only difference is that Layer7 LBs deserialize the http protocol. One huge benefit is per. http request routing, which can help even out load across your backends.
@antoniorap8825
@antoniorap8825 10 ай бұрын
Hey, thank for this helpfull and amazing tutorial and explaination. sorry for my bad english. I have a question, the backend IP can be found / detected by anyone ?? its there a possibility to hide a tcp connection using netcat to the load balancer proxy, and connecting to the backend, with sniffing maybe no? thank for people who respond and help !
@wangsonny8694
@wangsonny8694 2 жыл бұрын
thanks for this great video, helps a lot for preparing system design interviews!
@AtulPoddar-x1d
@AtulPoddar-x1d 9 ай бұрын
How does the layer 7 LB know which client to respond to, when it receives the response from server? In layer 4, it is done by maintaining a NAT, and it is the same TCP connection.
@pkcc9381
@pkcc9381 5 жыл бұрын
U are AWESOME. U made this video even though this is not most voted topic in ur last survey.
@hnasr
@hnasr 5 жыл бұрын
PK CC you guys are awesome! Of course I will make videos on topic you guys interested in. Ill just adjust priorities. Hope you enjoy it and thanks for commenting ! Stay awesome 😎
@iQatif
@iQatif 3 жыл бұрын
شكرا ابو علي
@hnasr
@hnasr 3 жыл бұрын
العفو
@brurytangkere4874
@brurytangkere4874 3 жыл бұрын
Hi, is there example if the HAProxy Loadbalancer using redis db as a session
@RNCode1234
@RNCode1234 5 ай бұрын
@hnasr If Layer 4 load balancer heavily relies on IP Address which is Layer 3. Why do we still call it Layer 4 load balancer? We could call it Layer 3 load balancer. Isn't it?
@rhul0017
@rhul0017 2 жыл бұрын
OK Hussein i have a doubt, since the segments are part of layer 4, then those units will definitely have IP included in that, Then we can use it to make the units sticky by forwarding the same segments with same IP to a server right,How is that a con, layer 4 can do that right, correct me if am wrong, i am just getting started, thanks
@jianxiongng1979
@jianxiongng1979 3 жыл бұрын
I had a Nginx behind the HAProxy, how can I pass the authentication of Nginx back to Nginx server through the HAProxy?
@abdelrhmanahmed1378
@abdelrhmanahmed1378 2 жыл бұрын
in layer 4 ,we have one connection between the client and the load balancer and the server ? how is that happening , what about the acks > and what happen if the packet is lost between one node and the other ?
@coolzsatyen1
@coolzsatyen1 2 жыл бұрын
Great Explanation, however you said you love to repeat, then you do not follow DRY principles :)... Keep posting such great videos. Appreciate !!
@goatslayer5957
@goatslayer5957 6 ай бұрын
The man the legend!
@abdelrahmanabdelfattah1092
@abdelrahmanabdelfattah1092 3 жыл бұрын
Thanks for this great video, I have a question, what is the difference between using an SSL certificate on layer 4 load balancer vs using it on layer 7 load balancer?
@hnasr
@hnasr 3 жыл бұрын
Fantastic question. Layer 7 load balancer must terminate TLS while Layer 4 load balancer doesn’t have to. L4 LB can terminate TLS means serve the certificate from the LB, which means it can decrypt and look at the content. It can also decides to Passthrough the TLS. Hello all the way to the backend which means it is end to end encryption and cert is served from Backend
@BoyzaLetlojane
@BoyzaLetlojane 4 жыл бұрын
Enjoyed this video. Learning made fun!! :)
@hnasr
@hnasr 4 жыл бұрын
Thanks George! Glad it was
@joesephbattle7834
@joesephbattle7834 3 жыл бұрын
Kristen n charles
@sneharajit41
@sneharajit41 3 жыл бұрын
I understand the concept of two flavors of load balancer but my question is since a load balancer is basically a software and processes the incoming request why both are not working in a single layer(layer 7)?
@MI5500
@MI5500 Жыл бұрын
This guy will be a great dad 😂😁
@GlenMillard
@GlenMillard 4 жыл бұрын
"..that's what she said!!!..." Ha - someone is a Micheal Scott fan!!
@hnasr
@hnasr 4 жыл бұрын
You think? kzbin.info/www/bejne/nIeugaV6p6qqiqs
@pajeetsingh
@pajeetsingh 3 жыл бұрын
TLDR?
@davidlira8853
@davidlira8853 3 жыл бұрын
that cracked me up lol
@Midhunchowdary
@Midhunchowdary 3 жыл бұрын
Wondering if microservices can run behind Layer 4 LB by running the services on different ports?
@AMANSINGH-gg8xz
@AMANSINGH-gg8xz 2 жыл бұрын
Hii, I just watched your video today, I have one doubt that if layer 4 load balancer uses one TCP connection how can we give a grantee to the client that the packet has been sent?
@Mayank0391
@Mayank0391 4 жыл бұрын
Again a very nice video. A detailed tutorial video of haproxy would be great.
@hnasr
@hnasr 4 жыл бұрын
Thanks 😊 haproxy tutorial is requested a lot! Ill need to make it soon. Have so much other videos on my backlog
@tusharh4723
@tusharh4723 3 жыл бұрын
Hi Hussein, great content. Thanks!! One question is in your example of layer 7 load balancing with Haproxy I did not see ssl certificate mentioned in configuration,then how Haproxy was able to work on layer7????
@ChrisAthanas
@ChrisAthanas 3 жыл бұрын
Great explanation
@pengdu7751
@pengdu7751 4 жыл бұрын
great video and explanation. the flying red dot is a bit distracting
@hnasr
@hnasr 4 жыл бұрын
thanks and apologies for the red dot, I try to get better as I make more videos
@pengdu7751
@pengdu7751 4 жыл бұрын
@@hnasr but overall great work. keep'em coming. it's been so fun and informational watching your videos. right to the point with demos. I teach in college part time and I wish I could be as a good speaker as you.
@hnasr
@hnasr 4 жыл бұрын
Thank you Peng for your kind words. I find making videos help improve my skills. I still need lots of work, particularly getting to the point quicker
@fyrweorm
@fyrweorm 2 жыл бұрын
I don't get it. What's the difference between an api gateway and a layer 7 load balancer?
@blablabla050484
@blablabla050484 4 жыл бұрын
Great explaination, and Very Cool Cursor movements. what kind is it ?
@hnasr
@hnasr 4 жыл бұрын
Rico Agung Firmansyah Thanks 🙏 I use google slides
@recepinanc3351
@recepinanc3351 4 жыл бұрын
Thank you for the great post!
@CODINC
@CODINC 3 жыл бұрын
Hussein what is the use of load balancer if i can use reverse proxy because reverse proxy is a load balancer? Is it any efficient?
@dr99tm23
@dr99tm23 2 жыл бұрын
thank you a lot.
@brianpayne3468
@brianpayne3468 3 жыл бұрын
Can you do a log-format in using logging (rsyslog) in HAProxy. I like to troubleshoot an HAProxy issue where it is dropping connections in rare occasions. Something to do with a sticky-bit in HAProxy timing out. The HAProxy is used as a Load Balancer ( reversed proxy) and runs as a container. Only connect using HTTPS in the Load Balancer using ports 80, 443, and 7999. From the logs, I like to see why and where it is dropping the connection. I would like to see the log info on the time duration of the connection. I am currently using 3.2.14 version of HAProxy. Thanks!
@mamyname
@mamyname 4 жыл бұрын
Keep up the good Tutorials.. thanks for sharing :)
@hnasr
@hnasr 4 жыл бұрын
Glad you like them!
@narularitesh
@narularitesh 3 жыл бұрын
Hi Hussein, your method of explanation is amazing, simple and logical. You are right bang on it. Amazing. I am really impressed, because I have always been confused with LBs. I have a few doubts (and probably some ideas for content enhancement based on my doubts), is there a way I can connect with you. Any support is helpful. Thanks.
@hingusanjay
@hingusanjay 4 жыл бұрын
Great tutorial. One question, if load balancer algo it round robin, then it was sticking to 4444 or 5555 only without you killing one of the server?
@la4123
@la4123 7 ай бұрын
I'm wondering abaut that either. It's so weird.
@krozaine
@krozaine 3 жыл бұрын
Layer 4 Load Balancer Demo : How did HAProxy know 4444 is down? Was it the first failed request that told it or was it some heartbeat type of mechanism between HAProxy and the backend services? Also, I am curious about the "check" keyword mentioned in the cfg file.
@hnasr
@hnasr 3 жыл бұрын
Haproxy periodically does a health check against the backends and see if they are alive. And if they are not they remove it from the backend pool
@viswa9109
@viswa9109 Жыл бұрын
From my understanding, one http request can potentially span multiple packets. if that is the case, how does layer 4 proxy take care of that. Like if it does a round robin or something else and sends the packets to different servers, wouldn't the packets be useless? How does the layer4 proxy handle this Edit: Ok so, I see that stickiness is employed. Just had to rewatch the video!
@msk9414
@msk9414 2 жыл бұрын
Hello Nasser, I have question regarding the function of layer 3 when layer 4 load balancing is used.I know layer 3 is responsible for establishing session when using layer 7 LB , but as per the video If I am using layer 4 LB then layer 4 is establishing the session which takes over layer 3 responsibility.Are layer 7,6,5 skipped when using layer 4 LB ?
@navindudissanayake1669
@navindudissanayake1669 3 жыл бұрын
Why does a level 7 load balancer need 2 TCP connections compared to 1 on level 4?
@edenr1988
@edenr1988 4 жыл бұрын
Awesome tutorials, I've learned a lot from them about networking thanks !! :) you seems to know a lot about networking so I have one question (maybe not 100% related to this video, it's also related to previous videos that you released) - I have the following use case, I want to redirect traffic to my local private network from a public cloud provider VM and I was thinking whether I should use iptables tcp forwarding (after seeing your other tutorial) or for example nginx / haproxy ws tunnel. Do you happen to know what's the pros and cons of these approaches ? what would be most reliable in terms of latency and security ? should I be just fine with iptables TCP forwarding ? or should I go with ws tunnel (The next step would be to build client / server app to automate the update of my private NAT IP address on that server so I can keep getting traffic from that "cloud static ip", I would also make it open source with MIT once I get into implemention) I've tested the iptables tcp proxy from your other tutorial and it did in fact worked, I could recieve traffic and respond from a cloud instance that was transfering the tcp packet to my local network. I've never tried ws tunnel thought and would like to know your opinion. To be more specific I have a Kubernetes Ingress on my local network (Layer 7 Loadbalancer) that the traffic would be transfered to it using portforwarding on my router. So from the cloud instance all I need is the static ip address basically (and the point of it is that I would be able to use more resources by only creating one single instance for probably $5 a month), I just want to transfer the client to my private cluster on my private network, the rest would be handled on my local private network.
@sirbumblefuck
@sirbumblefuck 4 жыл бұрын
I like your teaching style.
@hnasr
@hnasr 4 жыл бұрын
Rahul Pandey thanks Rahul!
@sarwowibowo9318
@sarwowibowo9318 Жыл бұрын
What if the load balancer is died? How to guarantee fault tolerant?
@parasarora5869
@parasarora5869 3 жыл бұрын
yeeahhh...!! This was fun .. :) .. great video sir !
@manasdalai3934
@manasdalai3934 4 жыл бұрын
Loved it. Great content.
@hnasr
@hnasr 4 жыл бұрын
Glad you enjoyed it!
@AhmedMohamed-xs5ij
@AhmedMohamed-xs5ij 5 жыл бұрын
This tutorial is great
@sairam-lj6zu
@sairam-lj6zu 4 жыл бұрын
Great video Hussein. I have a doubt, how layer 4 proxy will forward the packet to the server, without replacing the Destination server ip address in the ip packet ?
@hnasr
@hnasr 4 жыл бұрын
Good question! One implementation is to keep a table of what sourceIP goes to what Destination IP so it can map it. This is called NAT (network address translation) check out the NAT video I did How Network Address Translation is used on Layer 4 Load Balancing and Port forwarding
@dangaines405
@dangaines405 2 жыл бұрын
Great content!
@hnasr
@hnasr 2 жыл бұрын
Thanks Dan!
@Textras
@Textras 4 жыл бұрын
Have you done a video on H2C smuggling?
@hnasr
@hnasr 4 жыл бұрын
Textras I have not! Didn’t know about it thanks for sharing.. I only discussed HTTP 1.1 smuggling. I wouldn’t worry about h2 clear text though since most h2 setups are secure
@Textras
@Textras 4 жыл бұрын
@@hnasr saw it here twitter.com/theBumbleSec/status/1303305853525725184?s=19
@hnasr
@hnasr 4 жыл бұрын
It is actually a serious one if you backend supports h2c, I need to discuss this thanks for sharing!
@deeptshukla5141
@deeptshukla5141 3 жыл бұрын
Great placement of that's what she said! Great tutorial @Hussein
@adilamanat8117
@adilamanat8117 4 жыл бұрын
Great content! I have a question if in 7 layer architecture load balancer use 2nd tcp connection how does it response back to client does it make connection keep alive during that process or what?
@hnasr
@hnasr 4 жыл бұрын
Good question! LB starts and establishes a connection B1 to backend1 and B2 to backend2 Client establishes connection C1 with LB. Client sends a request on C1, LB receive it, looks at the content, perhaps changes it and then send the request on B1. LB wait for B1 to respond, once it gets back the result, it sends back the result to client. all this the client is synchronously waiting.. Client sends another request on C1, LB receive it, looks at the content, perhaps changes it and then send the request on B2 (because of round robin algorithm) .. same thing hope this helps
@jayak3768
@jayak3768 4 жыл бұрын
Quick question: Does a layer 4 load balancer have the capability to always direct a client to the same server. So that if there is http session information maintained on the server for the client, it continues throughout the duration of the client's interaction with the same server.
@hnasr
@hnasr 4 жыл бұрын
That is correct. Layer 4 Proxying maps client requests on the same TCP connection to always go to the same host on the backend. That being said the browser (with HTTP/1.1 specifically ) opens multiple TCP connections to a single host. So if you make a request to the site it can go to a TCP connection which will go to Host A but then you can make another request to the same site but browser will use another TCP connection which will land on another Host B.. I explain this in details here kzbin.info/www/bejne/r53OcpZvrNJ-nsU
@jayak3768
@jayak3768 4 жыл бұрын
@@hnasr So a client can establish 2 tcp connections with the same layer 4 load balancer. Even though for both of the tcp connections, the IP address of the client and the IP address : port of the server(layer 4 load balancer) are the same. How would the layer4 load balancer distinguish between the two tcp connections to always route the first tcp connection request and subsequent communication to host A and the second tcp connection request and subsequent communication to host B respectively. What parameter, tag, or any other information is different between the two tcp connections for the layer 4 load balancer to make this decision.
@pipi_delina
@pipi_delina 4 жыл бұрын
Hello Hussein do you have a video ebay's neutrino loadbalancer... kind regards
@hnasr
@hnasr 4 жыл бұрын
Ismail Yushaw hi , unfortunately I don’t didnt discuss that.. however all load balancers are similar. Some picks different design choices Check out this playlist Load Balancing kzbin.info/aero/PLQnljOFTspQWdgYcGXCTkjda8vd2jWJYt
@pipi_delina
@pipi_delina 4 жыл бұрын
@@hnasr I hope you can do something similar to that of traefik
@netman87
@netman87 4 жыл бұрын
Is there way to make haproxy keep connection alive? i mean with internal http2 we should be able to have multible streams in single connection and in this example it looks like it gets new connection everytime? atleast from haproxy to nodes
@hnasr
@hnasr 4 жыл бұрын
You can set the timeouts as needed check out the video here kzbin.info/www/bejne/p4rRcmV6e6p4gtk
@Tigerhawk1337
@Tigerhawk1337 4 жыл бұрын
I'm a bit confused about the "sticky segment" discussion at kzbin.info/www/bejne/l3ywfZp8i92Nj80. For Layer 4 load balancing, if there's a single tcp connection between the client and the reverse proxied server, like the diagram suggests, wouldn't that mean all segments go to the same reverse-proxied server? In other words, the concern you raised about MTU > 1500 shouldn't be an issue for layer 4 (yet you had it as a "con"). If fragments don't go to the same reverse-proxied server, then the blue line in the diagram that shows a single tcp connection between the client and the reverse-proxied server is a bit confusing.
@hnasr
@hnasr 4 жыл бұрын
You are 100% correct. In a Layer 4 proxying once the TCP connection is established, all packets sent to the reverse proxy on that connection are streamed to the same backend causing a “sticky” session. That is a disadvantage that prevents proper distributions of load. Apologies if my rephrasing in the video was confusing. And thanks for clarifying this 🙏
@RandomShowerThoughts
@RandomShowerThoughts 5 жыл бұрын
This was a hell of video!
@filippomachi2314
@filippomachi2314 5 жыл бұрын
Thanks Hussein, I really enjoyed this video and I was able to understand a lot of things. But I have a question, I am exploring the possibility to use Server Sent Events, in this case I can only use layer 7 load balancer, am I wrong? Thanks again!
@hnasr
@hnasr 5 жыл бұрын
Filippo Machi Thanks Filippo! Man i just love these questions because they make me think 💭 Ok so short answer is you can use a layer 4 load balancer with SSE and websockets much easier and reliable than a layer 7 load balancer. Not saying you cannot do it with L7LB But you need to find a load balancer that actually supports that. Here is why: layer 4 load balancer will NAT the tcp connection to final destination server and exchange packets in a single connection. So the server can send information to the load balancer and load balancer will simply NAT things to the client. So if i make an HTTP GET request to a L4 LB, first i try to establish a tcp connection with LB, LB will actually build a table and change the packet ip address destination to one of the backend servers, and forward the packet, and then simply acts like a gateway(kinda like how your router works) and now one your tcp connection is established you are tethered to one server .. so any http request on the same tcp will ALWAYS go to the same backend server.. unless you establish a new session. That is why SSE and websockets work normally since they are stateful like that.. However with layer 7 LB as we explained in the video, the client connects to the load balancer first so thats one tcp connection and the load balancer will establish another tcp connection to the backend server. So if I make a simple HTTP request to the layer 7 load balancer, my final destination as a client is the load balancer, The load balancer will then block my request (synchronously) and make the request to one of the backend servers, get the result, unblock me and return the result. So in this case most load balancers are really waiting for a request from clients ... but what happen if all of a sudden the server started to send something to the load balancer? (Server side events) what does that mean? How does the layer 7 load balancer know what client to forward the request to ? Smart load balancers might actually build a table and start mapping ip addresses to client ports. Other load balancers might make the backend server respond to the client directly So you see how complex it is to do layer 7, you can use layer 4 LB, The only thing is you will get a sticky load balancer to a single server per client session. i need to do more research and videos on this topic very interesting.. Hope that helps!
@filippomachi2314
@filippomachi2314 5 жыл бұрын
@@hnasr thanks a lot for answering my question, let me know if you perform further research or video regarding this topic :)
@pablohernandez4305
@pablohernandez4305 3 жыл бұрын
Great video
@xinyuzhang
@xinyuzhang Ай бұрын
Oh I bought your lecture on udemy, teacher
@nafasm
@nafasm 4 жыл бұрын
Great video.Thank You
@hnasr
@hnasr 4 жыл бұрын
Thanks Nafas!
@shazadrojan2387
@shazadrojan2387 4 жыл бұрын
quick question about Layer 4 using https - port 443 and SSL termination. If I am only using https-port 443 it is necessary to terminate SSL on the LB or can i just do this in IIS bindings?
@hnasr
@hnasr 4 жыл бұрын
It depends on your backend if the backend supports TLS then IIS should really do a TLS Passthrough not termination (since you said its layer 4 LB) the certificate being served will be the backend not the LB If the backend doesn’t support TLS then it the LB will do a TLS termination and serves its certificate instead. The traffic on the backend will be unencrypted might not be desirable
@Hellmiauz
@Hellmiauz 4 жыл бұрын
so in terms of uplink and bandwidth usage. If backend 1 and 2 have a 1Gbps port, Haproxy server needs a 2Gbps port to be able to transfer at full capacity? And bandwidth, if server 1 and 2 consumed say 1TB each in a day, Haproxy will consume 2TB on same period?
@hnasr
@hnasr 4 жыл бұрын
A very interesting insights lets unpack it the backend network interface of HAProxy must live in the same network as backend servers. Probably I am imagining a network switch between them. One port going from HAP to the switch, and from the switch to each backend server. So now the numbers. If we assumed defaults 1 Gbps for all ports. Than haproxy can upload and download 1 Gb per second (~128 MB each second). so if two clients concurrently requested to fetch a resource that is 128MB In size, from HAP, the first request goes to backend 1 the second goes to backend 2. But it will take HAProxies two full seconds to download this resource from each server (assuming no caching) So yes! a 2Gbps uplink:dnlink HAProxy will download the two resources concurrently in 1 second (50%) faster. And to answer your final question, yes if server 1 and 2 uploaded 1 TB each, then HAProxy will have “downloaded” 2TB. Thanks! Let me know if I missed something
@nityadeepika1967
@nityadeepika1967 3 жыл бұрын
hi Hussein, TLS termination happens even at layer 4 load balancer isn't it? I remember using an SSL certificate at the network load balancer (NLB in AWS). then, in my opinion, layer 4 does know the data. that makes it less secure. This kind of contradicts what you said at @10:26. could you pls shed some light?
@hnasr
@hnasr 3 жыл бұрын
That is 100% true thanks for mentioning this, TLS termination can happen in layer 4 (tls handshake will happen between client and proxy) this is as oppose to TLS pass through which the proxy merely forwards the TLS hello all the way to the backend
@sanilkhurana3991
@sanilkhurana3991 4 жыл бұрын
Maybe a stupid question but talking about NAT and how it changes the IP address, is a normal router that we have in homes similar to a layer 4 load balancer?
@hnasr
@hnasr 4 жыл бұрын
Sanil Khurana Correct a gateway act like a layer 4 NAT proxy. I wouldn’t use the word load balancer for a router because it doesn’t perform that task..
@sanilkhurana3991
@sanilkhurana3991 4 жыл бұрын
@@hnasr Thanks for the reply! Definitely, an interesting topic and I would look a lot more into it(probably starting with your NAT videos and layer 4, layer 7 load balancing videos) and I love the fact that you take the time to reply to comments.
@hnasr
@hnasr 4 жыл бұрын
All of these are interesting questions! Plus it helps other people reading the comments! (Like if you are reading this and getting value)
@gmanon1181
@gmanon1181 4 жыл бұрын
Excellent! I wonder if it's possible to combine somehow a load balancer in the transport layer with a load balancer in the application layer to deal with the disadvantages of one another. It sounds like the logical way to go. True or False?
@hnasr
@hnasr 4 жыл бұрын
gmanon thanks! Yes some proxies actually take advantage of both L7 and L4 example is websocket proxying.. (check out my video on that) first request is a layer 7 request to detect http upgrade and then it switches to layer 4 streaming
@drew4980
@drew4980 5 жыл бұрын
Looks like your first video on the playlist "Software engineering by example" is private. Just thought you'd want to know :)
@hnasr
@hnasr 5 жыл бұрын
Andrew Pelletier thanks for noticing! Thats my bad thats next week’s video and since its scheduled its set as private for some reason. Weird that youtube actually show it on the list. Let me remove it.
@bobbycyy2462
@bobbycyy2462 3 жыл бұрын
wonderful video!
@jexxiewoo8390
@jexxiewoo8390 5 жыл бұрын
Thanks for the content! Just sometimes the screen got chopped off 35:58
@hnasr
@hnasr 5 жыл бұрын
Jexxie Woo thanks 🙏 I did notice that after i posted the video. Thankfully nothing in the chopped screen is important. Appreciate your comment ! And ill make sure to avoid that in the future.
@gguestdub3518
@gguestdub3518 Ай бұрын
But i dont want web, i want layer 4 i mean ping?? Tcp connection over powershell???? U understand??
Network Address Translation - NAT Explained
21:28
Hussein Nasser
Рет қаралды 61 М.
WebSockets Crash Course - Handshake, Use-cases, Pros & Cons and more
47:33
SHAPALAQ 6 серия / 3 часть #aminkavitaminka #aminak #aminokka #расулшоу
00:59
Аминка Витаминка
Рет қаралды 1,3 МЛН
哈莉奎因怎么变骷髅了#小丑 #shorts
00:19
好人小丑
Рет қаралды 51 МЛН
АЗАРТНИК 4 |СЕЗОН 2 Серия
31:45
Inter Production
Рет қаралды 1,1 МЛН
API Gateway vs Load Balancer vs Reverse Proxy: when to use what?
9:06
Software Developer Diaries
Рет қаралды 17 М.
HAProxy Crash Course (TLS 1.3, HTTPS, HTTP/2 and more)
1:12:19
Hussein Nasser
Рет қаралды 135 М.
Load Balancers for System Design Interviews
4:42
Exponent
Рет қаралды 37 М.
Load Balancing with NGINX
30:03
NGINX
Рет қаралды 64 М.
Layer 4 vs Layer 7 Proxying In Details Explained with Examples
24:24
Hussein Nasser
Рет қаралды 25 М.
How To Build a Load Balancer In .NET With YARP Reverse Proxy
11:33
Milan Jovanović
Рет қаралды 19 М.
SHAPALAQ 6 серия / 3 часть #aminkavitaminka #aminak #aminokka #расулшоу
00:59
Аминка Витаминка
Рет қаралды 1,3 МЛН