K8s Horizontal Pod Autoscaler | HPA Manifest File Explained | Pod Requests Limits | HPA Demo

In this detailed kubernetes tutorial, we will look at EC2 Scaling Vs Kubernetes Scaling. Then we will dive deep into pod request and limits, Horizontal Pod Autoscaling (HPA) and how to code manifest file for it. Finally we will demo HPA in action!
Kubernetes Reference: kubernetes.io/docs/tasks/run-...
💰👨‍🎓 Get my courses with max discount and 30 day moneyback guarantee: bit.ly/3Eku9RH
*Connect with me*
🤳 Instagram: / cloudwithraj
🏢 LinkedIN: / rajdeep-sa-at-aws
🐦Twitter: / cloudwithraj
🖼 Facebook: / cloudwithraj

[@bibekdas3592]

crisp and clear. Saved a lot of my time. Thank you Raj. Simply Brilliant

[@tr8811]

Awesome Video, really cleared my concept of HPA, and it is working with Cluster Autoscaler. Thank you Very much for the video.

[@CoffeeandBarbell]

Beautifully explained. All my queries are cleared. Thank you.

[@cloudwithraj]

Glad it was helpful Dayananda

[@mediatwinkleTV]

Dude, you're a real life super hero. keep it up !

[@cloudwithraj]

Haha thanks mediatwinkle, glad the video was helpful.

[@101BeingHappy]

Very well explained the concepts of autoscaling at different levels

[@durgadeep4988]

Very clear and well illustrated !.

[@bhasthod1]

Excellent explanation and very apt presentation with the diagrams. Great work Sir...!

[@cloudwithraj]

Thanks Thrihesh for the kind words. I am glad you found it useful, thanks for watching.

[@007hariharan]

Great explanation. I was able to follow. You saved a lot of time. Thanks

[@bhuwaneshwarmishra94]

Excellent Raj ....now my all doubts related to HPA is cleared. Thank You so much

[@cloudwithraj]

You are most welcome

[@alitajvidi5610]

Thanks Raj! You made my day! Great demo!

[@cloudwithraj]

Glad to hear that!

[@deepanshumishra4568]

As always awesome video Raj , Thank you so much ♥

[@cloudwithraj]

Glad you liked it

[@magician6123]

Great video bro. Thank you very much.

[@santoshkalamkar8806]

nicely explained.. Thank you so Much!!!

[@balsubu1]

nice one.. simple and neat

[@umairqamar2672]

u r amazing raj

[@bhuwaneshwarmishra94]

I request you Raj to pls guide me step by step creation on jenkins pipeline ....demo to onboard docker service using jenkins pipeline. How we can mention bitbucket repos inside jenkins pipe and build the same.

[@syan224]

The explanation is really good, thank you

[@cloudwithraj]

Glad it was helpful!

[@phucbker]

Thanks for detailed explanation!

[@cloudwithraj]

Glad it was helpful!

[@bibonhiquan]

Great presentation! Thanks so much.

[@cloudwithraj]

Glad you liked it!

[@sreedhargourisetty9324]

Loved it.

[@amitkulkarni8813]

absolutely great video sir

[@cloudwithraj]

Thanks bro, glad you liked it

[@sanjoydey8378]

Very good content.

[@byteslinger3187]

Raj went beast mode with this tutorial. Very nice work!

[@cloudwithraj]

Appreciate it!

[@byteslinger3187]

@@cloudwithraj Hey Raj would you be willing to do a consultation? For payment of course. My company is stuck on the last piece to launch our server hosting business. Were having issues using the kubernetes JavaScript client to stream pod logs to our react front end. Its been websocket hell. Any help or advice would be awesome and again we can pay.

[@cloudwithraj]

@@byteslinger3187 ​ Ty for the offer! Not doing any consultation currently

[@richardlanglois5183]

Great presentation!

[@cloudwithraj]

Thanks for watching

[@itsthecrazytom7855]

Great video, really helped me get my head around the HPA concept thanks!

[@cloudwithraj]

Very welcome!

[@hassanharrison3986]

i guess I am kind of off topic but do anyone know of a good website to watch newly released tv shows online?

[@raylanamir3359]

@Hassan Harrison Flixportal :)

[@hassanharrison3986]

@Raylan Amir Thanks, I went there and it seems to work :D Appreciate it !

[@raylanamir3359]

@Hassan Harrison happy to help xD

[@samahome]

Excellent explaining

[@cloudwithraj]

Glad it was helpful!

[@deepanrajan7430]

All your kubernetes video are really great, can you please share more videos like ingress controler, node affinity

[@cloudwithraj]

Thanks for the kind words. Couple more Kubernetes videos coming soon!

[@bhupeshmaduskar9581]

it was very well explained , i have gone through many videos and docs . but getting more and more confused . specially explanation for targetCPUUtilizationPercentage was so much required . having it in demo is another level .

[@cloudwithraj]

Glad it helped

[@navnathdahibhate2464]

Nice Explanation 👍😊

[@cloudwithraj]

Thanks 🙂

[@pavannannapaneni4586]

Great demonstration. Question, how does the pod updates rolls out in HPA? For instance, I have HPA defined with minReplica's as 2 and max as 10, pods got scaled correctly when deployment triggered. However when I roll out update, it is supposed to bounce both the pods with new config, however I am seeing only 1 pod get bounced and I need to bounce the other one manually. How do I fix this?

[@reardeltoit4644]

thank you

[@rajuk1773]

Thank you so much

[@cloudwithraj]

You're most welcome

[@fabioszymanski]

Wowwwww

[@yathishgowda4847]

Great video, can we use prometheus instead metrics server ??

[@gdevelek]

In the CPU resource requests and limits 0.5 and 1.0 are NOT percentage numbers, they are ABSOLUTE numbers, and express cores. 0.5 means half a core. You need to correct this.

[@durbabanik3372]

life saver

[@damonzh588]

spec: maxReplicas: 8 minReplicas: 2 scaleTargetRef: apiVersion: apps/v1 kind: Deployment name: nginx targetCPUUtilizationPercentage: 60

[@pclokcer]

veryy good. thanksssss

[@cloudwithraj]

Welcome 😊

[@alitajvidi5610]

Thanks!

[@cloudwithraj]

Wow, TY Ali for the donation, much appreciated.

[@stasberkov]

Small correction: mebibyte uses 1024 as base, while megabyte uses 1000 as base.

[@kaustubhmishra3973]

What if I want to have more than 512 mib for a pod? Do we then need to increase the millicores? Also can we take any amount of millicores like 567 or 666?

[@MrAjsanpedro]

Hi thank you for this video, I just need to ask on 9:47 is it also possible to monitor the targetMemoryUtilizationPercentage in HPA?

[@cloudwithraj]

Yeah, it's possible. HPA can monitor lot of advanced metrics beyond the basic ones.

[@PauloEduardoftw]

Executing kubectl get hpa, is returned 45%/50% with 3 replicas, for instance. This 45%, is the sum of all pods or among these 3 pods, is the pod with highest percentage? Nice explanation, I just would like to understand better this metric.

[@sarojnayak1024]

🆒👍

[@balajiveerasingam3602]

on resources section, we are providing request and limit for cpu. A pod will be created with request cpu then how come it grows to use limit cpu ? Kindly clarify how request grows to complete the limit cpu

[@singaravelannandani7037]

Eks namespace access level via aws sso video also we are looking...

[@RahulSingh-ng9vi]

But what is the role of cpu limit in hpa scalling up and down, do we really need it or we should remove it

[@user-up1xf2lq4y]

I have set up my test program very similar to yours. I used apache2 ab command line to increase the load. I was able to see the number of pods increases as the cpu usages goes high. However, there was no time difference in Time per request or Total time taken when I manually increased number of replicas(let's say from replicas=2 to 4) . I played around number of request and number of concurrent requests options from ab command line. I was able to see an improvement in time per request with very particular set of request and concurrent request. I checked CPU usage with htop and it used 100% of CPU in very particular situation. So I had to make conclusion that increasing replicas doesn't always guarantee better performance for user's experience. I want to hear your opinion on this. Thank you

[@aniceguy241]

because the purpose is to achieve higher availability, not better performance in speed, HA != faster

[@umanaik8142233886]

Can deployment has multiple replica s ? I mean deployment must have more than one replica to ensure ...!

[@aefwon3936]

where is the reference for the app, like selector shud be there in the HPA config, explanation is indeed good, but i think i missed it

[@ibrahimaydin8301]

I have an error : wget: can't connect to remote host:Connection refused. How can i fix it. My service type is ClusterIP

[@fooslinger]

Kube will throttle the pod if cpu usage exceeds limit. Not kill it. There are other circumstances where kube will terminate pods.

[@saitejareddygurujala2534]

omg content.. can we have your Udemy course link? would try to enroll it

[@cloudwithraj]

bit.ly/3Eku9RH , max discount going on right now, expiring Monday

[@McMurchie]

Can you scale based on memory?

[@cloudwithraj]

Yeah!

[@ranutoshniwal]

How to change default values in hpa

[@QuangPham-bc7lc]

why this dashboard get the metrics so long?

[@ajaykharat8832]

kubernetes-sigs/metrics-server/releases/download/v0.3.7/components.yaml": no matches for kind "APIService" in version "apiregistration.k8s.io/v1beta1" ensure CRDs are installed first