What is Lambda Throttling? (and how to fix it!) | AWS Feature Overview

In this video, I talk to you about Lambda throttling. I start by describing what Throttling is and why it happens. From there, I walk you through a practical example in which throttling occurs. I discuss the different handling methods depending on your invocation event source. Finally, I talk about best practices and how you can prevent Lambda Throttling for your application.
Looking to get hands on experience building on AWS with a REAL project? Check out my course - The AWS Learning Accelerator! courses.beabetterdev.com/cour...
📚 MY RECOMMENDED READING LIST FOR SOFTWARE DEVELOPERS📚
Clean Code - amzn.to/37T7xdP
Clean Architecture - amzn.to/3sCEGCe
Head First Design Patterns - amzn.to/37WXAMy
Domain Driver Design - amzn.to/3aWSW2W
Code Complete - amzn.to/3ksQDrB
The Pragmatic Programmer - amzn.to/3uH4kaQ
Algorithms - amzn.to/3syvyP5
Working Effectively with Legacy Code - amzn.to/3kvMza7
Refactoring - amzn.to/3r6FQ8U
🎙 MY RECORDING EQUIPMENT 🎙
Shure SM58 Microphone - amzn.to/3r5Hrf9
Behringer UM2 Audio Interface - amzn.to/2MuEllM
XLR Cable - amzn.to/3uGyZFx
Acoustic Sound Absorbing Foam Panels - amzn.to/3ktIrY6
Desk Microphone Mount - amzn.to/3qXMVIO
Logitech C920s Webcam - amzn.to/303zGu9
Fujilm XS10 Camera - amzn.to/3uGa30E
Fujifilm XF 35mm F2 Lens - amzn.to/3rentPe
Neewer 2 Piece Studio Lights - amzn.to/3uyoa8p
💻 MY DESKTOP EQUIPMENT 💻
Dell 34 inch Ultrawide Monitor - amzn.to/2NJwph6
Autonomous ErgoChair 2 - bit.ly/2YzomEm
Autonomous SmartDesk 2 Standing Desk - bit.ly/2YzomEm
MX Master 3 Productivity Mouse - amzn.to/3aYwKVZ
Das Keyboard Prime 13 MX Brown Mechanical- amzn.to/3uH6VBF
Veikk A15 Drawing Tablet - amzn.to/3uBRWsN
📚 References:
Why you need a Lambda DLQ - • Failure Handling Using...
Lambda Playlist - • AWS Lambda Guides - Ev...
Getting started with AWS: • Introduction to AWS | ...
☁Topics covered include:
Lambda
Lambda Throttling
Lambda Concurrency
Lambda Concurrency Limit
Lambda Thrashing
🌎 Find me here:
Twitter - / beabetterdevv
Instagram - / beabetterdevv
Patreon - Donations help fund additional content - / beabetterdev
#AWS
#Lambda
#Throttling
#Concurrency
#Serverless

[@tech-letters]

Great and complete explanation. Thank you

[@phanichoragudi57]

Your channel is highly underrated! Keep up the good work

[@BeABetterDev]

Thank you phani!!!

[@saptarshiganguly1683]

I'm binge watching your videos, please keep them coming!

[@BeABetterDev]

Thank you so much Saptarashi and welcome to the channel!

[@CarlitosVJ1]

Great content! Thank you so much!

[@BeABetterDev]

You're very welcome Carlos!

[@praneeth0820]

You're just awsome man !!! great content !!

[@BeABetterDev]

Thank you so much for your kind words.

[@KimcheeOnATaco]

Super helpful and clear!

[@BeABetterDev]

Glad it was helpful!

[@tahasaleh4697]

Awesome video!

[@BeABetterDev]

Thanks Taha! Glad you enjoyed!

[@deshdeepakdhobi352]

Great one sir,,,, mazza aaigawa

[@ViniciusFeitosa]

Awesome video. thanks

[@BeABetterDev]

You're very welcome Vinicius!

[@sunilc8684]

Good Explanation 👍

[@BeABetterDev]

Thank you!

[@LocuraRosa987]

Your videos are just wonderful! Thank you very much

[@BeABetterDev]

Thank you so much Lea for your kind words! I am glad you enjoyed!

[@acejake7500]

i guess Im asking the wrong place but does anyone know a trick to get back into an instagram account?? I was stupid forgot my account password. I would appreciate any assistance you can give me.

[@remingtontanner5004]

@Ace Jake instablaster :)

[@acejake7500]

@Remington Tanner thanks for your reply. I got to the site on google and im waiting for the hacking stuff atm. Takes a while so I will reply here later with my results.

[@acejake7500]

@Remington Tanner it did the trick and I actually got access to my account again. I am so happy:D Thanks so much you saved my ass :D

[@jmj123]

Good one , thank u

[@BeABetterDev]

Glad you liked it!

[@keplerk]

Now im fixing things i didn't knew i could have to fix xD Thanks :D

[@BeABetterDev]

Sorry, not sorry! Hahaha

[@Overthought7]

I was hoping to understand provisioned concurrency vs reserved concurrency. You didn't mention provisioned concurrency, but you explained reserved concurrency so well that I can understand the AWS doc now. Thanks!

[@BeABetterDev]

Hi there! Check out my more recent video on cold start + provisioned concurrency. It may help understand the concepts more. Cheers!

[@chandra4996]

Very Nice video

[@BeABetterDev]

Thank you!

[@azithral4057]

Could you please explain what provisioned concurrency is and how is it different from reserved concurrency?

[@easyappsmarketingestudio2408]

Best Regards From Mexico City. Manuel Silva

[@seethablegalzoom]

Excellent Explanation! , Could you do a video on Lambda Cold Start Issues

[@BeABetterDev]

Hi Ram, thanks for the comment. A video on cold start is coming soon!

[@seethablegalzoom]

@@BeABetterDev Appreciate it!

[@majorcemp3612]

Can you send the link of your video on cold Start I cannot find it, else can you share a good link about it pleas 😊 also with all the updates of aws is there still cold start issues ? 🙃

[@igoralves1]

thanks

[@BeABetterDev]

You're welcome!

[@ayushigupta542]

Hi, Great video! Could you please help with this - I manually throttled the lambda and uploaded some files to s3 bucket. We have one SNS topic for S3 event source which then invokes lambda. When I unthrottle the lambda by changing the concurrency back to default one, all the throttled events are lost. Even after changing the SNS retry policy, there aren't nay retries happening.

[@BeABetterDev]

Hi Ayushi, When SNS encounters throttles from Lambda, it will retry 3 times immediately without delay. If it still can't succeed, it will keep retrying for a long period of time (23 days). You can see more about the retry counts at this link in the chart near the top of the page: docs.aws.amazon.com/sns/latest/dg/sns-message-delivery-retries.html For reasons like this, its usually a good idea to use SNS -> SQS -> Lambda instead of SNS -> Lambda directly. It gives you more visibility into the messages (all messages will get delivered to your queue no matter what) so there is less confusion when situations like yours arise. Hope this helps Daniel

[@ayushigupta542]

Thanks @@BeABetterDev , it is really helpful. I will use SQS to prevent the loss of events or avoid this kind of confusion.

[@ravindrabhatt]

You havent mentioned about Provisioned limit

[@jayspduarte]

very good content!

[@BeABetterDev]

Thanks so much!

[@Vector3Gaming]

Reserved concurrency can breach the limit of the overall quota for a region I believe right? E.g. you can give a function a reserved concurrency value of 2000 and another function a reserved concurrency value of 3000 and that's perfectly acceptable even without ever having asked for a limit increase right? Of course there can still be throttling in this case but it would significantly reduce chances of throttling to set the value to a very large amount

[@devgenesis6436]

We have around 600-700 lambas running multiple projects..what is the max unreserved cocurrency we can increase is it the best approach for us..as other two solutions are hard to setup for all of em

[@BeABetterDev]

Hi Vikas, by default it is 1000. I believe you can increase it much further if you request a support ticket.

[@as_wani]

Nice content! Just one question, if we want to increase the limit from 1000 to 2000 for 'Unreserved Account Concurrency' , AWS is going to charge extra amount for it or it is free?

[@BeABetterDev]

Totally free!

[@jamesonji]

Limit increase is free, if you invoker more Lambda functions you will pay more anyways.

[@mhoskins555]

Hi all, I'm trying to intentionally throttle my Lambda so that it doesn't call a third-party API more than 500 times per second. Anyone have an idea how to do that? The cheapest solution I've found so far is to set up a token bucket in dynamoDB, but it feels like overkill. This video is about concurrency, but limiting that is no good since that doesn't have anything to do with a timespan.

[@BeABetterDev]

Hi there, Have you looked into toying with Lambda's 'concurrency' setting? This allows you as the user to specify the amount of concurrent requests your lambda processes. You can do some quick math based on your processing speed to figure out the right value. I.e. if you set your concurrency to 2, and each invocation is 100ms each, you would process 20 events / second. Hope this helps.

[@robinhfr]

@@BeABetterDev Hello, I have the same issue. If I limit to 1 concurrency, my call will be throttles. Could I use an SQS to store all my calls and execute them one by one on another lambda?

[@sebpatu]

Hi sorry i think your wrong about SQS Lambda error handling, it is documented it will do an exponential backoff retries. if im not wrong.

[@hl2betafan]

somehow im wondering why people have lambda in their pfp

[@willcraig5406]

bro read word for word to a website

[@deshdeepakdhobi352]

Great one sir,,,, mazza aaigawa