How to Run a Python Docker Image on AWS Lambda

[@sweetymjct]

You are brilliant!! Following your steps, I deployed several Python apps to AWS Lambda. Your instructions were clear, code was perfect (worked fine without any changes) and explanations were precise. Very rare in free KZbin tutorials. Thank you.

[@pixegami]

That's awesome feedback. Thanks for sharing that! Glad it was useful for you.

[@tangled55]

Dude, I cannot tell you how AMAZING you are and how AMAZING this video is. I could literally hug you through the screen. Thank you so much for your video man. It was a PERFECT explanation.

[@pixegami]

Thank you! I'm glad it was helpful.

[@alphasauroxviix4235]

Thank you for putting so much effort into this video, the quality is just magnificent. Your channel is super underrated, I hope you get the recognition that you deserve soon.

[@pixegami]

Thank you! Really glad to hear you enjoyed this :)

[@visheshmp]

How do you even know what we want? Short simple to the point explanation. Thank you so much. Please keep creating such amazing videos!

[@pixegami]

Thank you, I appreciate your comment, and I'm glad you enjoyed it!

[@ttaylor9916]

Thanks!

[@pixegami]

No worries! Glad you found it helpful!

[@eb8931]

Fantastic video. It covered so much (CDK, Docker, Lambda) in just 13 minutes. And it actually all works really easily. My first interaction with lambda was a few years ago and decided I would never, ever touch it. But after this video, with CDK and the other progress since then, I am reconsidering moving my workflows over to lambda instead of FastAPI. Pretty much all because of watching this video.

[@pixegami]

Thank you! I really appreciate this kind of feedback, and honestly it's hearing things like this that motivate me to make this content. I hope that project all goes well for you!

[@immanuelpeter1579]

What if we want to use env variables? Where would we place them and how can we retrieve them in the py file?

[@terryyyzhang]

Thanks. It could be more helpful if you walk through the permission setting in IAM, as I end up spending an hour configuring that during bootstrapping as a newbie.

[@pixegami]

Ah I see, thanks for sharing that. IAM is one of those things that I often forget can sometimes be very challenging unless you've used it before. Noted for next time!

[@hamishrobertson946]

fyi for me these issues popped up around the 943 mark (Deploy to AWS). Assuming you are running as a managed user you'll need to add the appropriate policies to your IAM group as 'Permission denied' starts popping up each time you run cdk deploy/bootstrap. I had to add stuff like AmazonS3FullAccess and AmazonSSMFullAccess

[@champikadilshan5920]

Perfect! This video is brilliant, If anyone need to Run a Python Docker Image on AWS Lambda. Check this, You will definitely able to solve your issue

[@pixegami]

Glad it was useful!

[@taylormonacelli]

Straight to the point and thorough, very nice job. Super helpful, thank you!

[@JosephNOMO-m4n]

I'm very thankful for this video. I really struggle with GUI tools like websites. This command line interface solution really helped me to ship and urgent work I was struggling to configure on aws web interface. Thank you for your work.

[@pixegami]

Glad it helped!

[@prajganesh]

Great explanation. What are ways you can pass parameters to the container?

[@pixegami]

Thank you! Well, it depends on what kind of parameters you'd like to pass. Environment variables are probably an obvious and easy way to get started. You could also potentially modify/override the "command" or the "entry point" it is executed with.

[@ethananthony7419]

Excellent, well articulated and easy to follow instructions. Thanks!

[@pixegami]

Thanks! Really glad you found it easy to follow. That's always the goal! 😊

[@KillianTattan]

Great video, thank you! Wondering how this would work if using poetry instead of requirements.txt? I've seen a lot of different answers on SO and yotube.

[@Randomize-md3bt]

I came here after trying to install my libraries to my python lambda function and it give up so I am trying to upload it as a docker image

[@pixegami]

Yup, uploading a library with Python *without* Docker is surprisingly difficult, especially if you want to use libraries that have an OS-dependent library under the hood (which includes AI/ML libraries, numpy, and more). That's why the Docker way is really good to know :)

[@crabmeat88]

Is there anything extra I have to do to get environment variables working with this setup?

[@pixegami]

You should be able to apply environment variables via the CDK construct for Lambda. See the `environment` parameter: docs.aws.amazon.com/cdk/api/v2/docs/aws-cdk-lib.aws_lambda.Function.html

[@saml.8295]

I follow your steps and faild to build on the RUN pip install ... I commented it out and can build the image. What it take to get pip command to work? I use Windows 10 and curl command (in PowerShell) does not work with the URL. What's the ../2015-03-03/... for?

[@pixegami]

Hmm, what error do you see when you try to run pip install?

[@mohamedabdo-xg6tw]

@@pixegami I built my image, it runs with no errors but when I do Curl nothing happens. so, as saml asked, what ../2015/... stands for? or where it comes from?

[@kepitingtiara]

@@mohamedabdo-xg6tw , I did have same questions, here the GPT help me The 2015-03-31 represents the version of the AWS Lambda API. When you send an HTTP POST request to this endpoint, it triggers the Lambda function handler specified in your Docker container.

[@davidcasanova2951]

Thanks a lot ! Nice tutorial. Do you plan to make a video tutorial for a larger project, such as building a full-stack website or something similar ?

[@dchenk]

Just use docker-compose for this.

[@pixegami]

Thanks! I do plan some in the coming months, but right now I'm just trying to build a base of smaller videos (like this one) to cover all the basic tools first :)

[@ueiwqoak]

@@pixegami bump on @davidcasanova2951 's request. Fantastic video

[@volodymyrtruba7016]

Fantastic video! However, how do we handle logic that takes more than 3 seconds to execute, considering Discord messages have a 3-second limit?

[@k3chang]

Thank you so much for the video. Very clear. I have 1 question - the path you're using for all this, is it on your local machine? or is it via aws cli on the aws box, given the ?

[@pixegami]

Yeah, great question! The path I'm using is actually on my local machine. The 'ap-southeast-2' you see is just specifying the AWS region I'm deploying to using the AWS CLI and CDK. All the development and commands are run locally, then deployed to AWS.

[@jaxontn]

Hii can you make a new video for Docker Python API deployment?

[@jeffwoolfe]

Great video! When creating the CDK project why do you choose typescript as your language and not python? When I choose python as the language the lib folder is created in the venv folder.

[@pixegami]

I tried Python before and I'm not sure I like the experience as much as Typescript. CDK is natively developed in Typescript, so I feel it makes the quality of code hinting better, error messages easier to read (without all the JSII stuff they used to translate it to Python) and most importantly, it has the largest example base online and in tools like GPT.

[@igortrindade-dev]

Thank you for sharing this! It saves me a lot of time trying to create a bunch of layers to execute some heavy deps functions on AWS Lambda 🤯🙏

[@pixegami]

You're welcome! I'm glad to hear it helped :)

[@erikcoding1238]

what is the terminal autocomplete feature you are using it's nice how it autocompletes for you

[@jeronimoahumada7817]

Looks like zsh-autosuggestions

[@pixegami]

Yup! Or you can use `fish` terminal and get it out of the box. I have a video on the terminal setup here: kzbin.info/www/bejne/q5jannuVrd-eeaM

[@jayanths2788]

Error saying invalid entry point i am using arm64?? Im using m2 any fixes?

[@juanfranciscoestradagonzal7826]

Does the cost of lambdas change with the use of ECR? Or is there any additional cost generated by using ECR?

[@pixegami]

ECR cost would be billed separately to Lambda. I think ECR also has a free tier? aws.amazon.com/ecr/pricing/

[@rexthundathil3828]

Is it possible to deploy docker image using terraform? If so, can you do a video on this please?

[@pixegami]

I'm gonna guess it's possible, but I haven't used Terraform before. I'll add it to my list to check out!

[@bengoudifaoussama7020]

hello thank you for your video , i have a small question , in my lamda function i have some api keys ,how to do the .env config in aws with docker

[@techaisolution]

Hi, this setup spike my billing very high, The setup was to build lambda function to read the latest file from the s3 dir and make transformation then finally to s3 target dir, So this all setup with the python script has to run once the s3 notification to lambda function that an file just came to s3. But it went into a loop and made the s3 and lambda billing spike Let me knew what is the issue in my setup that i didn't noticed at first while running this python script in lambda

[@pixegami]

Uh oh. It sounds like you have a recursive Lambda function. I guess after you update the S3 file, it probably triggers another event (which triggers the function) in a loop. Normally, if you want to trigger Lambda from an S3 event, I wouldn't recommend to update/write back into the same S3 - maybe just use a different bucket for the output. For the billing spike, you can create a ticket to AWS support to explain the mistake, and see if they'll be able to give you a refund on the cost (it usually works if it's the first time you are making an honest mistake).

[@Sudeep-ow4pe]

Do I need to install docker desktop on my machine.

[@pixegami]

Nope, I don't think you need Docker Desktop specifically. You just need the Docker CLI, which comes with Docker Engine. If you're on Linux, you can install Docker Engine directly. For Mac or Windows, Docker Desktop is an easy way to get everything set up, but it's not strictly necessary if you prefer a lighter installation.

[@AvakashKumarSahoo]

does not work for me, my curl command gets stuck without any response

[@pixegami]

Have you run the container successfully? Do you see any output from the container terminal?

[@beratgenc7695]

This is perfect! Great work, thanks!!!

[@pixegami]

Glad it was useful, thank you!

[@claudiolaas456]

Would this setup also work to deploy a streamlit app? Or is it only for request-response type apps?

[@pixegami]

Ah, I don't think it works well for Streamlit. Streamlit relies on a session and an active connection with the user, but Lambda doesn't really do that. But stay tuned, I'm also working on a tutorial for deploying Streamlit with Docker to AWS as well.

[@eugenechua7239]

I don't quite get the part on LAMBA_TASK_ROOT? is it an environment variable that u need to set up when u first create the lambda function? the video doesn't seem to cover it..

[@pixegami]

Hey there! Good catch on the LAMBDA_TASK_ROOT. It's actually an environment variable that AWS Lambda automatically sets for you - you don't need to create it yourself. It represents the directory where your Lambda function code is stored in the execution environment. In the Dockerfile, we use it to make sure we're copying files to the right place. If you want to dive deeper, check out the AWS docs on Lambda environment variables: docs.aws.amazon.com/lambda/latest/dg/configuration-envvars.html Let me know if you have any other questions!

[@ttaylor9916]

LIke all the other comments ... brilliant. worked for me.

[@pixegami]

Thanks! Really glad to hear it worked out for you too!

[@Acumen928]

omg exactly what i needed thanks so much!!

[@pixegami]

You're welcome!

[@mohsinhassan88]

I followed your guide to the letter, but when i try to test the docker build locally with curl i always get "Empty reply from server" Any ideas?

[@mohsinhassan88]

figured it out difference was im using windows and the command is different for that. invoke-WebRequest -Uri "localhost:9000/2015-03-31/functions/function/invocations" -Method Post -Body '{}' -ContentType "application/json"

[@andreaizquierdobouldstridg2926]

Trying your tutorial on windows, prompted the error: 'curl: (52) Empty reply from server'. Any help will be apreciated!

[@pixegami]

Is this for when you are testing it locally? What about the Lambda docker output itself? In the terminal where you are running the image locally, do you see any messages?

[@therydn784]

This is was so helpful! Thank you so much!

[@pixegami]

You're welcome! So glad it was helpful for you!

[@RatherBeCancelledThanHandled]

Solution : on M chip Mac : change credstore from desktop to osxkeychain , use sudo nano ~/.docker/config.json Thanks for sharing but I’m getting the error ERROR: failed to solve: public.ecr.aws/lambda/python:3.11: error getting credentials - err: exit status 1, out: ``. Can you please advise a solution ?

[@pixegami]

Hmm, sounds like a permissions issue. I recommend checking how you are setting up your AWS credentials for this. AWS goes through a series of steps to try and determine your credentials: docs.aws.amazon.com/sdkref/latest/guide/standardized-credentials.html#credentialProviderChain

[@muustafa]

thanks for tutorial. What is your terminal that suggest commands?

[@pixegami]

I use fish terminal. See this video for my Mac terminal setup: kzbin.info/www/bejne/q5jannuVrd-eeaM

[@VishwamTalnikar]

how to add vpc related code?

[@pixegami]

Yeah, adding VPC configuration wasn't covered in this tutorial. But you can definitely do it! In the CDK, you'd use the 'vpc' property when defining your Lambda function. Something like: ```python lambda_function = lambda_.Function(self, "MyFunction", ... vpc=ec2.Vpc.from_lookup(self, "VPC", vpc_id="your-vpc-id"), ... ) ``` Check out the AWS CDK docs for more details: docs.aws.amazon.com/cdk/api/v2/docs/aws-construct-library.html#aws-lambda

[@VishwamTalnikar]

@@pixegami 👍

[@praveenpoonja95]

Amazing. I'm facing an issue in Dockerfile in "RUN pip install -r requirements.txt". when I run cdk deploy, I get Failed to build asset error. In local, it is running correctly. Any idea how to resolve this? meanwhile I commented 'RUN pip install -r requirements.txt' and returned just dummy message without numpy. This time Cdk deploy worked and the url was giving me the json response

[@pixegami]

Hmm, I think we'll need to see what the actual error is - the build could fail for a variety of different reasons.

[@jesuschacon7028]

i have a problems with CORS. In my frontend in headers response: OK but, also show CORS.

[@Acumen928]

im trying to create a docker image for a python lambda from an amplify app, how would this work for that setup?

[@pixegami]

I haven't used Amplify, but from what I understand it creates and manages the Lambda runtime for you. I'm not sure if you can extend it to support images. Let me know if you find out otherwise. That's why for more fine-grained control Iike to use AWS CDK for the infrastructure.

[@itsanishjain]

I wish real world senerios are this simple lol, I am currently using node and canvas and that's needed a lot of Os level dependies like gcc-c++ cairo-devel etc, how to cache them because everytime I make changes I need to build docker image again and that is taking too much time

[@pixegami]

Well, tutorials and examples are always going to be a simpler cleaner version of real world problems which does have its own challenges :) But your problem does have a solution. Docker builds images in layers, so anything you want to update/change, just put them in a later layer (e.g. lower in the Dockerfile) so it doesn't have to rebuild everything up until that point. That way it'll just re-build your changes into the image without having to go through the dependencies installation again. If you want to take it a step further, check out using GitHub actions to automate your workflow and deployment (it also has caching): kzbin.info/www/bejne/b6awlIFsa9KZrac

[@BrannigansLaw21]

You've earned a sub my man.

[@aacesta]

On the pre-requisites. How to install cdk on aws 2023 linux image. sudo yum install nodejs npm sudo npm install -g aws-cdk sudo npm install -g npm@10.2.5 sudo npm install -g aws-cdk

[@aacesta]

On the pre-requisites. How to instal Docker on aws 2023 linux image. sudo yum update -y sudo yum install -y docker sudo systemctl start docker sudo systemctl enable docker sudo groupadd docker sudo usermod -aG docker $USER docker version

[@pixegami]

Thanks for sharing this!

[@aacesta]

After the above you may also have to restart your machine before commands such as docker ps or similar can succeed in connecting to the daemon.

[@__sjduebsj]

Great video! Thanks :)

[@anaves]

wow! Excelent video. Thanks so much!

[@pixegami]

You're welcome!

[@JasperRowan-v3n]

Thank you, gained a sub.

[@pixegami]

Thank you :)

[@frkael8255]

New skill added to my resume, thank you so much :D

[@pixegami]

Congrats! Well done :)

[@TC-gz1ko]

Dumb question, what terminal are you using?

[@CloudScience-z4l]

I absolutely needed this bro. Thank you so much. +1 follow

[@pixegami]

Thank you! Glad it helped :)

[@EricFlores-z7m]

Great. thank you

[@pixegami]

No worries!

[@spare4337]

THANKS

[@pixegami]

You're welcome!

[@jeromedormoy6955]

king

[@liferecordsin]

It's not python it's typescript

[@pixegami]

The Docker image is a Python app. If you mean the CDK - yes that's Typescript. You can use Python for it too, but I generally go with Typescript since it's the 'native' language for CDK.

[@awshima]

I`m always getting a 404 back from the http call. The files are in the /var/task folder: sh-4.2# pwd /var/task sh-4.2# ls main.py requirements.txt sh-4.2# cat main.py import numpy as np def handler(event, context): arr = np.random.randint(0, 10, (3, 3)) return { 'statusCode': 200, 'body': {"message": "Hello from Lambda!", "array": arr.tolist()} } Using python inside the container, the function is working fine: sh-4.2# python -c "from main import handler; print(handler({}, {}))" {'statusCode': 200, 'body': {'message': 'Hello from Lambda!', 'array': [[3, 2, 8], [3, 7, 7], [1, 8, 3]]}} Logs for the container was showing this: 2024-09-01 18:56:19 01 Sep 2024 21:56:19,033 [INFO] (rapid) exec '/var/runtime/bootstrap' (cwd=/var/task, handler=) Addet this to the Dockerfile since "handler" in the log was empty: ENTRYPOINT ["/usr/local/bin/aws-lambda-rie", "python3", "-m", "awslambdaric"] Now Logs show this: 2024-09-01 18:58:25 01 Sep 2024 21:58:25,802 [INFO] (rapid) exec 'python3' (cwd=/var/task, handler=main.handler) But the result is the same: curl -X POST "localhost:9000/2015-03-31/functions/invocations" -d '{}' 404 page not found It looks like the AWS RIE is not calling the main.py function. What can be wrong?

[@awshima]

Man... "localhost:9000/2015-03-31/functions/function/invocations" (missing a "function" path). Solved.

[@DeepakKumar-nl5jr]

Nice video. Thanks @pixegami

[@pixegami]

Thank you!