How I deploy serverless containers for free

Build a Python Flask app for removing the background from images, containerize it with Docker, then deploy it with serverless cloud tools.
Watch Docker 101 • 100+ Docker Concepts y...
Source Code github.com/cod...

[@SterenTV]

Cloud Run product lead here. Big fan of Fireship. Glad Cloud Run is your go to for serverless containers.

[@geshanm]

Cloud run is the best 👌

[@oskrm]

Cloud Run is a great product

[@2footedOffsideTackle]

I have a cloudbuild.yaml template where the name of the artifact is all that is needed. This is usually set up with cloud build with a trigger in GitHub, and all it takes is a push to the master and walk away for a minute or two. Lord knows how many flask apps I have deployed. Good to see Cloud Run getting recognition.

[@BenPettis]

Cloud Run has been the least terrible contianer environment I've worked with out of all the major cloud providers. 10/10 would recommend😊

[@Funcijej]

@@Zeegonerwhy?

[@ProgrammingWIthRiley]

Absolutely correct. Cloud run is a well hidden gem in the serverless world. It uses knative under the hood to scale the services.

[@user72974]

Slight correction... It supports the Knative API for deploying (and exporting a Knative version of an app you've previously deployed) but it's its own proprietary technology under the hood that implements the Knative API (scaling etc).

[@DryBones111]

​@@user72974yep. The one problem with Google is that they don't dogfood. Everything they offer externally is a different flavour of their internal tool.

[@urmet]

afaik under the hood cloud run v2 runs on borg. the internal google conainer orchestrator

[@carpye]

honestly better explained than tutorials made for Google run

[@carguy-xv2cl]

This made more sense than a hour long video i watched about cloud run.

[@notjin2109]

crazy how i literally JUST learned about ECS, SAM, and Fargate is crazy. ur never fail to summarize things so well

[@prathamshenoy9840]

deployment products, pricing etc are such a mess to me. can't believe he taught an easy way in a small video

[@paulogodinho3275]

Amazing video! Next time I suggest using 'python-slim' image or even 'alpine' and install python during build, in the video you ended up with a 2.5gb image and inherited a lot of CVEs too. Thank you for such great content

[@jskksjjskksj]

The alpine base image has some missing system dependencies that you need for some Python packages. It'd be better to go with the python-slim image instead in most cases if you don't need to install Python yourself and customize exactly what you require..

[@computerfan1079]

Was about to say that.

[@101br03k]

can confirm that apline does not work, but slim does work, for me the image went from 2.01 to 1.19, wich is still quite big, but is is an improvement.

[@georgehelyar]

Ubuntu chiseled might be another alternative slim image that still uses glibc. I know there's a LLM in here but gigabytes of base image is insane and will have a big impact on cold start times. Even Windows has a nano server image that is smaller than that, and if Windows is beating you then you're doing something wrong.

[@GreatTaiwan]

@@jskksjjskksjit’s always better to customize and understand exactly what your image got

[@ARKGAMING]

Didn't know docker even sponsored anyone

[@adissentingopinion848]

Well it plainly worked because my embedded hardware ass actually learned stuff from that video.

[@fayenotfaye]

They don’t even need to ngl

[@carlosmspk]

I think it's recent, not sure why, but they might be cooking something for the future?

[@sobbski2672]

Must be fans

[@GreatTaiwan]

@@carlosmspkPodman

[@tajkirkpatrick5972]

The docker tag made me tear. Wishing you the best fireship! Thanks for another great video.

[@theoneblackmage666]

This is freaking cool, and I'd love to set up this app to use... Thanks for sharing the source code! I'm no coding expert, so I really appreciate these videos to see how to apply some of the concepts. Also, I used the "Certification" from the Docker 101 video on LinkedIn as a troll and to share your video because it was so good. It was funny how some people didn't read the comments (or the image) and took it seriously. 🤣

[@andrewchang7194]

Love Cloud Run. I’m an ML engineer so I run a lot of backend services that need to be called for simple tasks when serving models and running real-time ML inference workloads. I opt for GKE when building public APIs for model inference, because I need to be able to have containers with GPU’s configured, but for CPU-only workloads, cloud run is phenomenal. Serverless is fantastic for ML in general

[@robosergTV]

why not use VertexAI inference? No GKE needed

[@mirceanton]

I was ~yesterday years old when I learned there's now this feature in paint to simply remove backgrounds with the click of a button - and it's fairly decent. That's what I've been using lately

[@paulosouza449]

Tf? they don't even have layers yet but have a feature like this?

[@CaioAletroca]

Welp, it's true, and now it also has layers

[@kipchickensout]

plus support for transparency for the layers, refreshed UI, Cocreator, but sadly the fullscreen button doesn't do complete fullscreen anymore

[@tx7300]

@@paulosouza449 history of modern computing: they keep adding more and more abstracted magic while the fundamental features keep getting forgotten into the past and fading away from newer applications. until one day your only interface with a computer is a text/speech/visual/thought prompt and then we will realize this makes computers unusable compared to before

[@nijigaharaTV]

@@paulosouza449What do you mean no layers?

[@RobertMcGovernTarasis]

Had never heard of Cloud Run, so thats a win for them right there.

[@amoenus_dev]

Would love to see your explorations around kuberenetes. Especially for a smaller scale projects and local development

[@6Sloth9]

You should do a full course on docker. That'd awesome

[@user-ii7xc1ry3x]

Finally a new PRO Course! YESH!

[@thinhlpg]

Thanks, Fireship! I've got one up and running using your code. Also spotted the 'hi mom' in the video. Good to see you're hanging in there and moving forward 🤗

[@Nick-tv5pu]

I've only "hit the bell button" for two channels in my entire life... Fireship, snd beyond. Fucking love your videos

[@nothiiiiiiiing]

yes new fireship

[@anthonying]

yes new 🔥🚢

[@tx7300]

why is this so unnecessarily complicated why cant you just drag and drop a docker image and bind a custom domain and click run

[@WolfrostWasTaken]

Because they are different tools, Docker CLI is not GCloud CLI. It is impossible to authenticate and do customization with your method... honestly it's very easy just open the terminal and run 2 maybe 3 commands. It's not that hard, try it.

[@ShaferHart]

Then AI does it and you guys complained about me jobs.

[@hanes2]

How else companies like vercel gonna make money lol

[@mythicXD]

@@hanes2😅😂😂

[@Albanus15]

Ok this can be a side project idea

[@luiggitello8546]

This is my favorite video so far, will defined give it a try. Never used docker before

[@lolidkstudio]

you can literally google images and filter -> color: transparent

[@zmeireles68]

That's awesome! Waiting for you Stripe full course.

[@alaasabry-v6d]

Постоянно использую ваши советы. В основном остаюсь в плюсе.

[@adiorthotos]

So much simpler than serving it locally! /s

[@ElCerdoBlanco]

Long story short: stay within the free tiers of your cloud providers. 🤯

[@SirDamatoIII]

Love the Rube Goldberg reference!

[@rajeav8685]

Dude made me watch the whole ad without me realizing it

[@tombyrer1808]

It has been 0 days since Fireship mentioned AI ;)

[@dsfs17987]

we gonna need a docker counter soon as well

[@moveonvillain1080]

​@@dsfs17987Podman

[@blalmal10a]

@@dsfs17987 i lose count to svelte, can someone update pls?

[@rodiaz2709]

Unsponsored videos are such much better, They feel natural and more interesting. Thank you.

[@OfferREI]

Looking forward to your Stripe course!

[@cheesebusiness]

I don’t recommend AWS ECS for this, because it requires you to complicate your cloud architecture to simply have a static IP for the container

[@tajammulrizvi9504]

Fantastic pace and really concise explanation of how to get an App into the Cloud.

[@9s-l-s9]

Is there a danger of getting a $100000 bill if your app goes viral? 🤔

[@christospapaharalabous]

Welcome to the cloud. The answer is unfortunately yes

[@brighamdent310]

Depends how you set things up. You can set limits and stuff.

[@b.6603]

The "reduce number of instances to 3" part is VERY important

[@vitvitvitvitvitvitvitvit]

hobby dev nightmare

[@rohitkharche7562]

If Maning cloud run feels tough for someone they can also use Cloud Deploy, just the great tool

[@addDexter]

almost tought that i needed this tool

[@Simple_OG]

Bro I am addicted to your videos I am not able to code or do anything just watching your videos all days 🗣️

[@Zamai]

Was thinking ... is it possible to bundle this python library into WASM module and put the whole thing into webpage? Or the big download of the weights file would make it impractical ?

[@aymansyam6933]

About cloud run CPU allocation, you forgot to mention an important thing: always-allocated CPU is a huge advantage over CPU allocated during request processing because it will process background threads with the same power, where in during request processing, any process not on the main thread will have a basically non-existent CPU allocation and will take forever to process

[@ghostlexly]

Is it same for bullmq from nodejs ?

[@deryazzi]

Hilarious thumbnail 😂 especially after two weeks of wrestling with ECS to deploy Datahub

[@adammrazek]

Thank you for tutorial! I just came across an issue that building docker image locally on ARM (M1, M2 apple) will result in incompatible image and will get error like "is not ready and cannot serve traffic. The user-provided container failed to start and listen on the port defined provided by the PORT=8080 environment variable" - just rebuild your image using "docker buildx build --platform linux/amd64 -t ." and all is good then.

[@jerseyse410]

Hahahaha, good call on the url, was totally going to try it

[@giswong]

is it actually free? I think gcloud is not.

[@AgsBud]

Hes becoming self aware.

[@malle1544]

We're actually offended that you think we are going to try to abuse your url. 😢

[@Eghizio]

I've created the same thing for cropping memes couple years ago. It also uses Flask backend with some opencv magic, and a simple JS upload like in the video as the client 😄

[@-uz]

love this video, would love more like this

[@nickwoodward819]

keep the stripe updates coming - will 100% sub once released!

[@shmuelsigler2918]

Fun fact: in hebrew the word 'docker' means 'to stab'. Realy.

[@shapelessed]

Jesus christ, flask. The tool that made the world's worst language popular...

[@akuoko_konadu]

Thanks, short but useful

[@dclstn]

surely you can make a plugin for your editor

[@Ethel173]

plugin vs flex points flex points wins apparently

[@beyondfireship]

I've looked into it. Adobe premiere plugin development is pretty painful and trying to bridge in Python did not feel worth it, but I would buy that plugin.

[@davi-alves]

“I’m serious and don’t call me Shirley”

[@thomas_w]

For me it didnt work when i just tagged it with the copied url, i had to append /[local-tag], then it worked

[@vandalizmo]

thx! same here

[@jonathancowling393]

6:04 damn there go my plans for the rest of the day

[@vinayaksonawane5325]

I also fed up and made my own 10 micro services in onw website for personal use like image scrapping, video grabber, voice and music separation etc.

[@DanielDogeanu]

OMG, Jeff, please do a video about Coolify! I beg you! This is the perfect use case! It's open source, it's built by a single guy, and it's absolutely magic! You must absolutely try it! I promise it will change everything after you do!

[@4115steve]

I'd liketo see a full tutorial series on google cloud my man

[@ТомашШубарић]

ah, back when fireship made good videos

[@ShangXiLao]

Видео - огонь🔥Спасибо, классно!

[@MrBrax]

There's no such thing as serverless

[@yaaaayeet745]

wait! what?

[@pdcx]

you know serverless means the dev user not having to manage the servers right?

[@MrBrax]

@@pdcx then there's a server, you can't call it serverless

[@pdcx]

@@MrBrax its a misnomer. but it is used in this sense. you can disagree but big tech companies keep using it 24/7.

[@ShaferHart]

r/im14andthisisdeep

[@nooraldeen6637]

Awesome! Can you share something similar for ecs fargate next?

[@zilla982]

perfect port number

[@sharakpl]

I'm so gonna watch this many more times 🤓

[@re.liable]

Docker really is so good. Unfortunately for me local development with it is a bit hard... It takes up a lot of RAM and storage

[@vitvitvitvitvitvitvitvit]

I think docker is more used to share your enviroment with the team. For example, I share my backend environment so the frontend dev can test the requests without setup the backend. unfortunately, where I work I do the both, so I don't use docker since in some point it will use all my ssd storage

[@justine_chang39]

i too have my API dockerized and hosted on GCP Cloud Run

[@MrVermont]

And Kamal is the new cool kid on the block that allows you orchestrate Docker deployment to your own private servers. Made by the same people that pioneered Ruby on Rails.

[@pranavdeshpande4942]

You are so smart!

[@TheLime1]

got the notification from github hehehe

[@interesting_stuffs]

The configuration shown in the video is free in gcloud? 3 instances with 2gb mem?

[@Sammysapphira]

I guess I'm just confused how it determines when it needs to spin up more instances or not. How does it know when the load on a single instance is high enough to open another one?

[@VaibhavShewale]

ooh man i never thought of running bg remover like this, i alwas update the package and many times reinstall it to to do this!

[@valtterihuhdankoski909]

Mang this shit is gold! Keep it up 💪

[@schizolab]

>you people wat you mean YOU PEOPLE mann

[@chase14000]

- yaps “from scratch” multiple times - see inside - pulled a model from someone else’s github repo

[@nihalshafi5106]

awesome invention

[@Santosh_Adhikari_45]

Thank you for your invention😆😆

[@absint0o]

What about transformerJS? I think there’s a way of doing the same thing with all done on the client side…great video btw, I really like your videos about AI, really funny!

[@lordosouls]

What a CHAD

[@reza2kn]

@03:32 A fellow man of culture, I see! 😎

[@UvekProblem]

Bigup podman

[@trueberryless]

It's not Gigabyte, it's clearly Gibibyte...

[@ayoubachak01]

The A word is wild 💀

[@SamOdiagbe]

did you create the stripe course yet?

[@SxAde]

Will the Stripe course be updated for the users who have already bought the old one?

[@ismbks]

podman > docker

[@alisalloum629]

Very useful thank you

[@bruceclark406]

But how do I remove the background from my docker image?? 🤔

[@sikor02]

what about ddos attacks? if you have autoscaling enabled? will that make you go bankrupt?

[@gregtasi]

Exactly what I wanted to ask! This is basically unusable if that's the case.

[@Jakub1989YTb]

1:20 just admit it already :D

[@avienxyz]

There is an error in the docker tag command you have to use artifact url+image_name(it can be different from local tag) and then push it using push command otherwise you will get error.

[@superJerrySong]

for a frontend developer that's is rocket science 😅😅

[@jofla]

You dont need ecs to deploy a docker continer in aws! You can upload the image to a ECR and then deploy the lambda based on the image... Just like in GCP. I think your video is a little misleading, no hate tho

[@seansingh4421]

I had nothing but issues with docker. Can’t we just make something better ? At this point I would rather use npm baremetal than to screw with docker

[@LBC_squared]

Flask is so freaking easy it's like hilarious

[@jesteriruka4215]

Cloud is so cheap that you don't even need to hide the URL of the app, amazing!!!

[@shateq]

Dude it is 1 am

[@shateq]

Instead of sleeping im deploying a container rn

[@paryska991]

@@shateq dedication, these US timezones really fuck up my sleep schedule

[@wondays654]

Ah now I can save $500,000,000 on my new start up that will probably fail in 5 months.

[@ce9916]

Mentioning Fireship Pro without linking to it is so passive-aggressive

[@tutacat]

Run your own cloud on your computer...

[@isidorenwaiwu2793]

Where will the stripr course be hosted. I am very much interested in this. Thanks....🙏

[@innoberger1632]

I typed the app url into my browser just to find out it's not hosted anylonger :(

[@diegocolli86]

Great video dude, i just found a quick nice way to let me shit run