How to create a great dev environment with Docker

How to create a great local Python development environment with Docker. Learn about Docker Volumes, Docker Compose, how to debug in containers, and more.
Repo: github.com/patrickloeber/pyth...
Timeline:
00:00 - Introduction
02:03 - Why Docker?
04:02 - Dockerize an app
10:25 - Immediate file changes (Docker volumes)
13:08 - Use IDE in Docker container
17:38 - Docker Compose
25:54 - Debug inside Docker container
Get my Free NumPy Handbook:
www.python-engineer.com/numpy...
✅ Write cleaner code with Sourcery, instant refactoring suggestions in VS Code & PyCharm: sourcery.ai/?... *
⭐ Join Our Discord : / discord
📓 ML Notebooks available on Patreon:
/ patrickloeber
If you enjoyed this video, please subscribe to the channel:
▶️ : / @patloeber
~~~~~~~~~~~~~~~ CONNECT ~~~~~~~~~~~~~~~
🖥️ Website: www.python-engineer.com
🐦 Twitter - / patloeber
✉️ Newsletter - www.python-engineer.com/newsl...
📸 Instagram - / patloeber
🦾 Discord: / discord
▶️ Subscribe: / @patloeber
~~~~~~~~~~~~~~ SUPPORT ME ~~~~~~~~~~~~~~
🅿 Patreon - / patrickloeber
#Python #docker
----------------------------------------------------------------------------------------------------------
* This is an affiliate link. By clicking on it you will not have any additional costs, instead you will support me and my project. Thank you so much for the support! 🙏

[@heyydev_1]

I was just about to comment how great this video is and I saw I commented the same a year ago 😂 Thanks again. Now I'm a senior developer and these things keep been high value.

[@yaksvk]

Thank you Patrick! This was one of the clearest, straight-forward and concise introductions to Docker for people who actually do development and not just devops/admin stuff. Very helpful!

[@Javoke]

I wanna thank you for aaaaalll the videos you share with us. Me, as a non-english-native person, I appreciate the rythm and accent in your voice, so we can understand exactly what you are saying. Also,, the explanation is very clear !! Thank you so much!!!

[@heyydev_1]

Amazing explanation. Even though my native language is not English, this is the best tutorial I've found and the one that I understood the best. Thanks!

[@scriptkiddie100]

Thank you for this. Very comprehensible and through, ideal for a beginner tutorial.

[@techatival]

So far my favourite introduction to Docker. Thank you!

[@mogyiman]

Awesome content and clear presentation; special thanks for the debugger setup!

[@brendan8915]

This is the video that has finally got me over the line for using Docker. I needed to upskill this for work, my sincerest gratitudes to you. Thank you so much.

[@NileGold]

This was so simple, I didn't even realise that the video was 30 min :), thank you for this

[@dimahodan232]

best on-point video I have seen in the last few months on YT.

[@scigama71]

Superb. Thank you. This was very clean and straight to the point. Subbed.

[@tamirsalem76]

Brilliant tutorial, concise yet very complete.

[@DenisRasulev]

Thanks a lot for the great, short and to the point video with excellent explanations!

[@brandonrich4956]

Thank you! Excellent video. Easy to follow.

[@sixpooltube]

Amazing tutorial. Fast and easy to understand.

[@NavneetaSinha]

Thank You so much Patrick for this vodeo, this was the much needed video for me right now

[@ronjones1587]

This is all I need and you gave it perfectly ! Thank you very much !

[@AlexCaranha]

Good Job! Amazing tutorial, Patrick. Thanks a lot!

[@dogbusiness5201]

Thanks for the video. Just started the course on Docker so this one was extremely relevant

[@Mutombo71]

use podman instead, it is the future

[@GrayCo]

Great video and impressive understanding of the subject matter.

[@JiriPocta]

Thank you very much, simple and easy to understand.

[@UnUnkn0w]

great video, thanks! a lot of value for 30 minutes !!

[@cexploreful]

Wow i wanted to learn Docker! Thx again Patrick!

[@ujefmalek77]

आपके वीडियो सुपर कूल और अद्भुत हैं। मुझे यह बहुत पसंद आया. धन्यवाद

[@tedlazar]

Dear Patrick, thanks a lot for the great tutorial !!!

[@sabaokangan]

Thank you so much for sharing this with us ❤️‍🔥

[@jasynskyi]

Great explanation! thank you for your work

[@baopeng]

Very detailed! Cool stuff!

[@murtadha96]

Brilliant! Thank you for this video

[@chineduezeofor2481]

Excellent tutorial!

[@polydeuces01]

Great Demo I even managed to to do it on my windows machine.

[@vengtCent]

Hi Patrick, thanks for this great tutorial. Do you have any resources for setting up this environment with pycharm?

[@vadymesch2267]

Great one!❤‍🔥❤‍🔥❤‍🔥

[@AmodeusR]

Very interesting video. Although it lacks some clarifications on the docker commands, this gap could be filled by ChatGPT helping me out understand what they were exactly. Thanks for the video

[@angtranhai6457]

Very helpful sir!

[@janaeshkrish]

Nicely done 🎉

[@mohssineserraji1098]

Thank you for the amazing tuto

[@brennenherbruck8740]

Devcontainers have prebuilt configurations that are *much* simpler and gives your container superpowers with devcontainer feautres (like docker-in-docker)

[@Lexaire]

Yes, using non-dev images like he showed is an awful dev experience. Much better to use the premade ones for development, and then custom dockerfiles just for final testing and deployment.

[@madferretx]

Can you give examples of good premade dev environment? anything for javascript?

[@madferretx]

@@Lexaire Can you give good examples of premade dev environment? one for javascript? thanks

[@muxahx3096]

agreed + you can actually debug in container (use break points )

[@chriskeo392]

​@@Lexaireneed more!

[@navneetchourasiabgt]

Great content dude 😎

[@vivarantx]

thanks patrick , you are a genius!

[@MohammadMahdian888]

Awesome tutorial

[@timkochanski]

Great tutorial. Is anything additional required when docker compose yaml references multiple containers forming a network? Can I just connect to my UI container and debug through all the other referenced containers as if they were just imports and I had justmycode set to false? Or do we need to edit other container docker files... Maybe adding port 5678 for example?

[@RNikSan]

Super, thanks a lot!

[@ventin75]

exactly what i needed

[@michaelestrinone2111]

@Patric - it will be a great learning video about the same subject but geared towards C# developers with either SQL Server as a backend or MySQL etc.

[@DeathBean89]

I'm not a C# dev, but you could probably modify the Dockerfile to pull the image for the current .NET version and then RUN any commands to set up the environment. Then you could modify the docker-compose file and replace the redis service with a SQL Server or MySQL one. Forward the appropriate ports, make sure that your volumes are correct, and you should be good to go. I'm sure there are plenty of resources out there to get you going. Good luck!

[@alvarovs89]

Hi Patrick! I've been following you for a few months, and thanks for everything you share. Just a quick question, what do you use in the terminal of vs code that show you the suggested code? like autocompletion? thanks again :)

[@abdullahsaid4765]

try zsh

[@NostraDavid2]

I love the powerlevel10k wizard, that asks you which features / settings you want. Much easier than trying to customize bash until it looks like Zsh with p10k.

[@BrettKromkamp]

Great beginner tutorial. Thanks for this.

[@DanielStoehr203]

Hey Patrick, Thanks for the video. Do you know if developing inside docker Container is working With the community Edition of pycharm?

[@DanielF847]

Great tutorial and cool way to leverage containers! Have you found any methods for doing this using open-source or even source available tooling? :-/ Microsoft appears to have restricted the Docker and dev-environment extensions to their proprietary closed-source release of vscode (Microsoft visual studio code)... Great to see Microsoft back to their old tricks 😩

[@lune0409ify]

Thank you! :)

[@user-yy7el7vg8s]

Hi, Thanks for this tutorial, it's great! I would like to do the same in pycharm - but it appears that docker-based envs are a premium-only feature. Is that correct or it's possible to do the same also with the community edition of Pycharm?

[@danielk.2172]

Good tutorial! If anyone on Windows using Git bash having problems to see the reload of the local code, try mounting the volume with: -v /${PWD}:/code Apparently there is a POSIX path conversion that doesn`t convert correctly and ends up adding a ";C" at the end of the local path

[@josephrobineau1662]

you sir are a good man

[@guilhermemendes264]

Thanks bro I owe you a beer

[@budmonk2819]

Thank you brother - I almost gave up before I decided to search through the comments.

[@igorlikholat5606]

brilliant tutorial! thank you I have a question.. I’m confused with how to debug worker command inside docer container, when it possible to run in bash console only? I’m going to be glad hearing your answer)

[@recaseng]

Thank you ^^

[@datawolk]

When you build the release container for distribution, will it strip out the vs code stuff? Or do you have to do this manually or isnt that necessary?

[@FilSerge]

You need just rebuild image with code updated. That's it.

[@chikken007]

Could we also setup the debugger with the suggested "fastapi" option of VSCode?

[@FilSerge]

That is cool to have all your dev workflow as Dockerfile and to build it whenever/wherever you want. But it's such pain in the ass not to forget installing zsh shell, all vs code extensions, etc. Tried to set it all for my ml project, but failed.

[@lawrencedoliveiro9104]

7:17 Having a list of strings is a good idea. This avoids having to pass a shell command, with all the possibilities for (mis)interpretation of special characters. Instead, you pass the command-line words directly to the program, as is.

[@tt4m]

Good♥️♥️💛شكرا

[@kimsanov]

At 12:46 when we attach volume - did main.py copied inside container according to Dockerfile instruction?

[@lawrencedoliveiro9104]

2:13 A container is actually _less_ than a whole VM. It’s a complete prepackaged userland, that runs under the same Linux kernel that is already installed on your machine. It is not actually an OS on its own.

[@nguyenhieu6995]

I am quite new to docker. In the example at 21:00, there is a duplicate in command (Dockerfile and docker-compose), should it be duplicated like that or not?

[@elmarhinz3076]

In the moment of mounting the outside Volume, there should be similar code inside the container. (We know this, as we were able to run it without mounting the outside code.). I miss some words, how this conflict is solved. * What happens to the code inside the container when editing the mounted code? * Why do we copy the code at all, if we plan to mount it? * Wouldn't it make sense to throw an error message from inside, similar: "Error 501: The source volume was not mounted"? Otherwise duplicated code may lead to many mistakes by editing the wrong place. * Is there any standard or practice, how to handle this?

[@FilSerge]

> What happens to the code inside the container when editing the mounted code? it is substituted with anything new in project directory. > Why do we copy the code at all, if we plan to mount it? to be able to share it. You can commit all editing done to update the image.

[@timelschner8451]

Question: when you directly connected the IDE inside the cotainer, do you still need the mapping, since you are already in the IDE inside the container?

[@patloeber]

you probably still also want it on your machine and need a mechanism to persist the changes. But if, let's say you push your code from the container to Github, then you don't need the mapping

[@timelschner8451]

I see and thanks for the informative video!

[@haithammaged987]

thanks🤩

[@mirwek]

Interesting, you are using Fastapi. How can you debug with debugpy Flask application in docker since you need to give security PIN?

[@ChedyChaaben]

12:41 If you experience a problem when executing the command, try adding two double quotes like this : docker run --name fastapi-container -p 80:80 -d -v "$(pwd):/code" fastapi-image

[@insolentflunkey]

Thank you!

[@jeffiscowCS]

true hero

[@Didanihaaaa]

is this different for Flask? Also could you show how to deploy a CNN model and make it work? how do you post an image to trigs the app? do you include the CNN model (sometimes it is heavy) into the image? what if it is big size? Bests

[@commievoyager]

Nice exploration! But could you do the same using just a docker-compose? Why do you prefer the way using Dockerfile? What benefits does it have?

[@Remolhunter97]

Not sure what you mean, but you need multiple separate dockerImages, each for a different process, and then docker compose to organise all the different dockerImages you have, and run them all at the same time

[@tensorflow5330]

hello , as I know that docker volumes map the local machine folder Linux or MacOs is different to window 10/11. in windows 10/11 cannot be directly mapped to a local directory

[@sebastianmolitor4827]

Great video. Thank you for this fast foward track on "docker developing". But I have one stuoid beginner qestion: How do I get my changed code from inside the container? 🤔

[@martinstojcevski9585]

You can always copy the code from the container. But in the video he is explaining about container volumes, which will mirror both local and the container code, so whatever is changed in the code of the container it will be mapped to the local code

[@tonybengue]

Thanks for that tutorial sir 🔥 When I want to connect to my container throught Dev Containers, it opens the root folder instead of the code folder (thanks to workdir command in the Dockerfile), and I don't understand why.

[@jasonnn12]

What's the extension used that suggests full command in the terminal? seems pretty handy

[@przbadu]

I use zsh-autosuggestions, is this is what you are looking for

[@albincr]

What about other langs like go or rust?? and it too much tied up with vscode? can we configure some other editors???

[@anisyacoubi]

thanks Patrick, am I the only one who's not getting anything when i run the command "docker run --name docher-container -p......". I've changed the port though to 8000:8000 due to an error on 80 but the localhost isn't accesible, any idea where i could be wrong please

[@rahulmitra9476]

For those of you stuck at 12:18 take note that the brackets are curly brackets

[@AkaThePistachio]

Im having issues attaching to my running container, once connected im put inside an empty dir with no access to my code any advice?

[@sadamabbasi1574]

Sir, What python IDE and autocomplete extensions you have used in Intermediate Python Course ? Kindly share

[@Mathias-cq3zo]

It is the one that's included with the python extension in VSC (the Python extension Patrick showed us)

[@IsayanBros]

I have been using docker compose for project setup for years now and have been happy with it. However, as soon as I switched to an M1 Macbook, startup speeds have been pretty bad.

[@FilSerge]

Is it because m1? What have gone wrong?

[@kimsanov]

Why at 9:00 in Dockerfile wi didn’t have to use EXPOSE instruction?

[@lawrencedoliveiro9104]

12:34 Does the COPY command in the Dockerfile become superfluous when you define a volume?

[@ClAddict]

Only if you don’t want to actually use the docker image in any production environment.

[@irondragon0385]

Would it be possible to do this for Visual Studio (not Code)?

[@sseymour1978]

When using this approach you end up with 2 VScode projects open at the same time. And for some reason I can connect to debugger only from host VScode and not from container.

[@sakkakuppi5637]

Why I am having 'ModuleNotFoundError/ when trying to import function from a file I created?

[@AmodeusR]

For some reason even with the -v flag it didn't update the container, and it doesn't update even if I delete an recreate the container. Also, when I open VSCode in the running container, there's no folder opened, nor any actual python file. Any idea why?

[@elmarhinz3076]

Each time the container is rebuilt the editors extension have to be installed again. Here the workflow feels a little broken. Any best practice how to address with this? How to do it within a multi developer project?

[@FilSerge]

Yeah, such a bummer. You need to add some lines in Dockerfile for installing z-shell and vs code extensions.

[@mpsii]

Can you provide an update on using podman or containerd? My company has prevented us from using Docker due to corporate licensing costs. I am using virtualbox/vagrant now, but do not like the "integration" of vagrant into virtualbox

[@mpsii]

@@mspajic My company has said "No" to docker due to licensing for company (not personal) use.

[@mspajic]

@@mpsii I think you didnt understand me, docker engine is free even for companies, just docker desktop (gui app) isnt, these arent the same things, CLI versions policy hasnt been changed. Read the docker subscription model on their official site. I even checked with my company, as we had the same situation, and I got green light after this explanation.

[@mspajic]

Ah I get it, sry I misunderstood you. Company isnt using docker anymore as a tool in general and you dont get anything by installing it on pc. Sry again, was just tryin to help :)

[@olivierwarnier969]

Hi, thank you I'm alone with problem in 14:30 ? : when I start VSCode in dev container "fastapi-container" I don't have any sources, and when I open folder VSCode re-open local version. Working on macOSX Ventura 13.5.2 - VSCode 1.82.3 latests version of Docker and dev container extensions

[@kreten780]

Same problem, there is an error when setting up the whole opening code inside of a container. Did you solve it? I am getting Error reading shell environment. Error: stream ended with:0 but wanted:9

[@hdcamsit2144]

@patloeber do you think it makes sense to develop python packages inside docker?

[@cexploreful]

i want to know it too

[@Mutombo71]

does this also work with podman?

[@akshayboddhul]

Which vs code theme used?

[@eliluong]

can vscode connect to remote container on another host?

[@Xertish210]

which İDE do you use

[@elhusseinali8934]

could you share with us the name of your vscode theme

[@MAJIDNISAR]

is there a MERN /MEAN stack development machine for it

[@sunnypepple6571]

How I deploy and use it on an ec2 instance?

[@JOY-df2oz]

A.M.A.Z.I.N.G.

[@user-sl4ry1rg1u]

how your codes are being autocomplete?

[@ZIKAZIKA-nu4ih]

12:57 My changes to code are not reflected unless I restart the container. Can you please suggest why is this ?

[@jeffzzz7850]

I also have this problem.

[@tiagobovolin]

Attaching to running container opens Vs Code on an empty folder. How to I fix this?

[@sakkakuppi5637]

Click File > Open Folder... and select the folder