Microservice Architecture and System Design with Python & Kubernetes - Full Course

Learn about software system design and microservices. This course is a hands-on approach to learning about microservice architectures and distributed systems using Python, Kubernetes, RabbitMQ, MongoDB, mySQL.
✏️ Course from Kantan Coding. Check out his channel: / @kantancoding
🔗 Twitter: / kantancoding
🔗 Instagram: / kantancoding
💻 Code: github.com/selikapro/microser...
Kubernetes API Reference: kubernetes.io/docs/reference/...
⭐️ Contents ⭐️
(0:00:00) Intro
(0:01:02) Overview
(0:02:47) Installation & Setup?
(0:10:16) Auth Service Code
(0:32:25) Auth Flow Overview & JWTs
(0:53:04) Auth Service Deployment
(0:56:08) Auth Dockerfile
(1:20:05) Kubernetes
(1:37:26) Gateway Service Code
(1:42:34) MongoDB & GridFs
(1:47:04) Architecture Overview (RabbitMQ)
(1:49:50) Synchronous Interservice Communication
(1:50:49) Asynchronous Interservice Communication
(1:53:19) Strong Consistency
(1:54:07) Eventual Consistency
(2:19:16) RabbitMQ
(2:21:16) Gateway Service Deployment
(2:35:34) Kubernetes Ingress
(2:46:28) Kubernetes StatefulSet
(2:51:18) RabbitMQ Deployment
(3:09:35) Converter Service Code
(3:33:43) Converter Service Deployment
(4:21:09) Checkpoint
(4:22:11) Update Gateway Service
(4:31:46) Notification Service Code
(4:43:24) Notification Service Deployment
(4:51:55) Sanity Check
(5:05:54) End
⭐️ References ⭐️
www.mongodb.com/docs/
www.rabbitmq.com/documentatio...
docs.microsoft.com/en-us/azur...
docs.microsoft.com/en-us/azur...
cloud.google.com/datastore/do...
🎉 Thanks to our Champion and Sponsor supporters:
👾 Nattira Maneerat
👾 Heather Wcislo
👾 Serhiy Kalinets
👾 Erdeniz Unvan
👾 Justin Hual
👾 Agustín Kussrow
👾 Otis Morgan
--
Learn to code for free and get a developer job: www.freecodecamp.org
Read hundreds of articles on programming: freecodecamp.org/news

[@haojieshu1294]

This might be the most valuable video I have watched over the years. Flask, MongoDB, k8s, microservice, mq, those are all new concepts for me, but you made it so clear to learn. Appreciate all the hard work.

[@OneStopMusic.]

To anyone who is in dilemma of watching or not watching this video, let me help you make a decision. I did watch this video and it's really a good video. Explanation is on point. There are really good technologies being used and you don't have to put in too much effort to understand it. So if you are interested in learning a micro-services arch then this video will really help you out.

[@LAKD]

Your teaching skills is beyond excellent. The fact you can teach something this complex, and make it sound beginner friendly is extremely hard to do. You help visualize, and most importantly repeat every step with a new significant step, that's something extremely valuable. Thanks for explaining, and I'll certainly subscribe to your personal channel.

[@SD-vk3ko]

5 hours in 5 days, and at last day, so happy to see the email.. Awesome work done @kantan Would love to see more of such these videos... Thank you so much

[@dharavathsuresh8838]

There is a sense of satisfaction after completing the video. Thank you so much.😊

[@ericblancas8113]

now this is a course worth waiting for. Would also love to see more terraform content and possibly stuff on gRPC services

[@ChrisSanten]

Did you complete this successfully?

[@ericblancas8113]

@@ChrisSanten I was able to complete this successfully at the time!. Great course and gave me a good understanding of the System Design portion

[@ChrisSanten]

@@ericblancas8113 Great to hear thank you for responding!

[@hiconnor1321]

Great to finally see Kantan Coding on here. This tutorial and all his others are top tier

[@kantancoding]

@Somtoklinsnot sure why you keep commenting that this is for advanced learning. I’d argue that it’s pretty accessible to anybody with a basic understanding of Python 👍

[@Adil-dp4ll]

what a course !! I have been looking for a complete deployment of MSA project. kudos.

[@mamamiakool]

More power to you, to build and explain in such great detail for the community. Keep up the good work brother !!!

[@cho7777]

Very good course! So many interesting technologies in just one tutorial! It was also very helpful, to see how you fix errors and what your stategies are doing this.

[@PetritK10]

One of the best course ever about K8s, it helps me to understand CKAD exam better

[@mohammady.altamimi7114]

This is a great tutorial, thanks for sharing all the knowledge!

[@badinenisaivardhan4774]

great video... worth watching and in detail with message queues

[@RocketRift]

great video, landed a job as a software engineer upon finishing!!!

[@yoursatisfiedhaven]

fr?

[@kegklaus5069]

I wathced 5 giant hours long video that was amazing! Thank you FCC & Kantan Coding!

[@AntKazak650]

Thanks for amazing tutorial, very clear! One thing that I would like to see is tests for the code

[@litergame]

I just stumbled across this treasure!! Thank you!

[@HimanshuKumar-xz5tk]

this was a great video overall. would like to see more of these that teach us new architectures/technology

[@lloparyllopary]

Wow, thanks for this tutorial. I'd never used kubernetes before, but I will start using it for my servers!!! Good explanations' teacher!!!

[@ChrisSanten]

Did you complete this tutorial successfully?

[@lloparyllopary]

@@ChrisSanten Hi, I only used the tutorial for the kubernates part, and this part it worked fine

[@ChrisSanten]

@@lloparyllopary okay great to know thank you for responding, glad the kubernates part worked fine.

[@sunilshah300]

I just know that the guy is a developer since he keeps on saying this thing is not the scope of course.

[@kantancoding]

😂😂 this killed me

[@olter1000]

Incredible explanation style. Thank you so much, so clear.

[@nikolaykoychev8261]

Great video, I learned so much about how microservices work using python! Thank you for taking the time to explain it in a clear and easy-to-understand way. I appreciate your hard work and dedication to helping others learn about this important topic. Keep up the amazing work!

[@manikantapunnam1189]

Thanks very much, sir. Excellent Explanation.

[@ketankolte4776]

This content is exactly what I was looking for...

[@nattajab]

Thanks so much. I learn this topic with fun !!

[@francisboafo7190]

You guys are the best channel ever!!! Hands down!!!

[@palaashatri]

this is actually a really valid real world project. i have been working on a similar microservice, although its made with Java EE, and needed a deep dive on some concepts. Thank you so much freeCodeCamp!

[@ChrisSanten]

Did you complete this video lesson successfully?

[@palaashatri]

@@ChrisSanten yes

[@AndrewAkaHrun]

Very nice tutorial. I wish only you’d start building Python modules with unit tests instead of testing the code manually. Also, I noticed you’re tagging your containers after the build by copying the build reference into the terminal. One way of simplifying your workflow with containers is to add the tag command right to the build like so: “docker build . -t repo:tag1 -t repo:latest”. Your great educator and a lot of inspiration. Keep posting the videos!

[@Sandeep-zd6dq]

Finally system design tutorials started 🙌

[@coledrain2158]

God bless you bro. This was really helpful.. 💪

[@elcaciquedev]

The architecture design is simple yet effective enough to only be missing a couple more metric and security services, to be a perfectly viable "production" ready solution for any application.

[@ChrisSanten]

Did you complete this tutorial from start to finish successfully?

[@Anaghish]

Can you tell me more about what metrics and security services you think would be useful here? Thanks!

[@bhavasagar977]

@@Anaghish To serve a Flask app on production we need to use WSGI server like Gunicorn and we need to hash passwords to store them not as strings into the database. I don't know much about docker and Kubernetes.

[@booleangray2225]

Thanks for bringing us this tutorial. Awesome work! Keep it up Kantan Coding and FCC. What is the Terminal theme you are using? It looks marvelous.

[@flipthebits]

Thanks for this important course.

[@maorb1703]

This is the BEST!!! video I have ever seen so far 🔥🔥🔥 Amazing video, as well as great level of explaining the material. I really appreciate your work, and hopefully you'll post another python project soon!😁

[@mebaysan]

Thank you fcc. This is what really I am looking for it.

[@jehadok2582]

keep going guys thanks for free course

[@sergsergesrgergseg]

perfect timing i was just trying to figure this out for the past week

[@rohitsharma-mg7hd]

very good tutorila, completed full and working fine

[@Ryguy12543]

great teacher. thanks.

[@mahendranath2504]

Thank you so much ❤❤❤🫡👍👏🤩👌

[@ankansharma4897]

GOD level teaching. I will be extremely interested to buy your course if in future you create a microservice course with 50 to 60+ hours of content. Explaining in microservice in depth and with big capstone microservice project. I wish you do. And thank you for such great explanation.

[@IndianCoders]

Nice Tutorial

[@adityanjsg99]

This channel is a blessing

[@shaansharma2504]

very very very very nice stuff and i salute you, respect

[@sreejeshraj4800]

Hello FreeCodeCamp, your videos have helped me a lot. One request - while there are people advising to go, read and contribute to open source code for better experience (like reading Spring source code), I think it will be better if there is a tutorial created by someone who can walk through a real open source project and explaining it. That will greatly help many developers in my opinion. Please create a series of possible, thanks.

[@jonathankee9322]

Well good luck... why not just look for smaller Fish? Spring has too much abstraction, I am not even going to attempt it lol. I think something like Opensource Java projects on a smaller and reasonable scale like Minecraft development is the way to go for me.

[@albertwang5974]

Thanks for such useful tutorial!

[@brunodepaula5293]

Great tutorial. Any reason for not having the mongo db inside a pod and a volume claim for that also?

[@cnkumar20]

5 hours of Most Solid Content.

[@RonelldRegen]

Great tutorial, thank you so much. How did you get this eyecandy behaviour of vim? Having code completion for Python is great. Could you eventually provide your vimrc file?

[@Abel_Lopez_]

Great! Congratulations!

[@hamzazahidulislam3490]

Thank you so much 😊

[@mitakshgupta]

@kantan coding - Excellent course. PS - What plugins are you using in your terminal?

[@EiRA-hiE-x]

Wow this is literally what I want ty

[@matlabnewbie]

Thanks for the excellent course! Btw, your Vim looks super cool. Would you mind sharing your vimrc file?

[@rkspatel08]

Thanks kantan coding and freecodecamp for making such informative video.

[@lollipop2748]

Very good 😊

[@nirmesh44]

great tutorial. how are you getting hints in vim editor while writing code?

[@osamaansari1232]

We need this type of course with C#. ASAP

[@dkq986]

You guys are awesome 😎😎

[@nitishveera1010]

very very helpful

[@alexandergawrilow4684]

Thanks for the video, I appreciate it very much and I learned a lot. One question: what is the point of creating packages with one module in them? For example in gateway instead of having the package auth with the module validate, why not leave out the package auth and just use the module validate?

[@konstantinpalagachev1573]

Thanks!

[@antonadjei]

if you get an error installing the mysqlclient (pkg-config not found), add pkg-config to the apt-get install step in the Dockerfile

[@Punugotikrishnarao]

Thanks buddy

[@topics305]

Yayyy!! Really needed this type of project.. thank you FreecodeCamp

[@vivekr.k7950]

Your course is awesome, i really liked it. But i have one request, you are using vim and editing it an individual file it hard to trace. If you using nerdtree from beginning of the video it will very help full for audience. Thanks for the video

[@canyouholdthisplease7023]

Hey man, great video. Just wondering which ide you are using there? Is it available on MAC?

[@suwonpark792]

Would just like to point out that I couldn't didn't hear any instructions to download MongoDB on my local at the start of the video and hence was getting connection refused error in my kubernetes container. After downloading mongo on my local, it worked. Perhaps you would like to add that in at the start. Some environmental variables like server.config["MYSQL_PORT"] = int(os.environ.get("MYSQL_PORT")) needed to add an int infront. Overall, the video concepts were very well explained and I really learned alot. Thank you for your hard work.

[@yusali4969]

I also stuck at the MongoDB part, do you still remember how you fixed the MongoDB not instantiated issue? Thx!!

[@suwonpark792]

i just installed mongo on my local. cos when i rewatched it i understood that he is hosting the mongo on your own local and not in k8.@@yusali4969

[@vijaykumarpendem3509]

@@yusali4969 replacing mongodb://host.minikube.internal:27017 to mongodb://localhost:27017 worked for me after running mongodb locally

[@mohitmishra3091]

You guys are demi-gods ❤️💫

[@oeaoo]

Brilliant stuff, thank you! Here are some questions that I've just got. 1. Why storing big binary in Mongo? 2. How to debug more easily? This error hunting and rebuilding is tough. 3. Any hot deployment tools available? Sorry, I'm not familiar with all these tools. Just curious.

[@TheJFMR]

Im agree with you, everytime he changes something of the Code, he rebuilds It and upload It to Docker hub and delete and apply with Kubernetes. Thats tedious

[@akashrajum3319]

Thank you

[@herbe13]

thank you!

[@regiapriandi]

Thanks, I followed it from beginning to the end of the video, Thanks freecodecamp for the knowledge, I'm trying to develop the database using postgresql as the authentication database and mongodb as the database file in the kubernetes deployment.

[@ChrisSanten]

Did you complete this tutorial successfully?

[@AleksandarIvanov69]

It would be helpful if before creating each component and its files, while explaining what you are going to create you also show some kind of pseudo-code or diagram representation of each step you are taking.

[@nirmesh44]

best ever i have ever seen👍👍

[@ChrisSanten]

Did you complete this successfully?

[@sohansingh2022]

Thanks

[@Thankful_n_Grateful]

What are the prerequisites to successfully learn & understand what will be taught in this course? Could always just watch...

[@ricardovelasquez2283]

Bravo... Conteúdo maravilhoso. Ter outra fonte de renda nesta recessão econômica deve ser prioridade em cada livro de jogo de indivíduos. Pode ser bastante difícil acumular lucro sem um bom conhecimento ou orientação adequada, por isso é aconselhável trabalhar com um consultor de investimentos.

[@Jorge-eduardo49]

@Lorenzo pique Acho válida sua opinião. Os sinais de flutuações comerciais precisam de muita experiência para atingir a perfeição. Para evitar perdas, é aconselhável trabalhar com um especialista.

[@ricardovelasquez2283]

Bem, eu não sou um especialista e não posso ajudar. No entanto, recebi ajuda da Sra. Ana Davies, empregar seus serviços para gerenciar e negociar meus ativos foi a melhor decisão que tomei. Estamos em contato há 14 meses e contando.

[@juantapia408]

Já ouvi muito sobre ela no LinkedIn. Meu portfólio mostra zero ou nenhum sinal de melhora, como posso contatá-la?

[@ricardovelasquez2283]

@@juantapia408 Você pode se comunicar com ela usando o identificador abaixo

[@paweisio7786]

Does anyone know what the best way to install MySQL is on Windows using the installer for this course? I'm wondering whether I should do, "Developer Default" or "Server only" setup types

[@victormungai]

Your terminal setup please? It looks cool!

[@PieterKuppens]

That's also my question! How did you set up vim to use pylint? Is the checking 'live' or do you use a keyboard shortcut? Or on a completely different level, is there a config for Visual Studio Code, which seems a bit more user-friendly and cross-platform. Though I'm a dinosaur that actually knows and uses vi(m) when I'm working in text terminals on UNIX-based systems. PS. I'll forgive that you store passwords in plain text instead of with a salted hash ;)

[@nelsonobedfernandezzamora4584]

Nice!

[@bangje8498]

Any advice what to watch before finishing this course?

[@Han-ve8uh]

Why does rabbitmq-manager get stuck at "refused to connect"? In ingress-nginx-controller logs i see "Error obtaining Endpoints for Service "default/rabbitmq": no object matching key "default/rabbitmq" in local store" and "Service "default/rabbitmq" does not have any active Endpoint". Same 2 points for default/gateway. I'm guessing if this is the cause 1. What does "not have any active Endpoint" mean? From kubectl get services i see they all have CLUSTER-IP, is that the endpoint ingress controller is looking for or something else? 2. Why does CLUSTER-IP:15672 work to give me the rabbitmq UI? I got the CLUSTER-IP column of "kubectl get services "

[@uploadvoice]

Great video, qst: does it make sense to store mp3 on mongodb ? Better design would be to use a s3 block store like service, wouldn’t it be ?

[@linucksrox2670]

You would generally want to store files on something like s3 as opposed to blobs in a database, although there are some valid use cases for that but probably not mp3 files. Btw you could be using a better encoding option like ogg for audio but that's a whole 'nother conversation.

[@godataprof]

Using Kafka as the producer and consumer would have been great.

[@Cadambank]

@30:30 there is no need for checking the username again as the data is fetched using the auth.username. better would be to use aith.username and auth.password in where clause and check only rowcount.

[@user-ur2en1zq4f]

thanks fcc & kantan

[@SkynerGaming]

Dude where did you start the mongodb, I've been running around circles trying to find it 🙂 Thanks!

[@kaushikdey6333]

yeah me too, apparently he didn't mention that in the video.

[@SkynerGaming]

​@@kaushikdey6333 I followed the instructions in Mongodb official website and was able to have it up and running

[@kaushikdey6333]

@@SkynerGaming one more problem tho [spoiler alert] : When he enables insecure authentication for google account, its just not there when I check for it.

[@SkynerGaming]

@@kaushikdey6333 Ah yeah gmail changed that and you can no longer do as he says in the video. There are other ways of supplying a notification though, I think it's actually a good opportunity to come up with something by yourself 🙂

[@josephbtech]

@@SkynerGaming could you please explain the setup steps?

[@michaelelumeev5125]

Don't forget to use "brew services start mysql" prior using mysql

[@user-ur2ft7hp7t]

Thanks for the video, very interesting. One thing I'm not sure about. As known the shared database is a sort of anti-pattern, and here the same MongoDB is being used in several services directly. Is it critical to put a service's db behind the service's API?

[@thomass8871]

Bro could you upload courses on electrical&electronics engineering and circuit anaylsis? pleaseeeee

[@nccamsc]

Nice work, but I'd prefer to see more upfront analysis and design.

[@MrDandiya]

Bro all I can say is I love you.

[@po6577]

i had not stared yet, but i sound amazing already

[@saralightbourne]

thank you a lot, this is great! can somebody please tell me what terminal theme is used in the tutorial? pleaseeee🥺

[@naor9985]

look for it also.. do you know?

[@saralightbourne]

@@naor9985 still didn't find :(

[@michaelelumeev5125]

Amazing course, but it seems to me that the part where the configuration of the local MongoDB is shown is kinda missing. Believe it or not, I have sifted through all manifests trying to find it, and then decided to start it locally.

[@ChrisSanten]

Did you complete this tutorial video successfully?

[@michaelelumeev5125]

@@ChrisSanten Yup, without any issues. Actually there was one and I have also highlighted it in the comments.

[@ChrisSanten]

@@michaelelumeev5125 Good to know, thank you.

[@seanoverton798]

lol yeh I was going along wondering about this

[@StephenOgu]

Nice

[@futhedude4848]

about the micro service gateway, this tutorial is created it own gateway and connect through http to other service.

[@Alex-bc3xe]

His accent is such on point. :)

[@TibinThomas1993]

When I attempted to install flask-mysqldb, the installation process required compiling native code (C code) to build the mysqlclient Python package. During this process, the build system needs to locate the necessary libraries and header files for MySQL to link against. brew install pkg-config, helped me.