DevOps Project: Video to Audio Python Microservices App on Kubernetes

Kubernetes Project for Practice | DevOps project for resume | AWS Project | Python Microservices video to audio converter app | Kubernetes Microservices Deployment
In this DevOps Project you will learn how microservices architecture works by deploying a Python Microservices app that converts Video to Audio. Microservices architecture has been very popular since the start and every big company is using it. So this devops project is going to be a great learning for you and also something that you can mention in your resume.
#microservices #kubernetes #devops
Tools used to deploy this microservices architecture include Kubernetes (AWS EKS), Docker, Helm (Package manager for kubernetes), RabbitMQ (Queue service), MongoDB and Postgres
Github Repo for this Project: github.com/N4si/microservices...
Connect with me on LinkedIn: / nasiullha-chaudhari
Timestamp
Intro 0:00
Project Architecture 0:35
Important notice by CloudChamp 01:41
Project Starts here. 02:31
Cluster setup 05:15
Explaining the microservices code. 06:46
Install Helm charts. 11:33
Add neccessary rules in Security Group 20:00
Applying microservices manifest files 27:35
App Validation 41:59
Video converted to Audio 46:35
Resource Deletion after sharing on LinkedIn 47:36
Conclusion 48:11
Also Checkout my other videos:
DEVSECOPS project: • DevSecOps Pipeline Pro...
How to learn DevOps faster: • How to Learn DevOps Fa...
DevOps Interview Questions and Answers: • DevOps Interview Quest...
GitOps Explained with Examples: • What is GitOps | GitOp...
Monitoring explained with popular tools: • Popular DevOps Monitor...
CICD explained with a project: • What is CICD Pipeline?...
How much Programming is required in DevOps : • Is CODING required for...
How I use Python as DevOps engineer: • How I use Python as De...
How to use ChatGPT as a DevOps Engineer: • 5 EFFECTIVE ways to us...
CICD Pipeline explained: • What is CICD Pipeline?...
Terraform Tutorial : • Master Terraform in 60...
Terraform Project on AWS: • Simple DevOps Project ...
How I make money as Devops Freelancer: • How I make money remot...
Most used AWS services for DevOps Engineer: • Important AWS services...
#devops #kubernetes #microservices
Cloudchamp is your KZbin channel to learn DevOps with interesting tutorials and Projects that you can practice and even mention in your resume. Learn Cloud and devops tools including aws, Terraform, Kubernetes, Docker, microservices, GitLab and so much. subscribe now to never miss any video.
This project is perfect for beginner as well experienced people who are looking to understand microservices architecture, Kubernetes microservices deployment or how to deploy microservice application on Kubernetes cluster. After completing this devops project you will have good idea about microservices architecture and how to deploy python microservice on kubernetes using Helm, rabbitmq, mongo and postgres database.
Join this channel to get access to perks:
/ @cloudchamp

[@Vaishnavi-kathwate]

Thank you bhai, microservices ke project ki bohot zarurat thi. Ki actually kaise practical way mai docker kubernetes use krte hai various module kaise loose coupled krte hai by using these, so thank you 🙏❤🌹

[@cloudchamp]

You are welcome brother.🙏 Isko deploy karo aur samaj mein aaega kuch issue aaya toh comment karna 👍🏻

[@shibasisnayak4967]

I have gone through many devops channel even from udemy, pluralsight also. But the way you're explaining is awesome. keep up the good work Bro. Good Job!!

[@cloudchamp]

Thanks, will do! ☺️

[@gyanapriyapradhan6289]

Thank you so much for healing my mental health and growing towards my job career. ❤

[@cloudchamp]

You are welcome 🙏 Happy to help ☺️

[@atatekeli9295]

Hi Nasi, Thank you for. this project as it allowed me to set up databases and interact with them and taught me why Microservices are important. I'd recommend you using AWS CLI instead of console as it'd be way more realistic in production setting.

[@hajermakina7474]

I can't express my gratitude to you , you are making amazing content Thank you so much for what you are teaching us :)))

[@cloudchamp]

You are welcome 🤗 Happy to help. Do share my videos to support

[@Sardar_khan_wassipur]

Excellent content brother ❤ Love the way you explain things. Keep making such High quality content. Thanks.

[@cloudchamp]

You are welcome 🙏 Thanks for your support 👍🏻

[@yashajgaonkar394]

Great explanation and it was nice to meet you at the event!🎉

[@cloudchamp]

Same here Yash 🤝🤝

[@kevinmundati5039]

I must say I'm learning a lot keep up the good work champ!

[@cloudchamp]

Thanks, will do! Happy to help Kevin 😊

[@blazedteen917]

I have started learning python and this project helps thank you for uploading

[@cloudchamp]

You are most welcome

[@TheMightyWalk]

i love waking up in the morning to this . thanks champ

[@cloudchamp]

You are welcome 🤗 Good morning 🤝

[@saurabh9446]

Exceptional content. Please keep making these architectural deployment. May be nodejs as well

[@cloudchamp]

Thanks, will do!

[@kingalex1045]

You are savior may god bless you with everything you want. Thank you for uploading this for free 🙏

[@cloudchamp]

So nice of you Happy to help

[@artemy3718]

wow this is just amazing - thank you so much!

[@cloudchamp]

You're so welcome!

[@mayank8387]

Insightful! Thank you for sharing. Microservices!!

[@cloudchamp]

Glad you enjoyed it! ☺️

[@fredokereke9608]

thank you so much for this, oliver twist wants more devops projectsssssssss

[@cloudchamp]

You are welcome 🙏

[@maheshvarmac]

Fantastic!! Nice Project. Learning a lot

[@cloudchamp]

Glad you enjoyed it!

[@user-gf1ym5cu5c]

project is best. Keep it up and delivery more project like this and also make a tutorial for helm from scratch..♥♥♥

[@cloudchamp]

Thank you, I will

[@alghoul5317]

It was nice to meet you sir at Pune event. When is the next event in which you are the speaker?

[@krishnaacharya8800]

Hi Awesome content👋 Can you please create a video for this particular scenario Just to start: I want to deploy multiple website/pwa in the near future which I want it to scale according to audience mostly for now it is for around 1k-5k monthly visitors The problem I face is, I don't understand the Jargons and totally confused 1. If I have to use digital ocean or hostinger's cloud hosting or vps hosting, which one to use and what difference it has or should i consider AWS ? 2. Why tools like appwrite suggest to deploy in digital ocean? can't I deploy in cloud/vps hosting of hostinger .. 3. Which mongodb should I use serverless / shared or managed from within digital ocean and also deploy my website there ... As you can say, I'm pretty new to this field, infact I don't know to even ask a right question, Any video on this or clarfication about this as a whole would be really inevitable to me :)

[@003shamshuddin]

Nasi bro i'd like to know about your opinion on these which project shines more on resume 3-tier voting application or this microservices project?

[@user-uq6ji5nl1q]

Hey there, As you said this project is paid where we will pay in this whole process? Or it there any service for we are paying ? Look I just want to create the project for just presentation purpose and learning OfCourse but if I delete the cluster and nodes at the end will still I have to pay? As you did in last that deleted cluster, will you need to pay still? Please just clear my doubt

[@mwanthidaniel1254]

Hello Sir, in a scenario where we automate the CI process, how can we selectively control the image rebuilding process for microservices, ensuring that new images are only created for services where changes have been made, and not for those that remain unchanged?

[@VenuGopalReddy.]

thanks bro...vid was very informatic!!

[@cloudchamp]

Thanks 😊 Happy to help

[@abhishekdubey9920]

Bro i am amazed firstly , please make a road map for 3rd sem new folk want to master this till end of 2nd year please how can he do that with you , he needs structured plan for required months. Please give him roadmap and resources steps.

[@AdityaYadav-dd3mc]

Thanks for the video❤ But please explain what was the use case of rabbitmq in the project?

[@rohansinghnegi3300]

Plz make a 3 tier project series in DevOps, and Also make some project series in AWS .

[@cloudchamp]

Sure noted

[@user-tq8hr9wc9p]

iam running it on minikube what should place in the ipaddress for connecting to momgodb

[@walterwhite2679]

Where did you get the helm charts from ?

[@hiz_sl1333]

Thank you 🙏

[@cloudchamp]

You are welcome 🤗

[@jamalkiti]

Cloud Champ bhai ke aage koi bol sakta hai kya ...........champ bhai.... Thanks a lot sir.

[@cloudchamp]

Aaaaaaaa 😂🤣 You are welcome 🤗

[@comicdreamz]

Thanks buddy :)

[@cloudchamp]

You are welcome 🤗

[@DavidC2718]

Hello Nasi. I have found an error in the code and submitted a pull request titled " Incorrect check of query result "

[@kingalex1045]

Thank you for this

[@cloudchamp]

My pleasure!

[@veeraganesh8582]

HI Thank you for the video i have some issue on IAM role i can see the clusterrole but wjhile going to nodegroup not able to see the EKSNoderole even tried logout/relogin

[@cloudchamp]

You will have to create it and then it will appear. Search for how to create Eks node role.

[@akashrawat2198]

When applying micro services the auth worked perfect but the rest did not..i was able to create them but their pods kept on call back loop so im stuck there.. can someone help

[@paritoshkapadiya6859]

Can u recreate, EC2 course again bcz due to low quality video unable to see your screen recording

[@lekhajagadeesh6752]

Mongodb connection timeout error what would help ??

[@viral_shortsviralshorts]

This is amazing

[@cloudchamp]

Thanks!

[@adityagoel9595]

I'm getting an error in line "connection = pika.BlockingConnection(pika.ConnectionParameters(host='rabbitmq',heartbeat=0))." Because of this line, 3 containers are failing - converter, gateway and notification service. The error is: "socket.gaierror: [Errno -2] Name or service not known". In case anyone faced the same issue, how to troubleshoot? I looked over the internet and tried few things but unsuccessful.

[@adityagoel9595]

This error got solved by changing the host parameter from 'rabbitmq' to the clusterIP of rabbitmq.

[@DataScienceMLEngenieer]

Bro kaise or kon software mai create korte hei is digram flow

[@vijaykumar-mc6wt]

Thanks

[@cloudchamp]

You are welcome 🤗

[@manasgoyal9899]

very nice sirrr

[@cloudchamp]

Thanks and welcome

[@RavanammaBora-kd2vi]

Hi Champ, I received success message after the upload but I didn't receive the id to my email I am not getting the exact issue where i had gone wrong ..

[@leoliu-gc3sg]

Hi, i have a question. is nodeport used in real work to expose rabbitmq and mogodb? How to access or which service to use if not a node port.

[@cloudchamp]

There are other service types like Loadbalancer & Cluster IP along with nodeport

[@leoliu-gc3sg]

Thank you for your immediate reply. If I use ingress, can I change mogodb rabbitmq to clusterip@@cloudchamp

[@abalilziad4444]

hello thnk you so much for the video , how did you make the architecture animated , which website that you used to create it animated ? Thanku

[@cloudchamp]

Powerpoint but you can do it using draw.io

[@martingarcia3999]

How much does it cost to deploy the entire project in these services?

[@kasper52173]

Thank you, Excellent, the document which you are working from is that available anywhere?

[@cloudchamp]

In GitHub readme

[@yann-oliviermbella7766]

Hi, why do you need a postgres server as well as an authentication service please? are both connected? if yes, how? thank you

[@cloudchamp]

Yes they both are connected, the credentials for authentication are stored in postgres, you can check the auth-service code

[@yann-oliviermbella7766]

Thank you. I just saw that. But why create two servers for this and not one statefulset with the postgres image ?

[@vrushankgajula4584]

Wonderful video brother!!... Last time I didn't close the EKS cluster and got charged 800INR.. What do you suggest me to do after completing the project ? Need to keep the cluster or delete it?

[@cloudchamp]

Obviously delete after completion I have a section to show how to delete

[@manognakachiraju5993]

hi pls make troubleshooting videos beacause if we occur any problem in between it takes so much time to solve the error and the cost increases

[@leoliu-gc3sg]

hi, nasi, MongoDB and PostgreSQL ,why create two database?

[@cloudchamp]

As explained in the video, Postgres is to store credentials & MongoDB to store video and converted audio

[@kamalpreetcor6178]

i am having an issue in connecting cli with my cluster in vscode terminal , i did aws configure , i gave the deafult region and credentials but it is unable to connect ? i am stuck in this step : aws eks update-kubeconfig --name --region An error occurred (UnrecognizedClientException) when calling the DescribeCluster operation: The security token included in the request is invalid.

[@davidc78400]

did you fix this? I am having the same issue right now

[@davidc78400]

I fixed this problem. You need to get the aws configured from root user (where you created cluster through console) rather than an AWS IAM user

[@user-lt8cw4gr7g]

Hi. What OS do you use for just movie, youtube and so on or linux for all (work and life)?

[@cloudchamp]

I have been using Ubuntu for past 3 years now

[@user-lt8cw4gr7g]

​@@cloudchampthank you, just saw your wsl video and think that you use 2 OS, 1 for life, gaming, video - windows and 2 for work, coding and so on - linux Ubuntu

[@cloudchamp]

yes thats right @@user-lt8cw4gr7g

[@cloudchamp]

true@@user-lt8cw4gr7g

[@psyno1856]

how much can we get charged for this project estimated ?

[@blazedteen917]

Cool tshirt bro

[@cloudchamp]

Thanks bro 🤙

[@sanmiisedowo5292]

Hi People, is a very interesting project and thanks for sharing it, I have a question please; I am not able to connect to the installed mongoDB. I have used your yaml file without changing the email or anything, ....Do I have to update the file to my own email please? if yes can you please share the name of the Netflix project you mentioned so I can learn how to generate password for my email please?

[@manognakachiraju5993]

hi! wonderful video....im getting error while executing the psql 'postgres://nasi:........command that psql is not recognized.....what shall i do

[@cloudchamp]

Install Postgres

[@RamsarithaBora]

HI Champ, Working on this project I just got struck with connection of mongodb when I am tring to connect it was throwing me an error "bash: mongo: command not found".I verified the pods mongodb is in running status.Please help me out.Thanks in advance

[@cloudchamp]

You need to install mongo db locally

[@RamsarithaBora]

@@cloudchamp Yes I researched installed it locally working fine now Thank you

[@RamsarithaBora]

Another issue while creating the Docker image I am getting error in this line ERROR [2/6] RUN apt-get update && apt-get install -y --no-install-recommends ERROR: failed to solve: process "/bin/sh -c apt-get update && apt-get install -y --no-install-recommends --no-install-suggests build-essential libpq-dev python3-dev && pip install --no-cache-dir --upgrade pip" did not complete successfully: exit code: 100

[@madithatisreedharreddy6631]

can't we use minikube instead of amazon eks ?

[@cloudchamp]

Yes you can try to use make sure your laptop has good resources

[@user-tq8hr9wc9p]

does this project satisfy this conditions The application must be deployable using Kubernetes. The application must consist of at least two different types of microservices Each microservice must implement a REST API for access The application must be accessible from “the outside” (e.g. via a web browser) All microservices in the application must be horizontally scalable independently from each other. Any microservice images required to run your application must have been pushed to docker hub so that Kubernetes may find them. The application must make use of some form of database running as a separate microservice. The database must use storage which is persistent across restarts of the deployment infrastructure. The database does not have to be scalable.

[@poojak4432]

Doing this project what pre requisite I should have please tell

[@cloudchamp]

Basic python, and kubernetes is enough

[@poojak4432]

@@cloudchamp where I can find those project and would you please tell me the project titles

[@meriemmastouri4274]

Can someone please tell me how much will this project cost me since I only have 100$ in AWS academy learner lab? Will it be enough? Thank you

[@cloudchamp]

Yes will be enough

[@AnsumanSingh1]

Can we use Minikube instead of EKS ?

[@cloudchamp]

Yes

[@smartengineer4484]

First!!!

[@cloudchamp]

Thanks for the support 👏

[@alpha-lz6bw]

Should i install linux or use virtual machine ??

[@cloudchamp]

Depends if you have strong machine you can install Linux locally or setup virtual machines

[@gamingchamp3070]

Microservices!

[@cloudchamp]

!!!

[@Abhishek_8288]

I want to deploy 15 microservice in eks. how many ec2 are required can u tell me please?

[@cloudchamp]

All depends on the processes running in it, you need to know the resource requirements for the microservices

[@Abhishek_8288]

@@cloudchamp for example 1 micro services taking 2cpu 2ram then ?

[@prathameshlingayatvlogs589]

Microservices..!!

[@cloudchamp]

!!!

[@kunedevendra255]

To my mail I am not getting fid I configured as mentioned

[@cloudchamp]

Did you added the smtp details along with App password from Gmail? Is your notification pod running?

[@comesitstandhere]

please, can I deploy this on my VMware or vmbox

[@cloudchamp]

Yes you can

[@balaabirami6948]

Can u plz upload projects for azure devops

[@cloudchamp]

sure, soon

[@gombeadsoru3334]

Microservices

[@mihirkanani292]

Postgresql asking for password !!! Can anyone please help me out what is the default password for it? Thanks.

[@cloudchamp]

check the values in Helm_charts/Postgres/values.yaml

[@RavanammaBora-kd2vi]

Another issue while creating the Docker image I am getting error in this line ERROR [2/6] RUN apt-get update && apt-get install -y --no-install-recommends ERROR: failed to solve: process "/bin/sh -c apt-get update && apt-get install -y --no-install-recommends --no-install-suggests build-essential libpq-dev python3-dev && pip install --no-cache-dir --upgrade pip" did not complete successfully: exit code: 100

[@kapilchauhan7018]

Bahiya koi laptop suggest karo cloud computing ke liye

[@cloudchamp]

Koi b laptop jo minimum 4 gb aur i5 generator

[@regisnobel6690]

microservices

[@shivkant5039]

Please hire a editior

[@cloudchamp]

Do you have anyone

[@AmrutaWagh-kb3yv]

ye me karungi aj but tell us database

[@cloudchamp]

Database is Postgres for authentication and MongoDB for video and audio

[@ananypratap]

hi bro as a regular video i suggest you to hire a video editorr as your video are very informative but not engaging because of the video editing if you want i can edit videos for you Experience 2 year + in video editing and also worked for a startup to run there ads campaign If you want i can send you my portfolio in your mail