How Prometheus Monitoring works | Prometheus Architecture explained

► Part of the DevOps Bootcamp 🚀 More infos here: bit.ly/41Wc1cM
Fully understand how Prometheus Monitoring works | Explaining Prometheus Architecture | What is Prometheus Monitoring | Prometheus Monitoring Tutorial
Demo Part 1: Setup Prometheus Monitoring and Grafana on Kubernetes using Prometheus Operator ► • Setup Prometheus Monit...
Demo Part 2: In the 2nd part we will actually configure Prometheus to expose /metrics endpoint and configure Prometheus to scrape it. ► • Prometheus Monitoring ... 🤓
Prometheus has become the mainstream monitoring tool of choice in container and microservice world. 🔥
In this video you will learn:
1) Why Prometheus is so important in such infrastructure and what are some specific use cases
2) How Prometheus works? What are targets and metrics?
3) How does Prometheus collect those metrics from its targets?
4) Furthermore, I explain Prometheus Architecture with simple diagrams and animations and go through the main components: Prometheus Server, Pushgateway, Alertmanager
5) The advantages of Prometheus Pull System compared to alternative monitoring tools, which use Push System
6) Using Prometheus Monitoring with Docker and Kubernetes
You will also understand better why it’s important to monitor your applications/infrastructure in general.
▬▬▬▬▬▬ T I M E S T A M P S ⏰ ▬▬▬▬▬▬
0:00 - Intro
0:31 - What is Prometheus?
1:06 - Where and why is Prometheus used?
2:21 - Specific Use Cases for using Prometheus Monitoring
5:57 - How does Prometheus work? Prometheus Architecture explained
6:04 - Prometheus Server
7:02 - Targets and Metrics
7:53 - Metrics
8:50 - How does Prometheus collect those metrics from targets?
9:21 - Target Endpoints and Exporters
11:12 - Monitoring your own application
12:03 - Pull Mechanism - Unique advantage of Prometheus
13:38 - Pushgateway for short-lived jobs
14:14 - Configuring Prometheus - Example YAML Configuration
16:20 - Alert Manager - Triggering alerts
16:55 - Prometheus Data Storage - Where does Prometheus store the data?
17:38 - PromQL Query Language
18:37 - My Experience
19:23 - Key Characteristics - advantages and disadvantages of Prometheus
20:40 - Prometheus Monitoring with Docker and Kubernetes
▬▬▬▬▬▬ Useful Links 🛠 ▬▬▬▬▬▬
Official Prometheus Exporters List ► prometheus.io/docs/instrument...
Prometheus Client Libraries ► prometheus.io/docs/instrument...
Photo source for Metrics Example: itnext.io/prometheus-for-begi...
#prometheus #prometheusmonitoring #devops #techworldwithnana
▬▬▬▬▬▬ Want to learn more? 🚀 ▬▬▬▬▬▬
Full Kubernetes and Docker tutorial ► bit.ly/2YGeRp9
What is Kubernetes? ► • What is Kubernetes | K...
Complete Jenkins Pipeline Tutorial ► • Complete Jenkins Pipel...
▬▬▬▬▬▬ Courses & Bootcamp & Ebooks 🚀 ▬▬▬▬▬▬
► Become a DevOps Engineer - full educational program 👉🏼 bit.ly/45mXaer
► High-Quality and Hands-On Courses 👉🏼 bit.ly/3BNS8Kv
► Kubernetes 101 - compact and easy-to-read ebook bundle 👉🏼 bit.ly/3Ozl28x
▬▬▬▬▬▬ Connect with me 👋 ▬▬▬▬▬▬
Join private Facebook group ► bit.ly/32UVSZP
DEV ► bit.ly/3h2fqiO
INSTAGRAM ► bit.ly/2F3LXYJ
TWITTER ► bit.ly/3i54PUB
LINKEDIN ► bit.ly/3hWOLVT

[@TechWorldwithNana]

Check out the demo parts: ► Demo Part 1: Setup Prometheus Monitoring and Grafana on Kubernetes using Prometheus Operator ► kzbin.info/www/bejne/h6CnoqujbN6VgsU ► Demo Part 2: kzbin.info/www/bejne/o32zmGdvl5hmqaM In the 2nd part we will actually configure Prometheus to expose /metrics endpoint and configure Prometheus to scrape it. 0:31 - What is Prometheus? 1:06 - Where and why is Prometheus used? 2:21 - Specific Use Cases for using Prometheus Monitoring 5:57 - How does Prometheus work? Prometheus Architecture explained 6:04 - Prometheus Server 7:02 - Targets and Metrics 7:53 - Metrics 8:50 - How does Prometheus collect those metrics from targets? 9:21 - Target Endpoints and Exporters 11:12 - Monitoring your own application 12:03 - Pull Mechanism - Unique advantage of Prometheus 13:38 - Pushgateway for short-lived jobs 14:14 - Configuring Prometheus - Example YAML Configuration 16:20 - Alert Manager - Triggering alerts 16:55 - Prometheus Data Storage - Where does Prometheus store the data? 17:38 - PromQL Query Language 18:37 - My Experience 19:23 - Key Characteristics - advantages and disadvantages of Prometheus 20:40 - Prometheus Monitoring with Docker and Kubernetes 👉🏼 For any questions/issues/feedback, please leave me a comment and I will get back to you as soon as possible. Please don't forget to subscribe and give me a thumbs up if you liked my video 😊🙏

[@CeezGeez]

TechWorld with Nana Nice and simple explanation! Subbed 👍

[@kalankaraivilakkam]

Best introduction on Prometheus. Appreciated!

[@TechWorldwithNana]

@@CeezGeez Cool thanks for your feedback and subscribing :D

[@TechWorldwithNana]

@@kalankaraivilakkam Thanks a lot! :)

[@deepakranganathan9644]

@@TechWorldwithNana I have a doubt with respect to Prometheus setup for Django applications. If we have a load balancer which redirects to three application servers where the Django applications are running. Which of these setups will work and is optimally correct? 1. Having Prometheus installed in one of the application servers and then having a job for every Django application we need to monitor and provide all three application server's Django configuration details in the targets entry in prometheus.yml? - One more doubt, in this case, is when the targets are authenticated using OAuth, how can we manage in this scenario? 2. Installing Prometheus on any server and mentioning all the Django applications details in the targets entry in prometheus.yml file? - Do we need to have ssh trust set up in this case when the setup has to be done like this? It will be very helpful if you please give some insights on this. Thanks in advance :)

[@noahabah533]

Nana, you're doing a great job. Don't stop what you're doing. This is helping a lot of people.

[@TechWorldwithNana]

Thank you Noah 🙏. 😊

[@joshnak.974]

WOW great stuff

[@JesseSteinfort]

I second this! I'm on my second video and looking forward to more. You have put out great content. Thank you.

[@michaelhughes8413]

Agree with you 💯

[@poefpoef]

The quality of this tutorial is truly excellent. Nana doesn’t jump into solutions, but describes the problem or issue first, consistently. That helps to understand not only the ‘how’, but also the ‘why’ and the ‘what’. In addition, Nana tells a coherent story at the right pace. Kudos for this great video!

[@stvv5546]

First thing I am always doing on Nana videos is click Like button first and only then watch the videos! She absolutely deserves that and never dissapoints!

[@RiteshAgarwalGwalior]

Whenever I am looking for something, if it's available on this channel then I do not need to go anywhere else. This channel has the most clear and concise explanation. Thanks, Nana.

[@sushmitamahapatra4472]

I wish to have teachers like you Nana Kudos to you and your Parents !!👏

[@ThaiNguyen-cs3jy]

I'm starting my DevOps career and this is my first-to-go KZbin channel whenever I want to understand the overview and the fundamental knowledge of a DevOps tool. From Vietnam, thank you so much, Nana!

[@RonaldCrb]

This is fantastic in so many levels, i finally understood prometheus... wow

[@WISEInsights2k]

This tutorial helped me quickly understand Prometheus and answer few questions in my interview recently. Thank you, Nana!

[@dantevikas]

Capturing the concepts with great clarity, this was a much needed one. Been looking for something like this for a while now. Great quality. Appreciated.

[@TechWorldwithNana]

Wow thanks a lot Vikas, happy you think it's that good :)

[@4321rupesh]

Your tutorials are amazing and very easy to follow and helps in understandings the concepts. Great work!!

[@TelstarB]

This is one of the most didactic videos I have ever seen. Newbies all over the world will forever be grateful to you. Truly fantastic video!

[@vemareddy007]

~22 min lecture with no need of going backwards to understand !! Very good 👍. Coming to the content crisp and clean, that made it look simple. Good Job.!

[@TechWorldwithNana]

Thanks Vemareddy, glad I could explain it in that simple way 😊 Really appreciate your feedback!

[@bereketlibanos1787]

Your english is so clear, and easy to understand. A 4 year old would know what you are talking about despite the complexity of the stuff you are teaching. This shows how well you know what you are doing. Keep up the good work.

[@yapadqoi]

Probably one of the best teachers I've ever had. Wow! In a week-end, I've learned more on DevOps solutions, going through your video series, than I did in months with official documentation and reference manuals. You make things so simple and easy to grasp. Great job! Thank you so much

[@TechWorldwithNana]

That's so amazing to hear! Thank you for taking your time to write such great feedback! Appreciate it 😊

[@yapadqoi]

@@TechWorldwithNana Thank YOU for taking the time to reply back. You didn't have to, but I'm so happy to read it. Keep up the good work!

[@rahuldebdas2374]

Hi Nana, you are great. You are helping many people with your knowledge and all this is free of cost. So kind of you. Can you please upload a session on airflow -- what it is, how to install it on local machine and create the DAG and run some pipelines and also possibly how to monitor the data pipelines.

[@10-madhumitamanikmahapatra73]

Amazing! The bestest tutorial I have ever seen! Clear and crisp!!

[@elad3958]

Everytime I finish watching your videos, I feel I have a Master's Degree in DevOps from Harvard. I learn so much. Cant thank you enuff Nana.

[@Shubham__Saroj]

As always your explanation was clear and concise, and the visuals were very helpful in understanding the concepts. You really have a talent for explaining complex technical topics in an approachable way. Keep up the great work! 💯

[@bossiq2024]

Brilliant Nana. Very helpful, as I've been out of the tech space for 2 decades and needed a clear and concise primer for this!

[@TechWorldwithNana]

Thank you 🙏. 🙂

[@Mukarramali89]

Thank you so much. I usually cannot tolerate video tutorials, but you approach and simple slides made it work.

[@mitsos9333]

Would love to see part 2! Part 1 was really helpful. Thank you!

[@dennisronny3437]

I have started watching your tutorials recently and I am happy with whatever you are doing.Thanks alot and keep on with the good job Nana.

[@eminbaturdizdar6196]

I normally watch tutorial videos 1.5x speed but with Nana, the videos have so much quality information I actually need to stop at some points to process it better :)

[@manikandans8808]

Prometheus is always a special monitoring tool for me. This was very interesting to watch. Waiting for the next one ISTIO 😁😁😁.

[@TechWorldwithNana]

Thanks, glad you enjoyed watching :) Yes Istio will be one of the next videos, because so many people asked for it, so stay tuned 🙂

[@ravimaisa5772]

after watching your video.....i got confidence in prometheus. By the way your just outstanding in presentation...

[@TechWorldwithNana]

Thank you Ravi! Keep being awesome and give em your best shot. Stay safe. 😇

[@rahulsoni7991]

Nana, your explanation is quite simple and powerful. This is the first time I was studying Prometheus and understood the basics in just a few minutes. Next, I'm figuring out on setting it up in Linux to monitor my Spring MicroServices. Let me know if you have any videos on this. Also, I am subscribing to your channel now. Keep up the good work. Thanks!

[@PeterMoueza]

Good sum up ! Thanks ! A timeline : 0:44 bare servers traditional servers 11:31 own applications client libraries languages 17:56 Grafana 18:57 Grafana

[@vivekkataria5915]

By far the best explanation, not for just this video but overall content of channel. Focusing on basic make it easy to understand. Big Thanks Nana

[@motarski]

I will not be wrong when I say this is by far the best Video on the net explaining on a high level Prometheus Architecture and Monitoring with the tool. Thank you so much for sharing.

[@TechWorldwithNana]

Wow, really happy to hear that! 🙂 Check out my other videos and would appreciate if you share it :)

[@JuanRoa92]

Wow! I just arrived at your video and channel. Thank you! You explained every detail of the foundation behind all of this. The usual tutorials move through the demo, but if you need more features or adapt them to your needs, you still have to dig a lot.

[@vhpupuyoh]

Thank you very much for very clear explanation. I search for such one and finally find it :-). I'm not a native English speaker so it is hard to find lecturers that talk good English and talk slowly so we can understand without stopping the video every 10 sec. You are talking in very clear manner - please continue like that. I signed up to your channel. Thanks again

[@TechWorldwithNana]

Thanks for this amazing feedback! Really happy to hear :)

[@markbdsouza]

Just wanted to say this video is brilliant. Ive joined a new team that use Prometheus and Grafana and this video gave me such a good understanding on Prometheus. You are a really good teacher. Keep doing what you do and thank you for your work !!

[@TechWorldwithNana]

that's amazing, really great to hear my video helped! 🙌

[@sede189]

This is a fantastic intro!!!! A million thanks for the thoughtful explanations. I look forward to seeing more of your presentations

[@TechWorldwithNana]

Hi Stephen, really happy to hear. Thank you :)

[@youmbss]

WOW JUST WOW, your talent can't be denied. I have been struggling with prometheus and you just made it easy for me. thank you

[@1234mytubeuser1234]

Best introduction about Prometheus I ever had!!!... You have a golden talent of making hard topics super simple. BTW Nana, did you get a chance to work on the video "How to configure and use Prometheus for K8S". Can you also create one video on complete setup of K8S + Prometheus + Grafana? TIA.

[@TechWorldwithNana]

Hi Amit, thank you for your feedback! 🙂 Btw the 1st part of the demo video is out, which is the setup :)

[@joenyugoh1179]

So true, very simple description to such a complex topic. Thanks Nana

[@dorjeetsering937]

Great clarity and coverage in just 20 minutes. Thanks Nana. Keep it up.

[@TechWorldwithNana]

Thanks, glad you learned a lot in those 20mins :) Yes will do, many great tutorials are coming 💪🏼 :)

[@DontTakeCrack]

ty for this, i learned prometheus a couple years ago and have been somewhat managing it and it was clear to me there was a much easier way to represent that documentation. i think this is great and should sit on the front page of prometheus docs itself.

[@santoshkarthedath3876]

This is an amazing intro for Prometheus - thank you Nana. Please publish more Prometheus/Jaeger/Grafana use cases. Thank you !!

[@TechWorldwithNana]

Thank you Santosh! Will definitely do!

[@RohitMishra-vl1vp]

Concepts are explained with clarity... Very impressive... Perhaps one of the best video for Prometheus present .. Amazing

[@TechWorldwithNana]

Wow thank you Rohit, happy you think so :D

[@hamtuber]

Just brilliant. I feel like an expert on the subject after each of your videos, thanks!

[@TechWorldwithNana]

That's great :D

[@shivashishsingh5915]

This is what I was looking for. This is what you get in premium courses. Very simply explained and smartly crafted video. Thank you..!!

[@TechWorldwithNana]

Thank you so much for this feedback :)

[@soheilrahsaz727]

This the second video I've watched in this channel and I can already say that you explain really great and talk about all the interesting parts. Thank you

[@SamuelTambunan]

It is amazing how you explain it, for me who has no idea what prometheus is and curious in understanding it and where I intent to pick a monitoring tools to implement, I have no trouble in understanding how prometheus works and what value it brings. Thank you very much. Really looking forwards for your contents in this channel.

[@TechWorldwithNana]

Wow thank you Samuel, that's a really great feedback! Hope you will like the upcoming videos too :)

[@philipackerley5775]

Fantastic intro to the product. Clarity at last!

[@TechWorldwithNana]

Thank you Philip! :) Happy that it was helpful for you!

[@pixiedustdreams]

Agree!! Thank you for this

[@coolinark]

Brilliantly explained! All your vids are pure gold and diamonds! Thank you so much for your work, dear Nana!

[@TechWorldwithNana]

Hi, thank you so much, happy you like my videos :)

[@sumitology]

To be honest you made it look easier. As of now this is the best video for getting started with Prometheus.

[@samirchandra2637]

You explained it very beautifully with the art of explaining in a simple way. Appreciated !!!

[@TechWorldwithNana]

Thank you Samir :)

[@nmhmm2472]

You are such amazing talented teacher I have ever been know

[@perseapina]

i had to learn prometheus for my job recently and this playlist was really helpful, thanks!

[@jimmyz80]

This video is fantastic. Clearly outlined all of the relevant information I was looking for, to get a basic understanding of Prometheus. Thanks!

[@rameshbhaskar]

This is a very helpful overview of Prometheus. Very well put together. Thank you for doing this.

[@yilativs]

Thank you! Best introductions on DevOps topics i've ever seen.

[@prathameshtakane7354]

I cant explain in words how much I appreciate this video, thank you so much

[@abhi_galav]

absolute legend..please reproduce so that we have more people like you

[@amareshnayak8055]

Excellent clarity with explanation of real time scenarios.Great Job! much appreciated.

[@TechWorldwithNana]

Thanks for your feedback, happy to hear :)

[@jeffreygnanasoundarjohnsel5455]

One of best tutor found in KZbin

[@Lulublinkstay]

Thank you Nana. It was really helpful. You have opened another door to enrich our application.

[@pg5201]

Awesome wrap up! Exactly what I needed! Thanks 🙏

[@varshasingh1299]

Thank you so much for making this video in such a simple and efficient way ❤️

[@frekehkhouri]

You are amazing! Can't believe how easy it is to understand these topics by watching your videos.

[@CaryZhuangzhiLi]

Nana, thank you for the fantastic video! I have a few questions on the push/pull method comparison that started around 12:41. 12:41 - Isn't network traffic determined by the amount of data that's collected? So if the monitoring targets and granularity are the same, the push or pull model would generate the same network traffic, right? 13:02 - Using daemons to push metrics for an application that doesn't have library support. I thought this would be very similar to applications that don't have native Prometheus support - it has to use an exporter sidecar to provide a scraping endpoint. It seems to me these are the same between the two models. 13:23 - Better detection if service is up and running. I also agree to pull model works better in most cases. For the push method, when the monitoring server detects service is not pushing data, it can also treat it as a failure. The pull model is a bit more straightforward, and it sees problems very quickly. However, it could also suffer from network problems. So I thought both methods could trigger potential false alarms the same way.

[@devashishsingh4841]

You are killing it nana ☑💯

[@BindasBadshah]

What a brilliant tutorial. Thank you for the efforts!

[@TechWorldwithNana]

Thanks, glad you liked it! Hope you check out my other videos too 🙂

[@jlesseyp]

Wow, great explanation!, just what I needed. I have a very clear idea of what Prometheus is and what it does. Thank you!

[@TechWorldwithNana]

That's great, thank you Juan for your feedback! :)

[@ahanamallik340]

Very comprehensive video with all important points covered for a beginner

[@pp76339]

Thanks a lot Nana for the awesome explanatory video. Sincerely appreciate what you are doing for the dev community.

[@SuperPoower]

This is actually awesome... I'm hooked to your channel!!

[@TechWorldwithNana]

Thank you Laryssa :) Happy to hear that!

[@princeabhi9985]

Thank you Nana, after watching your videos I am grooming myself better than before.

[@douglasholman6300]

Thanks Nana, I appreciate your content! I am excited to learn about monitoring your Kubernetes cluster with Prometheus!

[@TechWorldwithNana]

Thanks a lot Douglas! :)

[@IanOnyango]

Hi Nana, thank you so much for this video. Ever since I got into this DevOps world, I follow your tutorials and explainer videos religiously. Could you please do one on Fluentd, briefly explaining what its use cases and how it differs from Prometheus?

[@rajeevsinha2632]

As usual, clear and concise content. Very much appreciated.

[@mateidavid3411]

Really tutorial and very well explained, thank you!

[@akhleshkumarjaiswar9364]

Hey TechWorld with Nana, your effort taken to these vlogs really makes me understand so clearly. #thanks

[@TechWorldwithNana]

Thank you. Happy to help. 🙂

[@ahmedosama3380]

Outstanding explanation!! Thank you for the amazing efforts.

[@fonosayno]

This was an excellent and very helpful tutorial. Thank you!

[@dobo7227]

This is a very well done video! Thank you for the information

[@kpvsharma1986]

Exactly what I need, thank you

[@elenapliakas6427]

Wow, thanks for this video. Really need this overview with just enough details

[@TechWorldwithNana]

Thanks Elena, glad you liked my way of explaining the topic 🙂

[@bmejia220]

Great explanations, clearly illustrate the use case with great details. Thanks so much!

[@ankurgupta9609]

Best introduction about Prometheus I ever had, Thank you so much. When are you releasing the video about practical example of setting it up with Kubernetes? Also, Do you have a site or blog?

[@TechWorldwithNana]

Cool, glad you liked it so much! :) I don't know yet, will try to make it as soon as possible - realistically it will be in the next 2 months. Stay tuned. I'm on DEV.to, Twitter, Instagram, LinkedIn, Facebook - check out the links here kzbin.infoabout

[@TechWorldwithNana]

Hi, just wanted to let you know that I have released the first part of the demo video =)

[@ankurgupta9609]

@@TechWorldwithNana Thank you so much :)

[@rambarambabbu]

Best explanation i have ever watched. Thank you so much 🙏🏻🙏🏻🙏🏻🙏🏻

[@troom6851]

Incredible. After watching this video I am sure that subscribing to your channel is a very good idea. Thanks so much for the complete Prometheus explanation.

[@TechWorldwithNana]

Thanks a lot Troom! Subscribing is for sure a great idea! :D 👍 Many interesting topics coming and I'll give the best to make them as helpful as possible. If you would like to see any specific topic, just let me know. I consider suggestions for future videos :)

[@ricrui3]

Esta es una increible introduccion a Prometheus, muy bien explicada y facil de entender.

[@rsrini7]

Each and every video talks your in-depth knowledge and the way you teach. Simply wow... Many of the concepts are neatly explained... Thanks. Pressed the Bell Icon and awaiting for more videos. Love from India.

[@TechWorldwithNana]

Wow really happy to hear :) Thank you so much and greetings to India! 🇮🇳

[@cosmetolog__d]

Nana, you are doing great job, bringing your knowledge and experience into the mass! Your videos are something special to me. Need to implement some monitoring into our evnrionment, so decided to give a chance to Prometeus. KZbin just instantly directed me to your channel, and it cool! P.S. Keep doing what you doing!

[@dma98]

Oh the relief of deciding to build some service, looking up tutorials and finding that Nana has a video already, it just can't be explained

[@surprino]

These videos helped me a lot when as a refresher for my interviews... Thank You very much

[@basultobd]

This is beautiful, thank you Nana, you are the best!

[@TechWorldwithNana]

Thanks Daniel :D

[@Max-qn7gh]

Please more about Prometheus. :) Just found your channel. I love it

[@TechWorldwithNana]

Awesome, will do :) Check out my other videos in the meantime 🙂

[@TechWorldwithNana]

Hi Max, I released the next video for Prometheus yesterday, if you would like to check it out ;)

[@Max-qn7gh]

@@TechWorldwithNana Awesome, i will check it out right now. =) Thank you

[@JerryGoNuts]

Sending much love!!! I love your tutorials. I have learned so much from your videos. Keep up the great work.

[@francis5247]

Amazing job Nana. Well structured better explained.

[@franfernandez694]

Brilliant video Nana, thanks for sharing!

[@irinastepanov4959]

amazing video! thank you for covering all the grounds in 20 minutes :)

[@devops_sensei]

Very informative. Looking forward to going through your other tutorials and videos. Cheers!

[@sauravkumar-bp3es]

Well explained and very nice teaching style. Thank you so much for this lecture.

[@phanikumar3236]

I really admire the way of explanation and also thank you very much for sharing such a wonderful knowledge to every one. I am waiting for next video about ISTIO :)

[@TechWorldwithNana]

Thanks for your feedback phani :)

[@masilok]

Very good explanation for a beginner like myself, thank you ☺️

[@jasmineverdant]

you're an absolute GEM. keep it up!

[@TechWorldwithNana]

Thanks :D

[@vollmerama]

Its amazing how well you explain things. Thank you