How to Monitor Nginx with Prometheus and Grafana? (Step-by-Step - Install - Monitor - Fluentd)

[@AntonPutra]

🔴 - To support my channel, I’d like to offer Mentorship/On-the-Job Support/Consulting - [e-mail]

[@AntonPutra]

❤Part 2 - How to Build Custom Prometheus Exporter? - kzbin.info/www/bejne/aai3Ya2JqLaVa5o I misspoke; this particular nginx prometheus exporter must be installed on the same VM compared to the kafka exporter, where you can specify multiple brokers.

[@bharatchopra7212]

Another great video. Thanks Anton

[@AntonPutra]

My pleasure!

[@adibgasah3557]

Thanks. Your posts videos are very useful when trying other monitoring tools and approaches!

Today is my first day at close-to-devops job and this video is helpfull.

[@pjj7466]

Excellent tutorial and I have implemented as it is and worked like charm. Keep going bro.

[@AntonPutra]

❤️

[@entretenimento_constante]

It's a very good video, very clean and organized.

[@AntonPutra]

Thanks Ferdinando!

[@chasim1982]

Thanks Great Video as always, lot of learning

[@AntonPutra]

Thanks Muhammad!

[@TheArpitkoberoi]

fluentd is resource hungry. The CPU usage slowly kept rising over 8-9 hours and suddenly spiked the memory from 1G to 8G crashing the nginx server itself causing downtime in production. This happened when the nginx server was handling just 5-6RPS.

[@AntonPutra]

Agree, try lua plugin - github.com/knyar/nginx-lua-prometheus

[@TheArpitkoberoi]

Let me check it out, thanks

[@alexr6631]

Thanks. Your posts videos are very useful when trying other monitoring tools and approaches!

[@AntonPutra]

Glad it was helpful!

[@nforlife]

Great video @anton Can you make a video on how to set up this solution on EKS?

[@AntonPutra]

Is there anything specific? Cause I have bunch of them on my channel if you search for Prometheus or Eks

[@nforlife]

I just figured out you have almost everything. Do you have a human brain or a chip 🤔 I was also wondering if you offer training in python programming for DevOps engineers

[@mechrono9555]

using docker-compose would have been a massive time and complexity saver in this project.

[@AntonPutra]

sure, i have an example in the following video - github.com/antonputra/tutorials/blob/main/lessons/141/docker-compose.yaml

[@samtx]

​@@AntonPutrahow to run docker compose on two nodes

[@AntonPutra]

@@samtx you can use minikube and spin up multiple nodes

[@samtx]

@@AntonPutra thx I was asking if docker swarm is need if to run dockercompose on multiple servers for hardware issues

[@AntonPutra]

​@@samtx You could use Docker Swarm, but it has been outdated for a while. If you need container orchestration (running containers on multiple servers), consider using k8s (Kubernetes).

[@congdatt]

Keep it up bro !!!

[@AntonPutra]

Thanks! Will do

[@rohithmn3378]

Hi @Anton Putra, Could you please make a similar video on k8s cluster to monitor Nginx with Prometheus and Grafana using fluentd.! It would be of great help.

[@spuddyminer8347]

do you have any videos with explainer on why you use a different user for each process?

[@cbabbx]

In general you want to use a different user for each process for security reasons.

[@spuddyminer8347]

assuming that it's because the program won't have permissions to make changes to my files that have permissions set so that other users can't open them...but they can still read my files. I guess there's probably some nuance here I'm missing that makes it worth it.

[@nailsv5924]

Thank a lot, for this guide!

[@AntonPutra]

my pleasure!

[@fazlurrahmatullah3017]

Hello, can u give a dashboard example for "latency traffic" like in this video?? *Sorry for my bad english

[@AntonPutra]

sure, here is source - github.com/antonputra/tutorials/tree/main/lessons/140/dashboards just import it

[@nahuszna]

I find it hard to understand your pwd as it's not shown in the terminal :( Otherwise awesome material thanks Anton!

[@AntonPutra]

Thanks for the feedback, I'll include them in the readme starting next video.

[@antgod76]

Hi. Can you explain how can we setup the terraform locally without the AWS please? Thak you.

[@AntonPutra]

You can use "docker-compose up" instead. Terraform is to create AWS VPC and EKS,

[@SanjeevKumar-nq8td]

Which capability Fluntbit does not have? Can you bit more clear on it please. Fluentbit which run as daemon set, hence should be able to read parse the log stream of Nginx?

[@AntonPutra]

I know, I just couldn't find the 3rd party plugin that i can use to parse logs and expose them as prometheus metrics. If you know one, please let me know.

[@MeroCasulli]

Amazing video, thank you! I have the following error while importing the 2nd group of panels: "Failed to upgrade legacy queries Datasource r_9gjRp4z was not found" how can i fix it? thanks

[@AntonPutra]

yes, can you try to update data source under settings (variables)

[@samuelude6858]

​@@AntonPutra​What exactly to update, seems it's the same issue with mine.

[@andriimulyk575]

Great video, can you make a video how to do something similar with nginx-ingress in K8s? I think it will be very useful

[@AntonPutra]

Well, i have bunch of videos to monit nginx ingress including this one - kzbin.info/www/bejne/jJupd619e96Jors

[@dAvid3_f]

Very nice tutorial, thanks 👍 Side note: I'm just wondering why you don't use Ansible or any other CM (config management) tool to install and configure all the dependencies ?!?

[@AntonPutra]

Thanks, I do, maybe for other videos - github.com/antonputra/tutorials/tree/main/lessons/151/ansible

[@samuelude6858]

@Anton Putra Nice video content. Followed through but noticed at the end that the imported fluentd dashboard failed with the error `Templating Failed to upgrade legacy queries` and was not able to display anything. Any idea what could be the problem as other dashboard i imported via ID worked fine or is there a way to convert from JSON to ID?

[@AntonPutra]

try to update datasource or just create a new dashboard and import quiries

[@samuelude6858]

@@AntonPutra thanks got it fixed already🙏

[@pateldivya6422]

@@samuelude6858 Heyy! can you please say how you solve this? i got same error

[@eugenechernyshenko4933]

Возможна высокая кардинальность метрик по path

[@AntonPutra]

Soglasen, but it's a good starting point

[@yashwantpatil9230]

Thanks Anton

[@AntonPutra]

welcome!

[@fazlurrahmatullah3017]

how to install set-alert? is the method the same as the Prometheus set-alert in general?

[@AntonPutra]

do you mean alertmanager? yes it's a binary, you can use systemd to manage it as well

[@fazlurrahmatullah3017]

@@AntonPutra yes, that's what i mean thanks you

[@AntonPutra]

@@fazlurrahmatullah3017 you can scroll down antonputra.com/monitoring/install-prometheus-and-grafana-on-ubuntu/

[@gabrielarispe7703]

hi your dashboard no this in the github repository

[@AntonPutra]

perhaps forgot to commit, but it's simple enough to recreate

[@AdharshSreedharan]

Great video thanks a lot

[@AntonPutra]

Thanks!

[@VRT-y3f]

Здравствуй, а как настроить для всего nginx-са , а не только для твоего тестового flask приложения?

[@AntonPutra]

Well, it's not only for the flask. You can use the path as a variable to switch between different upstream servers.

[@VRT-y3f]

@@AntonPutra , а какую именно переменную ты имеешь в виду? value в json-е на гитхабе со значением /api/devices? Помоги пожалуйста, уже долго пытаюсь настроить мониторинг 4xx и 5xx ответов nginx-а в grafana, но пока без успешно.

[@eugenegranovsky9439]

and what about monitoring nginx unit with prometheus and grafana?

[@AntonPutra]

Unit? I haven't used NGINX Unit directly, mostly ingress.

[@vtvvnha2230]

awesome

[@AntonPutra]

Thanks!

[@domingosdias5988]

Great!!!

[@ziaurrehman4738]

So fast as usual, hard to follow

[@andrewm4894]

I kinda like the speed, gets straight to it

[@andrewm4894]

Maybe try playback speed of 0.75 I tried it and seems like could help if you find it too fast

[@AntonPutra]

You can follow the blogpost - antonputra.com/monitoring/monitor-nginx-with-prometheus/#intro

[@mikoo1991]

Templating Failed to upgrade legacy queries this is what i get in grafana. 2024 october. maybe ur version of grafana is younger than mine