Sorry about that I just added it the link to the github repo to the description.

It's hard to say without knowing your infrastructure. But if I had one ec2 with multiple microservices on it, depending on its current load I would probably run loki and grafana on the same ec2. But in another scenario having a dedicated ec2 for reporting in a larger environment could be a good fit as well

Thanks so much that's really nice to hear!

Prometheus uses time series data and PostgreSQL isn't to my knowledge optimized for that type of data. There are other databases that are like influxdb and it supports remote read and write. I've never used it myself because we just haven't needed any additional storage solution up to this point

I appreciate it, thanks so much!

Promtail is a log scraper. I used the default configuration but it's highly customizable and can be used to scrape logs from multiple sources and send them to loki

Thanks so much I appreciate that.

Sure thing

Wonderful. I'm glad it helped

I'm so happy it helped

You're most welcome 😁

Thanks so much 🙏

That's a good question. I'm not sure let me do some digging

Awesome! I'm so glad to hear that. It's a super cool platform.

What specifically are you trying to track? For example are you trying to track the length of time it takes a request to complete?

@@developingwoot I want to track the date + time when something got imported and the date + time of the next import. I just changed my logic to using two ObervableGauge's for it (lastImportTime, nextImportTime). Each returns a list of measurments containing a long value(unix timestamp) + tag. I basically just want to show two dates in my grafana dashboard. Last Import and next import.

The tags consist of a key "environment" and a string which represent the type of document that got imported. I'd like to create dashboards for the different tags. for example lastImportedXmlDate, lastImportedJsonDate etc. So I want more than just two dates, sorry for the wrong information. Two dates per environment.

@@catex5452 are you just wanting logs or are you charting this?

@@developingwoot I'm not sure if I know what you mean. I think I just want to display stats. (I never worked with Grafana before) Here you can see my code: using System; using System.Diagnostics.Metrics; namespace Import.FileListener { public class MetricsManager { private Meter meter; private Counter<int> importedCounter; private ObservableGauge<long> lastImportTimeGauge { get; set; } private ObservableGauge<long> nextImportTimeGauge { get; set; } private List<Measurement<long>> lastImportTimes = new List<Measurement<long>>(); private List<Measurement<long>> nextImportTimes = new List<Measurement<long>>(); // Singleton instance of MetricsManager private static readonly MetricsManager _instance = new MetricsManager("MetricsManager", "1.0.0"); public static MetricsManager Instance => _instance; private MetricsManager(string meterName, string meterVersion) { meter = new Meter(meterName, meterVersion); importedCounter = meter.CreateCounter<int>("imported-files"); lastImportTimeGauge = meter.CreateObservableGauge<long>("last-import-time", () => { return lastImportTimes; }); nextImportTimeGauge = meter.CreateObservableGauge<long>("next-import-time", () => { return nextImportTimes; }); } public void SetImportTimes(string fileName, DateTime lastImport, int intervalSeconds) { long lastTime = new DateTimeOffset(lastImport).ToUnixTimeSeconds(); long nextTime = new DateTimeOffset(lastImport.AddSeconds(intervalSeconds)).ToUnixTimeSeconds(); lastImportTimes.Add(new Measurement<long>(lastTime, new KeyValuePair<string, object>("environment", fileName))); nextImportTimes.Add(new Measurement<long>(nextTime, new KeyValuePair<string, object>("environment", fileName))); } public void Increment(string fileName) { importedCounter.Add(1, new KeyValuePair<string, object>("environment", fileName)); } } }

Thanks so much I really appreciate it

I used the configuration provided with the loki image. The .Net Web API's labels are provided via the appsettings.json file. You can configure labels as properties there, but each one creates its own stream. I haven't found a need to create more labels as of yet because parse the json and search for specific properties in when querying in Grafana. Please let me know if I didn't understand the question.

Your most welcome

Oh that's a good idea. I'll see what I can do. I hope you found what's there helpful.

​@developingwoot The video is simple and straightforward, and it is indeed very useful. Thanks for your effort.

Yes you can do that but you want to research what would work best for your implementation. For example I feel OpenTelemetry is a better option if your using microservices because with the additional libraries you can include tracing.

@@developingwoot thank you

@@developingwoot I agree. Otel and it's knowledge will help specially with microsevices

I have a video where I do this with docker and that would probably be a better option but I'll see what I can do. No promises 😉

@@developingwoot yes please if can spear some time for azure deployment.

arsbkhan please let me know if you find some thing as i also struggling for the same. may be we can help each other on this.

Thanks so much! I'm glad it helped.

Yeah I could probably do something like that are you still thinking Prometheus and Grafana? I used Docker because it is really nice in that it just starts those services for you. But I'll see what I can do.

@@developingwoot thank you for your reply.

I've posted that video for you 👍

@@developingwoot thank you so much for your effort.