Querying Azure Log Analytics (with KQL)

[@TenMinuteKQL]

Great video!

[@CoopmanGreg]

👍 Great stuff! Well presented!

[@claire7633]

Hi, Dustin! Thanks for your video, it’s very helpful. However, I had an issue when I tried to query memory usage for databricks at log analytics. I know the memory usage for driver node by name_s contains driver.jvm.total. But I have no idea how to query the total memory usage(both worker and driver nodes). Do you know how to do that? Many thanks!

[@DustinVannoy]

I typically look at that in the Metrics tab (Ganglia) within Databricks. There is a chart showing recent memory usage across the cluster and then at the bottom you can choose a metric like mem-free to see how much is free per node. If you search for name_s contains 'mem' or name_s contains 'heap' you may get some interesting metrics. If I get a chance to find exact names in Log Analytics I will add more info here.

[@hashilbh5654]

do you have sample query for getting AKS pod logs.

[@DustinVannoy]

I don't have anything around that, but this other video may be helpful. kzbin.info/www/bejne/jnbHqHqsiJd0raM

[@ganeshbudkhale9165]

Thanks for video👌 Can we create a shared dashboard using these queries and visualize it? If yes then how?

[@DustinVannoy]

You could build something in Azure Portal by following these steps in the docs: docs.microsoft.com/en-us/azure/azure-monitor/visualize/tutorial-logs-dashboards. You can export to Power BI and there is a way to setup that connection to refresh and share from Power BI Service. I will see if I can talk a colleague into posting a video about that. For the basics of how to export and run from Power BI desktop, I mention that briefly here: kzbin.info/www/bejne/nJzXq2lpqqmtg5Y