Рет қаралды 1,095
Data Observability, borrowing ideas from Software Observability, pertains to the ability to understand the full data lifecycle in an organization. It involves monitoring and managing the internal state of data systems from ingestion to storage and usage. It is about gaining insight into the data pipeline, understanding how data evolves, and identifying any issues that could compromise its integrity or reliability.
In this Observability Lab, David Bruendl and Wolfgang Beer explain how #Dynatrace Davis Anomaly Detection can be applied to the 5 Pillars of Data Observability: Freshness, Distribution, Volume, Schema, and Lineage.
David and Wolfgang show us how Davis Anomaly Detection based on any data in Grail can be applied in Notebooks, Dashboards, Workflows, and in the recently introduced Davis Anomaly Detection App to automate the alerting on Data Observability issues!
Links discussed:
Introduction to Anomaly Detection based on DQL: • Introduction to Anomal...
Data Observability with Dynatrace: dynatr.ac/4b90o7U
Davis Anomaly Detection: dynatr.ac/4biQpN2
Blog on Data Observability: dynatr.ac/4b63JUW
Blog on the Importance of Data Quality: dynatr.ac/3WvxnP9
Chapter List:
00:00 - Introduction
00:50 - What you will be learning today
01:22 - Recap of Anomaly Detection with DQL session
04:00 - What is Data Observability?
05:03 - Data-driven Enterprises
06:06 - Example of Data Pipelines such as ETL
08:25 - 5 Pillars of Data Observability
12:02 - Live Demo of Data Observability with Dynatrace
Subscribe to our channel → dynatr.ac/subscribeYT
Stay up-to-date with Dynatrace! Follow us on:
Facebook → / dynatrace
Instagram → / dynatrace
LinkedIn → / dynatrace
Twitter / X → / dynatrace
Twitch → / dynatrace
Have a question about our platform? Visit our Dynatrace Community to connect with our experts and users → dynatr.ac/3FYfPB3