Mini Data Engineering Project: Monitor Apache Airflow with Airbyte, Snowflake, and Superset

  Рет қаралды 3,108

Data with Marc

Data with Marc

Күн бұрын

Mini Data Engineering Project: Monitor Apache Airflow with Airbyte, Snowflake, and Superset
Notion Page: robust-dinosau...
In this video, you will build a dashboard to monitor your Airflow instance using different metrics.
You will learn:
✅ Using the Airflow REST API to build metrics
✅ Extracting data from your Airflow instance using Airbyte
✅ Creating an Airflow connector with the Airbyte AI Builder
✅ Storing data of your Airflow instance into Snowflake with Airbyte
✅ Defining metrics to monitor with Superset
✅ Running Airflow in the cloud with Astronomer
and more!
Enjoy ❤️

Пікірлер: 10
Loading data into S3 Iceberg Tables with AWS EMR and Apache Airflow
22:45
SPLASH BALLOON
00:44
Natan por Aí
Рет қаралды 27 МЛН
ПОДРИФТИЛ С БАБУЛЕЙ #shorts
00:22
Паша Осадчий
Рет қаралды 2,5 МЛН
Thank you 😅
00:15
Nadir Show
Рет қаралды 46 МЛН
Last Person Hanging Wins $10,000
00:43
MrBeast
Рет қаралды 151 МЛН
What's new in Apache Airflow 2.7?
12:55
Data with Marc
Рет қаралды 4,8 М.
Build an AI Agent and talk to your Airflow DAGs
16:54
Data with Marc
Рет қаралды 1,9 М.
Getting Started with Prefect | Task Orchestration & Data Workflows
26:40
Kahan Data Solutions
Рет қаралды 44 М.
Master Apache Airflow: 5 Real-World Projects to Get You Started
13:18
Darshil Parmar
Рет қаралды 14 М.
Airflow with DBT tutorial - The best way!
17:54
Data with Marc
Рет қаралды 54 М.
SPLASH BALLOON
00:44
Natan por Aí
Рет қаралды 27 МЛН