Elevating Data Quality: Great Expectations and Airflow at PepsiCo

  Рет қаралды 1,748

Apache Airflow

Apache Airflow

9 ай бұрын

Presented by Russell Lamb at Airflow Summit 2023.
Discover PepsiCo’s dynamic data quality strategy in a multi-cloud landscape. Join me, the Director of Data Engineering, as I unveil our Airflow utilization, custom operator integration, and the power of Great Expectations. Learn how we’ve harmonized Data Mesh into our decentralized development for seamless data integration. Explore our journey to maintain quality and enhance data as a strategic asset at PepsiCo.

Пікірлер
Preventative Metadata: Building for Data Reliability with DataHub, Great Expectations, and Airflow
27:41
Preventative Metadata: Building for Data Reliability with DataHub, Great Expectations, and Airflow
DataHub
Рет қаралды 1,1 М.
Advanced Data Quality Use Cases with Airflow and Great Expectations
1:01:38
Advanced Data Quality Use Cases with Airflow and Great Expectations
Astronomer
Рет қаралды 6 М.
Heartwarming Unity at School Event #shorts
00:19
Heartwarming Unity at School Event #shorts
Fabiosa Stories
Рет қаралды 22 МЛН
路飞太过分了，自己游泳。#海贼王#路飞
00:28
路飞太过分了，自己游泳。#海贼王#路飞
路飞与唐舞桐
Рет қаралды 22 МЛН
ВЕНГАЛБИ ПОЛУЧИЛ ПОДАРОК за 20 МЛН! Тамаев удивил Ахмеда!
39:19
ВЕНГАЛБИ ПОЛУЧИЛ ПОДАРОК за 20 МЛН! Тамаев удивил Ахмеда!
Асхаб Тамаев
Рет қаралды 6 МЛН
Slow motion boy #shorts by Tsuriki Show
00:14
Slow motion boy #shorts by Tsuriki Show
Tsuriki Show
Рет қаралды 9 МЛН
Learn to Efficiently Test ETL Pipelines
35:13
Learn to Efficiently Test ETL Pipelines
Databricks
Рет қаралды 10 М.
Deep dive in to the Airflow scheduler
43:06
Deep dive in to the Airflow scheduler
Apache Airflow
Рет қаралды 13 М.
Lakehouse data validation with Great Expectations in Microsoft Fabric
36:18
Lakehouse data validation with Great Expectations in Microsoft Fabric
Learn Microsoft Fabric with Will
Рет қаралды 3,8 М.
Data Quality with Great Expectations
1:09:57
Data Quality with Great Expectations
NashKnolX
Рет қаралды 314
Data Reliability Engineering: A New Approach to Data Quality | Bigeye
21:51
Data Reliability Engineering: A New Approach to Data Quality | Bigeye
Data Council
Рет қаралды 6 М.
Open-Source Spotlight - Great Expectations (Data Quality Platform) - James Campbell
23:40
Open-Source Spotlight - Great Expectations (Data Quality Platform) - James Campbell
DataTalksClub ⬛
Рет қаралды 6 М.
How to begin writing data tests with Great Expectations
19:45
How to begin writing data tests with Great Expectations
DataEngineerOne
Рет қаралды 13 М.
DataOps in action with Nessie, Iceberg and Great Expectations
22:14
DataOps in action with Nessie, Iceberg and Great Expectations
Dremio
Рет қаралды 1 М.
Airflow Tutorial: Running Data Quality Checks with Snowflake and Soda
28:06
Airflow Tutorial: Running Data Quality Checks with Snowflake and Soda
Data with Marc
Рет қаралды 7 М.
Automated Testing For Protecting Data Pipelines from Undocumented Assumptions
18:35
Automated Testing For Protecting Data Pipelines from Undocumented Assumptions
Databricks
Рет қаралды 4,9 М.
8 Товаров с Алиэкспресс, о которых ты мог и не знать!
49:47
8 Товаров с Алиэкспресс, о которых ты мог и не знать!
РасПаковка ДваПаковка
Рет қаралды 151 М.
iPhone socket cleaning #Fixit
0:30
iPhone socket cleaning #Fixit
Tamar DB (mt)
Рет қаралды 16 МЛН
Samsung laughing on iPhone #techbyakram
0:12
Samsung laughing on iPhone #techbyakram
Tech by Akram
Рет қаралды 4,4 МЛН
Что делать если в телефон попала вода?
0:17
Что делать если в телефон попала вода?
Лена Тропоцел
Рет қаралды 2,8 МЛН
Полная версия на @brother-live Запустил серверный комп который нашёл на радиоэлектронной свалке))
0:49
Полная версия на @brother-live Запустил серверный комп который нашёл на радиоэлектронной свалке))
Brother-live_mob
Рет қаралды 1,5 МЛН
Хакер взломал компьютер с USB кабеля. Кевин Митник.
0:58
Хакер взломал компьютер с USB кабеля. Кевин Митник.
Последний Оплот Безопасности
Рет қаралды 501 М.
Запрещенный Гаджет для Авто с aliexpress 2
0:50
Запрещенный Гаджет для Авто с aliexpress 2
Тимур Сидельников
Рет қаралды 531 М.