Data Engineer's Lunch 106: Designing an analytics pipeline with BigQuery and dbt: a walkthrough

  Рет қаралды 380

Anant Corp

Anant Corp

Күн бұрын

This talk covers a walkthrough of a personal project to build a batch ELT pipeline to gather, transform, and prepare tennis match level data for analysis. Tools used include Python and Prefect for extraction and orchestration, BigQuery for data warehousing, and dbt for transformation.Transformed data is visualized in Looker Studio.
Accompanying SlideShare: Coming Soon!
Sign Up For Our Newsletter: eepurl.com/grdMkn
Join Data Engineer’s Lunch Weekly at 12 PM EST on Mondays:
www.meetup.com...
Cassandra.Link:
cassandra.link/
Follow Us and Reach Us At:
Anant:
www.anant.us/
Awesome Cassandra:
github.com/Ana...
Email:
solutions@anant.us
LinkedIn:
/ anant
Twitter:
/ anantcorp
Eventbrite:
www.eventbrite...
Facebook:
/ anantcorp
Join The Anant Team:
www.careers.an...
#data #dataengineering #datalakehouse

Пікірлер
Delta Live Tables A to Z: Best Practices for Modern Data Pipelines
1:27:52
Squid game
00:17
Giuseppe Barbuto
Рет қаралды 38 МЛН
100km/h Reflex Challenge 😱🚀
00:27
Celine Dept
Рет қаралды 156 МЛН
Когда учитель вышла из класса
00:17
ЛогикЛаб #2
Рет қаралды 2,7 МЛН
System Design  - Run DBT workload on Cloud Composer 2
24:17
PracticalGCP
Рет қаралды 2,5 М.
Why use DuckDB in your data pipelines ft. Niels Claeys
22:26
MotherDuck
Рет қаралды 25 М.
Simon Sinek's Advice Will Leave You SPEECHLESS 2.0 (MUST WATCH)
20:43
Alpha Leaders
Рет қаралды 2,8 МЛН
Building Production RAG Over Complex Documents
1:22:18
Databricks
Рет қаралды 27 М.
Using dbt And Snowflake To Develop And Deploy Analytics Code  | LAB
1:17:39
Snowflake Developers
Рет қаралды 36 М.
How to get started with BigQuery
17:19
Google Cloud Tech
Рет қаралды 51 М.
dbt(Data Build Tool) crash course for beginners: Zero to Hero
1:23:49
Squid game
00:17
Giuseppe Barbuto
Рет қаралды 38 МЛН