How to use dbt Snapshots to track data history

  Рет қаралды 14,819

Kahan Data Solutions

Kahan Data Solutions

Күн бұрын

Пікірлер: 18
@KahanDataSolutions
@KahanDataSolutions Жыл бұрын
Get my Modern Data Essentials training (for free) & start building more reliable data architectures www.ModernDataCommunity.com
@jppbkm
@jppbkm Жыл бұрын
After going through the first 25% of the playbook and then stopping....here I am again googling answers to a work problem and finding your videos. Appreciate all the info and content. (Our issues was an incorrect unique_key setting on a table where the snapshot was created HUGE tables as a result.)
@anbarasuramachandran2235
@anbarasuramachandran2235 Жыл бұрын
Awesome. Helped in understanding the concept of Slowly changing dimensions (SCD) !
@KahanDataSolutions
@KahanDataSolutions Жыл бұрын
Glad it helped!
@dominicaleung7329
@dominicaleung7329 Ай бұрын
thank you so much for your help. You make it very clear. I got mine snapshot working now.
@KahanDataSolutions
@KahanDataSolutions 29 күн бұрын
Glad it helped!
@anushanr1355
@anushanr1355 Жыл бұрын
Hi, please make a detailed video on dbt analytics certification. As I am preparing for that it would be much helpful. Appreciate your works on data engineering
@gauravsati1041
@gauravsati1041 2 ай бұрын
Hi , How we can set DBT_VALID_TO default Null values to something other max number
@rajasekharreddy113
@rajasekharreddy113 19 күн бұрын
Thank you for the video. One question, Once snapshot is taken, it is best practice to use snapshot tables or source tables for working with other models? if snapshot is answer, how frequently, we have to update snapshot tables? or we have to trigger them for every update
@rusttaf
@rusttaf 11 ай бұрын
Hi, thanks for explaining this concept. Is there a way to set valid to date of ending record to d-1? This way using between in where condition will return 2 records instead of 1
@nainatiwari4543
@nainatiwari4543 Жыл бұрын
Hey ,What have you mentioned in yml file? As I was trying to do this way but the staging model could not refer the snapshot due to some reason.
@arbol41
@arbol41 Жыл бұрын
Thank for a very good content, I have a question how we can track deleted raw from the source ?
@mrp12-ii
@mrp12-ii Ай бұрын
soft deletes, CDC or snapshots would be the way to go.
@BreathOfHopePodcast
@BreathOfHopePodcast 15 күн бұрын
i ran from data science because of I knew I couldn't keep up with all the statistical readings
@100sabh
@100sabh Жыл бұрын
I find snowflake streams to be better than this concept
@dimi727
@dimi727 8 ай бұрын
is it possible to partition snapshots (especially for Bigquery?)
@mallninja9805
@mallninja9805 Жыл бұрын
You're a "Solutions Architect". Do you really need to nickel and dime your youtube audience to death with "courses" ?? You should feel shame.
@ingenieroriquelmecagardomo4067
@ingenieroriquelmecagardomo4067 11 ай бұрын
why did you even bother writing this lmao, youre not even a content creator
5 Tips to Improve Your dbt Project
8:13
Kahan Data Solutions
Рет қаралды 51 М.
Which One Is The Best - From Small To Giant #katebrush #shorts
00:17
Как подписать? 😂 #shorts
00:10
Денис Кукояка
Рет қаралды 7 МЛН
HAH Chaos in the Bathroom 🚽✨ Smart Tools for the Throne 😜
00:49
123 GO! Kevin
Рет қаралды 15 МЛН
Apple peeling hack @scottsreality
00:37
_vector_
Рет қаралды 132 МЛН
Handle JSON with dbt // jinja & macros
16:56
Kahan Data Solutions
Рет қаралды 25 М.
dbt Environments vs Targets | What's the Difference?
10:21
Kahan Data Solutions
Рет қаралды 7 М.
how to use dbt snapshot to manage slowly changing dimensions
7:26
BI Insights Inc
Рет қаралды 763
7 Database Design Mistakes to Avoid (With Solutions)
11:29
Database Star
Рет қаралды 78 М.
Data Modeling Tutorial: Star Schema (aka Kimball Approach)
16:34
Kahan Data Solutions
Рет қаралды 113 М.
Airflow with DBT tutorial - The best way!
17:54
Data with Marc
Рет қаралды 46 М.
Intro to DBT YML Files
13:11
dbtutty
Рет қаралды 910
Use hooks to simplify repetitive dbt run activities
7:06
Kahan Data Solutions
Рет қаралды 25 М.
dbt. Снэпшоты и метрики
15:33
M&H Corporate Channel
Рет қаралды 628
What is DBT | Data Build Tool | Real Time Project Flow | DBT Demo Videos
37:17
Praveen Kumar Bommisetty
Рет қаралды 24 М.
Which One Is The Best - From Small To Giant #katebrush #shorts
00:17