What are Metadata Driven Architectures ?

  Рет қаралды 2,107

BigData Thoughts

BigData Thoughts

Күн бұрын

Пікірлер: 5
@AdnanKhan-kf2bm
@AdnanKhan-kf2bm 10 ай бұрын
Thank You Very Much for Explaining the concept in simple way. I had no idea about Meta Data driven prior watching your video , Now I have a fair idea about it, Thanks again.
@BigDataThoughts
@BigDataThoughts 10 ай бұрын
thanks
@AnandKumar-dc2bf
@AnandKumar-dc2bf Жыл бұрын
Can you do one video or 2 on real-time issues in Apache spark
@sarfarazhussain6883
@sarfarazhussain6883 Жыл бұрын
One quick Q, let's say my schema or Metadata has a column "ID" as Long and using that I already created my table in Lakehouse, after a month application team changed the ID from Long to String, how am I going to handle it without reprocessing the entire table?
@BigDataThoughts
@BigDataThoughts Жыл бұрын
yes for data type change you would need to reprocess(its a destructive change). Using a metadata framework doesn't mean that there would be no reprocessing at any point of time but it ensures we reduce code changes for many scenarios. Typically constructive changes like adding a new column.
All about Debugging Spark
18:29
BigData Thoughts
Рет қаралды 4 М.
Mom had to stand up for the whole family!❤️😍😁
00:39
😜 #aminkavitaminka #aminokka #аминкавитаминка
00:14
Аминка Витаминка
Рет қаралды 2 МЛН
Cool Parenting Gadget Against Mosquitos! 🦟👶 #gen
00:21
TheSoul Music Family
Рет қаралды 33 МЛН
The Modern Metadata Platform: What, Why, and How?
35:12
Databricks
Рет қаралды 6 М.
Creating a modern data platform: Data modernization and driving value
36:20
Spark Architecture in Depth Part1
13:02
BigData Thoughts
Рет қаралды 4,7 М.
Delta Live Tables  || Metadata Driven end to end data pipeline with Parallel Execution #dlt
17:46
Software Development Engineer in Test
Рет қаралды 2 М.
Fabric Metadata Pipeline Finish
16:55
Baker Tilly US
Рет қаралды 789
Evolution of Data Architectures in last 40 years
21:26
BigData Thoughts
Рет қаралды 478
What is ETL | What is Data Warehouse | OLTP vs OLAP
8:07
codebasics
Рет қаралды 424 М.
What is Event Driven Architecture (EDA)?
12:10
IBM Technology
Рет қаралды 185 М.
Mom had to stand up for the whole family!❤️😍😁
00:39