No video

Apache XTable (incubating): Interoperability among lakehouse table formats

  Рет қаралды 379

Dremio

Dremio

Күн бұрын

Apache Hudi, Iceberg, and Delta Lake have emerged as leading open-source projects, providing decoupled storage with powerful primitives for transaction and metadata layers, commonly referred to as table formats, in cloud storage. When data is written to a distributed file system, these three formats are not significantly different. They all offer a table abstraction over a set of files, including a schema, commit history, partitions, and column stats. When engineers and organizations must choose a table format, they face a challenging decision. Each project has its rich set of features that may cater to different use cases. So, the question arises: do we really need to choose?
Enter Apache XTable-an open-source project that provides omni-directional interoperability between lakehouse table formats. XTable doesn't introduce a new or separate format but offers abstractions and tools for translating table format metadata. This allows you to write data in any format of your choice and convert the source table format to one or more targets that can be consumed by the compute engine of your choosing. This presentation will showcase how XTable addresses the challenging problem of selecting a specific table format and the growing need for interoperability in today's lakehouse workloads.

Пікірлер: 1
@mdafazal12
@mdafazal12 2 ай бұрын
very well explained...great job Dipankar
Open Data Foundations across Hudi, Iceberg and Delta
34:24
Data Council
Рет қаралды 2,2 М.
Magic trick 🪄😁
00:13
Andrey Grechka
Рет қаралды 45 МЛН
女孩妒忌小丑女? #小丑#shorts
00:34
好人小丑
Рет қаралды 56 МЛН
OMG what happened??😳 filaretiki family✨ #social
01:00
Filaretiki
Рет қаралды 12 МЛН
Harley Quinn's plan for revenge!!!#Harley Quinn #joker
00:49
Harley Quinn with the Joker
Рет қаралды 33 МЛН
[July 2024] Apache Hudi - Community Call
51:59
Apache Hudi
Рет қаралды 163
What is Apache Iceberg?
12:54
IBM Technology
Рет қаралды 21 М.
The Mecanum Wheel Is So Weird, It Is Genius. How It Works
12:30
Jeremy Fielding
Рет қаралды 2,4 МЛН
7 Best Practices for Implementing Apache Iceberg
57:01
Tabular
Рет қаралды 6 М.
DuckDB & Iceberg : The Future of Lightweight Data Management
1:14:57
Introducing Polaris Catalog: An Open Source Catalog For Apache Iceberg
13:43
Snowflake Developers
Рет қаралды 5 М.
Building an Open Data Lake House Using Trino and Apache Iceberg
47:06
Data Science Connect
Рет қаралды 5 М.
Magic trick 🪄😁
00:13
Andrey Grechka
Рет қаралды 45 МЛН