Apache Iceberg Overview (Jan 2024 Edition) - Architecture, Ecosystem, and more!

The latest version of our Apache Iceberg Overviews, here are some relevant links:
Make a Data Lakehouse on Your Laptop Tutorial
bit.ly/am-drem...
Apache Iceberg 101 Article
bit.ly/am-iceb...
Getting Started with Dremio
bit.ly/am-drem...

[@abdullahomar9041]

This is very interesting and informative

[@Gfghb-u7w]

Looks like this cannot be used with e.g. image files?

[@TusharChoudhary-mf8df]

what is your use case this assumes that data is of the relational kind

[@anandsharma213]

Lovely presentation!

[@esmob4140]

Great explanation!

[@Dremio]

Thank you

[@emonymph6911]

Why did Dremio go with Iceberg over Hudi? Hudi seems more intuitive and flexible with the timeline approach.

[@Dremio]

www.dremio.com/blog/exploring-the-architecture-of-apache-iceberg-delta-lake-and-apache-hudi/

[@emonymph6911]

@@Dremio It's exactly that article which made me ask the question. ^.^ Don't get me wrong I'm trying Dremio right now in local docker looks amazing. But I still thought Hudi with timeline is more suitable for BI considering dates ties well together with graphs, event streams and Data Vault methodology as well. Going to watch the Xtable presentation at subsurface, looking forward to it! PS: Alex your customer care videos and docs are the best in the world for a software application. I like how you guys go at a moderate pace and cover terminologies in the tutorial before showing the ropes. Makes it an easy barrier of entry. Please keep that up. 10/10 waves!

[@Dremio]

@@emonymph6911 I think this may be answering the opposite question but this article may be helpful too: www.dremio.com/blog/dremios-commitment-to-being-the-ideal-platform-for-apache-iceberg-data-lakehouses/ I do think there is a tremendous benefit to the reusability of Iceberg's metadata structure along it's partitioning evolution and hidden partitioning features which are unique to the format.