Рет қаралды 453
In this session, we explain how to evolve the schema, partitioning scheme, and underlying data in the tables within a modern data lake. We explain the mechanics of schema evolution, partition evolution, and the performance tradeoffs of using a copy-on-write vs merge-on-read strategy for your read-and-write workloads. We then do a guided exercise to observe these techniques in practice within our hands-on MinIO modern data lake environment.
To get the most out of this exercise, follow along inside your own data lake environment. Instructions for setting that up are below:
Video Instructions - • MinIO Modern Data Lake...
Reference Repo - github.com/min...
MinIO is an open-source object storage server released under the GNU AGPL v3 license. It's compatible with Amazon S3, making it a great choice for deploying your storage infrastructure on Kubernetes.
Connect with us:
Website: min.io/
LinkedIn: / minio-inc-
Twitter: / minio
Docs: min.io/docs/mi...
Slack: minio.slack.com/
#ObjectStorage #MultiCloud #CloudNative #Kubernetes #ObjectStore