Memory mapping & streaming

The 🤗 Datasets library lets you use and process datasets that don't fit in RAM. Learn how it can do this with memory mapping and how to use the streaming feature.
This video is part of the Hugging Face course: huggingface.co/...
Open in colab to run the code samples:
colab.research...
Related videos:
Loading a custom dataset - • Loading a custom dataset
Slide and dice a dataset 🔪 - • Slice and dice a datas...
Don't have a Hugging Face account? Join now: huggingface.co/...
Have a question? Checkout the forums: discuss.huggin...
Subscribe to our newsletter: huggingface.cu...