Reducing data pre-processing time by 95% using Ray

  Рет қаралды 1,460

Container Bytes

Container Bytes

Күн бұрын

In ML your model is as good as your data. Often this crucial step is overlooked.
In this video Google Solutions Architect Shobhit and Kavitha walks through a reference solution where they managed to bring down data pre-processing of downloading over 20,000 data points each with multiple image URLs from 8+ hour to just about 20 minutes using Ray workers.
Ray is an open-source unified compute framework that makes it easy to scale AI and Python workloads - from reinforcement learning to deep learning to tuning, and model serving.

Пікірлер: 4
@stanrock8015
@stanrock8015 4 ай бұрын
Great video. Will target Ray at next
@NameSingh-eg5ky
@NameSingh-eg5ky 4 ай бұрын
Can you give the link to notebook to practice
@stanrock8015
@stanrock8015 4 ай бұрын
Please add links you mentioned
@ContainerBytes
@ContainerBytes 4 ай бұрын
Coming soon!
Apple beats EVERYONE to share LLM Secrets!!!
11:54
1littlecoder
Рет қаралды 15 М.
Heartwarming Unity at School Event #shorts
00:19
Fabiosa Stories
Рет қаралды 20 МЛН
路飞被小孩吓到了#海贼王#路飞
00:41
路飞与唐舞桐
Рет қаралды 81 МЛН
Задержи дыхание дольше всех!
00:42
Аришнев
Рет қаралды 2,3 МЛН
Architecture of a ML Platform with Resource Sharing on Kubernetes
16:41
Serve LLM on Google Kubernetes Engine on L4 GPUs
16:51
Container Bytes
Рет қаралды 386
MLOps 1 - Getting Started
9:12
ABC-ML
Рет қаралды 97
Using dynamic arrays in a Table : 4 methods | Excel Off The Grid
8:07
Excel Off The Grid
Рет қаралды 3,3 М.
Do NOT Learn Kubernetes Without Knowing These Concepts...
13:01
Travis Media
Рет қаралды 254 М.
6 Tips For Designing a REST API That Doesn’t SUCK
23:32
ArjanCodes
Рет қаралды 18 М.
Arcee-Nova: a new high for open-source language models!
12:29
Julien Simon
Рет қаралды 3,7 М.
AI business ideas funded by YCombinator
16:31
Harshit Tyagi
Рет қаралды 18 М.
Lessons From A Year Building With LLMs
35:21
AI Engineer
Рет қаралды 9 М.
Building Production-Grade LLM Apps
59:53
DeepLearningAI
Рет қаралды 22 М.
Как удвоить напряжение? #электроника #умножитель
1:00
Hi Dev! – Электроника
Рет қаралды 984 М.
Самый тонкий смартфон в мире!
0:55
Не шарю!
Рет қаралды 160 М.
Как распознать поддельный iPhone
0:44
PEREKUPILO
Рет қаралды 2,1 МЛН