KubeRay: A Ray cluster management solution on Kubernetes

Managing Ray clusters and workloads on Kubernetes can be challenging. KubeRay provides an open-source toolkit to manage the lifecycle of Ray clusters and simplify the deployment process of Ray Applications on Kubernetes. In this talk, we will talk about:
1. How KubeRay integrates with the Kubernetes ecosystem? (e.g. observability, ingress, prototyping, scheduling)
2. What capabilities exist in KubeRay? (e.g. autoscaling, fault-tolerance, high-available serving deployment, batch job)
3. Performance/Stability/Scalability benchmarks
Find the slide deck here: drive.google.c...
About Anyscale
---
Anyscale is the AI Application Platform for developing, running, and scaling AI.
www.anyscale.com/
If you're interested in a managed Ray service, check out:
www.anyscale.c...
About Ray
---
Ray is the most popular open source framework for scaling and productionizing AI workloads. From Generative AI and LLMs to computer vision, Ray powers the world’s most ambitious AI workloads.
docs.ray.io/en...
#llm #machinelearning #ray #deeplearning #distributedsystems #python #genai

[@hsubyron2277]

GOAT

[@fabsync]

great video and integration with kubernetes! It will be great how can you use that for local developement...

[@mattgrant4143]

Hi! What are the chances we can get the source code for this demo!! Trying to learn about KubeRay myself, have a k8s cluster (with gpu and taints setup, but cant get kuberay to play nicely with them. my job just gets stuck w/ pending)