Self-Hosted LLMs on Kubernetes: A Practical Guide - Hema Veeradhi & Aakanksha Duggal, Red Hat

  Рет қаралды 2,353

CNCF [Cloud Native Computing Foundation]

CNCF [Cloud Native Computing Foundation]

Күн бұрын

Пікірлер: 3
@LanTran-jo9od
@LanTran-jo9od 4 ай бұрын
the title is hosting in k8s. However, the recorded video is for running in local. Did I miss anything?
@abdullahalshater2365
@abdullahalshater2365 27 күн бұрын
No, you were miss led :)
@east4ming
@east4ming 8 ай бұрын
This is a step-by-step, informative, hands-on guide. Very well presented, thank you!
Unleashing the Power of DRA (Dynamic Resource Allocation) for Just-in-Time GPU Slicing
39:03
CNCF [Cloud Native Computing Foundation]
Рет қаралды 1,3 М.
Comparing Sidecar-Less Service Mesh from Cilium and Istio - Christian Posta, Solo.io
37:15
CNCF [Cloud Native Computing Foundation]
Рет қаралды 5 М.
Why no RONALDO?! 🤔⚽️
00:28
Celine Dept
Рет қаралды 102 МЛН
Players push long pins through a cardboard box attempting to pop the balloon!
00:31
Homomorphic Encryption in the Open Source World - Aakanksha Duggal, Red Hat
32:43
Object, Block, or File Storage? Choosing the Right Cloud Storage to Integr... M. Becker, T. McDonald
29:38
How to Deploy LLM in your Private Kubernetes Cluster in 5 STEPS | Marcin Zablocki
17:24
GetInData | Part of Xebia
Рет қаралды 2,3 М.
Serving 100s of LLMs on 1 GPU with LoRAX - Travis Addair | Stanford MLSys #84
59:17
Enabling Cost-Efficient LLM Serving with Ray Serve
30:28
Anyscale
Рет қаралды 6 М.
Training Large Language Models on Kubernetes - Ronen Dar, Run:ai
27:43
CNCF [Cloud Native Computing Foundation]
Рет қаралды 1,5 М.
Future of Service Mesh- Sidecar or Sidecarless or Proxyless? - Levine Kohavi, Mattix, Norman, Howard
37:40
All You Need To Know About Running LLMs Locally
10:30
bycloud
Рет қаралды 180 М.