Slaying OOMs - Mark Saroufim & Jane Xu, Meta

  Рет қаралды 642

PyTorch

PyTorch

Күн бұрын

Пікірлер: 2
@mkamp
@mkamp 2 ай бұрын
Awesome presentation style. Love the language, the humor and the sketched diagrams, that are used consistently throughout. World class.
@mcmc6052
@mcmc6052 2 ай бұрын
very useful talk, thank you!
Torchtitan: Large-Scale LLM Training Using Native PyTorch 3D Parallel... Wanchao Liang & Linsong Chu
24:20
Torchtitan: Large-Scale LLM Training Using Native PyTorch 3D Parallel... Wanchao Liang & Linsong Chu
PyTorch
Рет қаралды 405
Sponsored Session: NeMo-Aligner: A Scalable Toolkit for Model Alignment - Gerald Shen & Jimmy Zhang
21:16
Sponsored Session: NeMo-Aligner: A Scalable Toolkit for Model Alignment - Gerald Shen & Jimmy Zhang
PyTorch
Рет қаралды 235
It’s all not real
00:15
It’s all not real
V.A. show / Магика
Рет қаралды 20 МЛН
ЧТО ОПАСНЕЕ? ОТВЕТЫ ВАС ШОКИРУЮТ... (1% ОТВЕЧАЮТ ПРАВИЛЬНО) #Shorts #Глент
00:38
ЧТО ОПАСНЕЕ? ОТВЕТЫ ВАС ШОКИРУЮТ... (1% ОТВЕЧАЮТ ПРАВИЛЬНО) #Shorts #Глент
ГЛЕНТ
Рет қаралды 2,4 МЛН
VIP ACCESS
00:47
VIP ACCESS
Natan por Aí
Рет қаралды 30 МЛН
Une nouvelle voiture pour Noël 🥹
00:28
Une nouvelle voiture pour Noël 🥹
Nicocapone
Рет қаралды 9 МЛН
TorchInductor CPU Backend Advancements: New Features and Performance Imp... Jiong Gong & Leslie Fang
21:53
TorchInductor CPU Backend Advancements: New Features and Performance Imp... Jiong Gong & Leslie Fang
PyTorch
Рет қаралды 254
Andrew Ng Explores The Rise Of AI Agents And Agentic Reasoning | BUILD 2024 Keynote
26:52
Andrew Ng Explores The Rise Of AI Agents And Agentic Reasoning | BUILD 2024 Keynote
Snowflake Inc.
Рет қаралды 228 М.
LLM inference optimization: Architecture, KV cache and Flash attention
44:06
LLM inference optimization: Architecture, KV cache and Flash attention
YanAITalk
Рет қаралды 4 М.
DistServe: disaggregating prefill and decoding for goodput-optimized LLM inference
32:03
DistServe: disaggregating prefill and decoding for goodput-optimized LLM inference
PyTorch
Рет қаралды 954
Ilya Sutskever: Sequence to Sequence Learning with Neural Networks at NeurIPS 2024
24:37
Ilya Sutskever: Sequence to Sequence Learning with Neural Networks at NeurIPS 2024
Nadira Povey
Рет қаралды 34 М.
Torch.Compile for Autograd, DDP and FSDP - Will Feng , Chien-Chin Huang & Simon Fan, Meta
22:23
Torch.Compile for Autograd, DDP and FSDP - Will Feng , Chien-Chin Huang & Simon Fan, Meta
PyTorch
Рет қаралды 638
State of PyTorch - Ji Li & Damien Sereni, Meta
20:37
State of PyTorch - Ji Li & Damien Sereni, Meta
PyTorch
Рет қаралды 610
Meta Llama 3 and the Future of Responsible AI Development - Spencer Whitman & Vincent Gonguet, Meta
20:51
Meta Llama 3 and the Future of Responsible AI Development - Spencer Whitman & Vincent Gonguet, Meta
PyTorch
Рет қаралды 223
Visualizing transformers and attention | Talk for TNG Big Tech Day '24
57:45
Visualizing transformers and attention | Talk for TNG Big Tech Day '24
Grant Sanderson
Рет қаралды 242 М.
"Simple Made Easy" - Rich Hickey (2011)
1:01:39
"Simple Made Easy" - Rich Hickey (2011)
Strange Loop Conference
Рет қаралды 103 М.
It’s all not real
00:15
It’s all not real
V.A. show / Магика
Рет қаралды 20 МЛН