Slaying OOMs - Mark Saroufim & Jane Xu, Meta

  Рет қаралды 642

PyTorch

PyTorch

Күн бұрын

Пікірлер: 2
@mkamp
@mkamp 2 ай бұрын
Awesome presentation style. Love the language, the humor and the sketched diagrams, that are used consistently throughout. World class.
@mcmc6052
@mcmc6052 2 ай бұрын
very useful talk, thank you!
Torchtitan: Large-Scale LLM Training Using Native PyTorch 3D Parallel... Wanchao Liang & Linsong Chu
24:20
Torchtitan: Large-Scale LLM Training Using Native PyTorch 3D Parallel... Wanchao Liang & Linsong Chu
PyTorch
Рет қаралды 405
Sponsored Session: NeMo-Aligner: A Scalable Toolkit for Model Alignment - Gerald Shen & Jimmy Zhang
21:16
Sponsored Session: NeMo-Aligner: A Scalable Toolkit for Model Alignment - Gerald Shen & Jimmy Zhang
PyTorch
Рет қаралды 235
小丑女COCO的审判。#天使 #小丑 #超人不会飞
00:53
小丑女COCO的审判。#天使 #小丑 #超人不会飞
超人不会飞
Рет қаралды 16 МЛН
Don’t Choose The Wrong Box 😱
00:41
Don’t Choose The Wrong Box 😱
Topper Guild
Рет қаралды 62 МЛН
IL'HAN - Qalqam | Official Music Video
03:17
IL'HAN - Qalqam | Official Music Video
Ilhan Ihsanov
Рет қаралды 700 М.
ВОТ ПОЧЕМУ Япония живет в будущем 🤫 Утилизация масла #япония #токио #путешествия #shorts
00:59
ВОТ ПОЧЕМУ Япония живет в будущем 🤫 Утилизация масла #япония #токио #путешествия #shorts
Холли Лолли Live
Рет қаралды 4,7 МЛН
TorchInductor CPU Backend Advancements: New Features and Performance Imp... Jiong Gong & Leslie Fang
21:53
TorchInductor CPU Backend Advancements: New Features and Performance Imp... Jiong Gong & Leslie Fang
PyTorch
Рет қаралды 254
Andrew Ng Explores The Rise Of AI Agents And Agentic Reasoning | BUILD 2024 Keynote
26:52
Andrew Ng Explores The Rise Of AI Agents And Agentic Reasoning | BUILD 2024 Keynote
Snowflake Inc.
Рет қаралды 228 М.
LLM inference optimization: Architecture, KV cache and Flash attention
44:06
LLM inference optimization: Architecture, KV cache and Flash attention
YanAITalk
Рет қаралды 4 М.
DistServe: disaggregating prefill and decoding for goodput-optimized LLM inference
32:03
DistServe: disaggregating prefill and decoding for goodput-optimized LLM inference
PyTorch
Рет қаралды 954
Ilya Sutskever: Sequence to Sequence Learning with Neural Networks at NeurIPS 2024
24:37
Ilya Sutskever: Sequence to Sequence Learning with Neural Networks at NeurIPS 2024
Nadira Povey
Рет қаралды 34 М.
Torch.Compile for Autograd, DDP and FSDP - Will Feng , Chien-Chin Huang & Simon Fan, Meta
22:23
Torch.Compile for Autograd, DDP and FSDP - Will Feng , Chien-Chin Huang & Simon Fan, Meta
PyTorch
Рет қаралды 638
State of PyTorch - Ji Li & Damien Sereni, Meta
20:37
State of PyTorch - Ji Li & Damien Sereni, Meta
PyTorch
Рет қаралды 610
Meta Llama 3 and the Future of Responsible AI Development - Spencer Whitman & Vincent Gonguet, Meta
20:51
Meta Llama 3 and the Future of Responsible AI Development - Spencer Whitman & Vincent Gonguet, Meta
PyTorch
Рет қаралды 223
Visualizing transformers and attention | Talk for TNG Big Tech Day '24
57:45
Visualizing transformers and attention | Talk for TNG Big Tech Day '24
Grant Sanderson
Рет қаралды 242 М.
"Simple Made Easy" - Rich Hickey (2011)
1:01:39
"Simple Made Easy" - Rich Hickey (2011)
Strange Loop Conference
Рет қаралды 103 М.
小丑女COCO的审判。#天使 #小丑 #超人不会飞
00:53
小丑女COCO的审判。#天使 #小丑 #超人不会飞
超人不会飞
Рет қаралды 16 МЛН