No video

ZeRO & Fastest BERT: Increasing the scale and speed of deep learning training in DeepSpeed

  Рет қаралды 7,573

Microsoft Research

Microsoft Research

Күн бұрын

Пікірлер: 1
@xiaobuyang8125
@xiaobuyang8125 2 жыл бұрын
this video is very good to explain how deepspeed is . could you share the ppt used in this video?
Turing-NLG, DeepSpeed and the ZeRO optimizer
21:18
Turing-NLG, DeepSpeed and the ZeRO optimizer
Yannic Kilcher
Рет қаралды 16 М.
What is generative AI and how does it work? - The Turing Lectures with Mirella Lapata
46:02
What is generative AI and how does it work? - The Turing Lectures with Mirella Lapata
The Royal Institution
Рет қаралды 991 М.
Or is Harriet Quinn good? #cosplay#joker #Harriet Quinn
00:20
Or is Harriet Quinn good? #cosplay#joker #Harriet Quinn
佐助与鸣人
Рет қаралды 46 МЛН
This Kind Couple Gave Me a New Home! 🏡💖 #heartwarming #storytime #creative
00:35
This Kind Couple Gave Me a New Home! 🏡💖 #heartwarming #storytime #creative
Friendeez
Рет қаралды 21 МЛН
This Dumbbell Is Impossible To Lift!
01:00
This Dumbbell Is Impossible To Lift!
Stokes Twins
Рет қаралды 42 МЛН
Xe ô tô đồ chơi nhà giàu và nhà nghèo || Poor Car & Rich Car #shorts
00:58
Xe ô tô đồ chơi nhà giàu và nhà nghèo || Poor Car & Rich Car #shorts
Bon Bon Media
Рет қаралды 24 МЛН
Ultra-dense data storage and extreme parallelism with electronic-molecular systems
55:49
Ultra-dense data storage and extreme parallelism with electronic-molecular systems
Microsoft Research
Рет қаралды 2,7 М.
Introducing Developer Velocity Lab to improve developers’ work and well-being
24:53
Introducing Developer Velocity Lab to improve developers’ work and well-being
Microsoft Research
Рет қаралды 8 М.
How Fully Sharded Data Parallel (FSDP) works?
32:31
How Fully Sharded Data Parallel (FSDP) works?
Ahmed Taha
Рет қаралды 11 М.
A Day in the Life of a Machine Learning Engineer (at a *small* startup)
14:53
A Day in the Life of a Machine Learning Engineer (at a *small* startup)
Daniel Bourke
Рет қаралды 372 М.
What is PyTorch? (Machine/Deep Learning)
11:57
What is PyTorch? (Machine/Deep Learning)
IBM Technology
Рет қаралды 28 М.
DeepSpeed: All the tricks to scale to gigantic models
39:42
DeepSpeed: All the tricks to scale to gigantic models
Mark Saroufim
Рет қаралды 19 М.
Beekeeper Answers Bee Questions From Twitter | Tech Support | WIRED
15:22
Beekeeper Answers Bee Questions From Twitter | Tech Support | WIRED
WIRED
Рет қаралды 3,4 МЛН
The first 20 hours -- how to learn anything | Josh Kaufman | TEDxCSU
19:27
The first 20 hours -- how to learn anything | Josh Kaufman | TEDxCSU
TEDx Talks
Рет қаралды 39 МЛН
Microsoft DeepSpeed introduction at KAUST
1:11:36
Microsoft DeepSpeed introduction at KAUST
KAUST Supercomputing Laboratory
Рет қаралды 7 М.
Demystifying Parallel and Distributed Deep Learning: An In-Depth Concurrency Analysis
44:22
Demystifying Parallel and Distributed Deep Learning: An In-Depth Concurrency Analysis
insideHPC Report
Рет қаралды 15 М.
Or is Harriet Quinn good? #cosplay#joker #Harriet Quinn
00:20
Or is Harriet Quinn good? #cosplay#joker #Harriet Quinn
佐助与鸣人
Рет қаралды 46 МЛН