Nvidia's new AI can build LLMs cheaper! Upcycling MoE explained by Ethan He

  Рет қаралды 599

Tech Cindy

Tech Cindy

Күн бұрын

Пікірлер: 1
@TechCindy
@TechCindy 20 күн бұрын
📚 Paper discussed: "Upscaling Large Language Models into Mixture of Experts": arxiv.org/abs/2410.07524 Available in NVIDIA's Megatron-Core repository: github.com/NVIDIA/Megatron-LM/tree/main/megatron/core/transformer/moe
NVIDIA Nemotron 70b Local AI Testing - The BEST Open Source LLM?
21:47
NVIDIA Nemotron 70b Local AI Testing - The BEST Open Source LLM?
Digital Spaceport
Рет қаралды 15 М.
What is Mixture of Experts?
7:58
What is Mixture of Experts?
IBM Technology
Рет қаралды 10 М.
ROSÉ & Bruno Mars - APT. (Official Music Video)
02:54
ROSÉ & Bruno Mars - APT. (Official Music Video)
ROSÉ
Рет қаралды 331 МЛН
Family Love #funny #sigma
00:16
Family Love #funny #sigma
CRAZY GREAPA
Рет қаралды 47 МЛН
ЛУЧШИЙ ФОКУС + секрет! #shorts
00:12
ЛУЧШИЙ ФОКУС + секрет! #shorts
Роман Magic
Рет қаралды 31 МЛН
HELP!!!
00:46
HELP!!!
Natan por Aí
Рет қаралды 56 МЛН
[Paper Club] Upcycling Large Language Models into Mixture of Experts
39:02
[Paper Club] Upcycling Large Language Models into Mixture of Experts
Latent Space
Рет қаралды 353
No more bad outputs with structured generation: Remi Louf
15:32
No more bad outputs with structured generation: Remi Louf
AI Engineer
Рет қаралды 9 М.
ChatGPT can talk in advanced voice now! Here are 9 funny examples.
5:21
ChatGPT can talk in advanced voice now! Here are 9 funny examples.
Tech Cindy
Рет қаралды 3,3 М.
Large Language Models (LLMs) - Everything You NEED To Know
25:20
Large Language Models (LLMs) - Everything You NEED To Know
Matthew Berman
Рет қаралды 118 М.
Nvidia JUST Changed the AI Game - Unveiling the AI That Kills ChatGPT!
11:02
Nvidia JUST Changed the AI Game - Unveiling the AI That Kills ChatGPT!
AI Uncovered
Рет қаралды 30 М.
AI, Machine Learning, Deep Learning and Generative AI Explained
10:01
AI, Machine Learning, Deep Learning and Generative AI Explained
IBM Technology
Рет қаралды 507 М.
NEW Mixtral 8x22b Tested - Mistral's New Flagship MoE Open-Source Model
12:03
NEW Mixtral 8x22b Tested - Mistral's New Flagship MoE Open-Source Model
Matthew Berman
Рет қаралды 56 М.
Large Language Models and The End of Programming - CS50 Tech Talk with Dr. Matt Welsh
1:06:56
Large Language Models and The End of Programming - CS50 Tech Talk with Dr. Matt Welsh
CS50
Рет қаралды 809 М.
Trump is About to Change Everything For Tech Startups
59:15
Trump is About to Change Everything For Tech Startups
a16z
Рет қаралды 44 М.
How to Learn AI and Get Certified by NVIDIA
6:54
How to Learn AI and Get Certified by NVIDIA
Sahil & Sarra
Рет қаралды 202 М.
ROSÉ & Bruno Mars - APT. (Official Music Video)
02:54
ROSÉ & Bruno Mars - APT. (Official Music Video)
ROSÉ
Рет қаралды 331 МЛН