A Visual Guide to Mixture of Experts (MoE) in LLMs

  Рет қаралды 3,931

Maarten Grootendorst

Maarten Grootendorst

Күн бұрын

Пікірлер: 12
@ScottzPlaylists
@ScottzPlaylists 4 күн бұрын
👍 I really like your style of teaching / presentation. I Subscribed❗ I'll look through all you videos and book. ❗
@mohajeramir
@mohajeramir 2 күн бұрын
Subscribed!
@YuxinWu-m1i
@YuxinWu-m1i 11 күн бұрын
你讲的好好啊!谢谢大哥!
@marloncajamarca2793
@marloncajamarca2793 2 ай бұрын
Best explaination of MoEs I have came across till now! The high-quality explaination of key concepts, production and visuals are superb. Keep up with this amazing work and thanks for sharing this for free Marteen.
@ringpolitiet
@ringpolitiet 2 ай бұрын
Very high production value! Very useful, thanks.
@jacehua7334
@jacehua7334 2 ай бұрын
Always very useful thank you Maarten!
@datahouse24
@datahouse24 8 күн бұрын
thank you
@tantzer6113
@tantzer6113 22 минут бұрын
I am not clear on how the different experts end up with different specializations.
@ShivangiTomar-p7j
@ShivangiTomar-p7j Ай бұрын
AWESOME!!! THANKS A LOT
@Mohamed_Shokry
@Mohamed_Shokry Ай бұрын
Thanks for the video! I can tell you put a lot of work into it.
@Deshwal.mahesh
@Deshwal.mahesh Ай бұрын
Can we have a fine-tuning or building it from scratch video too 😶
@ekramhossain4601
@ekramhossain4601 2 ай бұрын
Can you also make this kind of video to explain transformer as well? Thanks :)
Which Quantization Method is Right for You? (GPTQ vs. GGUF vs. AWQ)
15:51
Maarten Grootendorst
Рет қаралды 23 М.
Multimodal AI: LLMs that can see (and hear)
21:19
Shaw Talebi
Рет қаралды 5 М.
REAL or FAKE? #beatbox #tiktok
01:03
BeatboxJCOP
Рет қаралды 18 МЛН
It works #beatbox #tiktok
00:34
BeatboxJCOP
Рет қаралды 41 МЛН
To Brawl AND BEYOND!
00:51
Brawl Stars
Рет қаралды 17 МЛН
Understanding Mixture of Experts
28:01
Trelis Research
Рет қаралды 10 М.
AI can't cross this line and we don't know why.
24:07
Welch Labs
Рет қаралды 1,5 МЛН
Visualizing transformers and attention | Talk for TNG Big Tech Day '24
57:45
Creating Your Own Programming Language - Computerphile
21:15
Computerphile
Рет қаралды 218 М.
Transformers (how LLMs work) explained visually | DL5
27:14
3Blue1Brown
Рет қаралды 4,4 МЛН
BERTopic Just Got Better! Introducing Exciting Features in v0.16
18:00
Maarten Grootendorst
Рет қаралды 7 М.
How might LLMs store facts | DL7
22:43
3Blue1Brown
Рет қаралды 986 М.
Vision Transformer Basics
30:49
Samuel Albanie
Рет қаралды 35 М.
REAL or FAKE? #beatbox #tiktok
01:03
BeatboxJCOP
Рет қаралды 18 МЛН