LLM Research Techniques: LoRA, DPO, Mixture of Experts, and more

  Рет қаралды 226

Vanishing Gradients

Vanishing Gradients

Күн бұрын

In this video, Sebastian Raschka (Lightning AI) talks about his favourite LLM research techniques and architectures, which include LoRA, DPO, Mixture of Experts, Multi-Head Attention, and much more!
This was part of a livestreamed podcast recording for Vanishing Gradients. The full recording is here: kzbin.info...
The podcast episode is available here: vanishinggradi...

Пікірлер
The skills you need to work with LLMs
4:25
The skills you need to work with LLMs
Vanishing Gradients
Рет қаралды 149
Prompt Engineering Master Class for ENGINEERS with Ollama and LLM (Q4 2024 Update)
29:07
Prompt Engineering Master Class for ENGINEERS with Ollama and LLM (Q4 2024 Update)
IndyDevDan
Рет қаралды 26 М.
Мен атып көрмегенмін ! | Qalam | 5 серия
25:41
Мен атып көрмегенмін ! | Qalam | 5 серия
kak budto
Рет қаралды 1,2 МЛН
The Best Band 😅 #toshleh #viralshort
00:11
The Best Band 😅 #toshleh #viralshort
Toshleh
Рет қаралды 22 МЛН
Đang ngồi chơi bỗng dưng bể cá vỡ kính, may có CCTV chứng minh sự trong sạch cho cô bé
00:27
Đang ngồi chơi bỗng dưng bể cá vỡ kính, may có CCTV chứng minh sự trong sạch cho cô bé
Tiin_vn - Viettel Media
Рет қаралды 28 МЛН
It’s all not real
00:15
It’s all not real
V.A. show / Магика
Рет қаралды 20 МЛН
AI Unpacked with Nobel Laureate Geoffrey Hinton
23:33
AI Unpacked with Nobel Laureate Geoffrey Hinton
Valence
Рет қаралды 12 М.
AI Vision Agents and Business Value - with Andrew Ng
23:35
AI Vision Agents and Business Value - with Andrew Ng
Super Data Science: ML & AI Podcast with Jon Krohn
Рет қаралды 15 М.
8 AI Tools I Wish I Tried Sooner
16:10
8 AI Tools I Wish I Tried Sooner
Futurepedia
Рет қаралды 299 М.
What are AI Agents?
12:29
What are AI Agents?
IBM Technology
Рет қаралды 1,1 МЛН
GraphRAG: LLM-Derived Knowledge Graphs for RAG
15:40
GraphRAG: LLM-Derived Knowledge Graphs for RAG
Alex Chao
Рет қаралды 135 М.
Top Minds in AI Explain What’s Coming After GPT-4o | EP #130
25:30
Top Minds in AI Explain What’s Coming After GPT-4o | EP #130
Peter H. Diamandis
Рет қаралды 938 М.
What's next for AI agentic workflows ft. Andrew Ng of AI Fund
13:40
What's next for AI agentic workflows ft. Andrew Ng of AI Fund
Sequoia Capital
Рет қаралды 357 М.
Rasa CALM Demo: Conversational AI with LLMs | Alan Nichol
12:44
Rasa CALM Demo: Conversational AI with LLMs | Alan Nichol
Vanishing Gradients
Рет қаралды 774
OpenAI's Noam Brown Unpacks the Full Release of o1 and the Path to AGI
48:18
OpenAI's Noam Brown Unpacks the Full Release of o1 and the Path to AGI
Unsupervised Learning: Redpoint's AI Podcast
Рет қаралды 52 М.
AI Inference: The Secret to AI's Superpowers
10:41
AI Inference: The Secret to AI's Superpowers
IBM Technology
Рет қаралды 17 М.
Мен атып көрмегенмін ! | Qalam | 5 серия
25:41
Мен атып көрмегенмін ! | Qalam | 5 серия
kak budto
Рет қаралды 1,2 МЛН