🚀🔍 AI papers deep dive: LLM understanding, RAG, CoT

  Рет қаралды 2,688

Sophia Yang

Sophia Yang

Күн бұрын

🌐 RA-DIT Retrieval-Augmented Dual Instruction Tuning: Enhancing RAG systems by fine-tuning both the LM & retriever. Implementation in LlamaIndex.
📆 FreshLLM: Leveraging search engines to keep LLMs updated with the latest info.
🧠 Analogical Reasoners: Automatically guides the reasoning of LLMs for a better chain-of-thought.
✨ On AI transparency & interpretability, two pivotal papers:
- Representation Engineering: A Top-Down Approach to AI Transparency
- Decomposing Language Models Into Understandable Components
#ArtificialIntelligence #AIpapers
Links:
arxiv.org/abs/2310.01352
/ 1709646787076935818
arxiv.org/pdf/2310.03214v1.pdf
arxiv.org/pdf/2310.01714.pdf
www.ai-transparency.org/
www.anthropic.com/index/decom...
transformer-circuits.pub/2023...
00:00 intro
01:04 RA-DIT Retrieval-Augmented Dual Instruction Tuning
04:17 FreshLLMs
07:02 Analogical Reasoners
10:07 Representation Engineering
14:18 Decomposing Language Models Into Understandable Components
🔔 SUBSCRIBE to my channel: kzbin.info...
⭐ Stay in touch ⭐
📚 DS/ML Book Club: dsbookclub.github.io/
▶ KZbin: / sophiayangds
✍️ Medium: / sophiamyang
🐦 Twitter: / sophiamyang
🤝 Linkedin: / sophiamyang
💚 #ai

Пікірлер: 32
@VictoriaLin
@VictoriaLin 8 ай бұрын
We're flattered to be the first paper featured in your first paper reading session. Continue the great work! 👩🏻‍💻📖✨
@SophiaYangDS
@SophiaYangDS 8 ай бұрын
Thanks so much! It's an honor to get a comment from the author yourself! ♥
@sgramstrup
@sgramstrup 8 ай бұрын
I think its a good idea. We all need some 'bridging' between the most important new papers, and all of us that are a bit swamped by the speed of this field. Also, by discussing the details of the paper, the audience gets a referential framework to relate concepts to. Keep digging for papers that reveal the inner workings of 'cognitive networks'..
@alexeymalafeev6167
@alexeymalafeev6167 7 ай бұрын
Awesome video!
@santhoshsthanikam9656
@santhoshsthanikam9656 8 ай бұрын
This is excellent, Please continue to make this type of videos.Thanks for sharing the knowledge
@SophiaYangDS
@SophiaYangDS 8 ай бұрын
Thank you 🙏 I just made a new one. Hope you like it :)
@snsa_kscc
@snsa_kscc 8 ай бұрын
Great stuff, Sophia! Have a good one.
@SophiaYangDS
@SophiaYangDS 8 ай бұрын
Thanks!
@FREELEARNING
@FREELEARNING 8 ай бұрын
Thanks Sophia. What I like the most about your videos is that they are concise.
@SophiaYangDS
@SophiaYangDS 8 ай бұрын
Thanks so much 🙏
@kostastsaousis7445
@kostastsaousis7445 8 ай бұрын
Sophia. This session is amazing and a very good idea! Please continue to do it as often as possible!! Great work !
@ark1111
@ark1111 8 ай бұрын
Great Video and very intresting papers you found! Thank you for showcasing them!
@SophiaYangDS
@SophiaYangDS 8 ай бұрын
Thank you 🙏
@dimastorres8530
@dimastorres8530 8 ай бұрын
Representation engineering was a mind blower. Thank you for sharing!
@SophiaYangDS
@SophiaYangDS 8 ай бұрын
Thank you 🙏
@AIJasonZ
@AIJasonZ 8 ай бұрын
Thank you Sophia, so good! How did you go and find quality paper to read? (I mean there are so many new ones each week LOL)
@SophiaYangDS
@SophiaYangDS 8 ай бұрын
I follow a bunch of researchers and people who share quality papers 😄
@oscarbertel1449
@oscarbertel1449 8 ай бұрын
Excelente
@SophiaYangDS
@SophiaYangDS 8 ай бұрын
Thank you 🙏
@VenkatesanVenkat-fd4hg
@VenkatesanVenkat-fd4hg 8 ай бұрын
Superr, explanation
@SophiaYangDS
@SophiaYangDS 8 ай бұрын
Thank you!
@densonsmith2
@densonsmith2 8 ай бұрын
Very useful
@SophiaYangDS
@SophiaYangDS 8 ай бұрын
Thank you 🙏
@klammer75
@klammer75 8 ай бұрын
Great work and love the paper reviews! Keep em coming!🥳😎🦾
@viewview6687
@viewview6687 8 ай бұрын
Thank you very much for this video. I watch your summarize video before bed.
@SophiaYangDS
@SophiaYangDS 8 ай бұрын
Thanks so much! This one is a little different from my other videos. I hope it's not too boring 😅
@leo-ur8kx
@leo-ur8kx 8 ай бұрын
@@SophiaYangDS Its not boring at all. Do you planning to create video that shows reasoning in embedding search?
@SophiaYangDS
@SophiaYangDS 8 ай бұрын
Thank you!!! Really good to know. And thanks for the suggestions. Do you have recommended paper on that? @@leo-ur8kx
@VaibhavPatil-rx7pc
@VaibhavPatil-rx7pc 8 ай бұрын
Thanks
@SophiaYangDS
@SophiaYangDS 8 ай бұрын
Thanks!
@moon8013
@moon8013 8 ай бұрын
keep making videos please
@SophiaYangDS
@SophiaYangDS 8 ай бұрын
Thanks 🙏 I'll try
GraphRAG: LLM-Derived Knowledge Graphs for RAG
15:40
Alex Chao
Рет қаралды 76 М.
Sprinting with More and More Money
00:29
MrBeast
Рет қаралды 191 МЛН
버블티로 체감되는 요즘 물가
00:16
진영민yeongmin
Рет қаралды 63 МЛН
Watermelon Cat?! 🙀 #cat #cute #kitten
00:56
Stocat
Рет қаралды 54 МЛН
Homemade Professional Spy Trick To Unlock A Phone 🔍
00:55
Crafty Champions
Рет қаралды 57 МЛН
What is RAG? (Retrieval Augmented Generation)
11:37
Don Woodlock
Рет қаралды 100 М.
Prompt Engineering, RAG, and Fine-tuning: Benefits and When to Use
15:21
Machine Learning Q and AI author interview with Sebastian Raschka
58:15
The Attention Mechanism in Large Language Models
21:02
Serrano.Academy
Рет қаралды 82 М.
I wish every AI Engineer could watch this.
33:49
1littlecoder
Рет қаралды 56 М.
Chain of Thought (CoT) meets Instruction Fine-Tuning
29:55
code_your_own_AI
Рет қаралды 7 М.
Retrieval-Augmented Generation (RAG)
24:04
Connor Shorten
Рет қаралды 31 М.
The Era of 1-bit LLMs by Microsoft | AI Paper Explained
6:10
AI Papers Academy
Рет қаралды 88 М.
Sprinting with More and More Money
00:29
MrBeast
Рет қаралды 191 МЛН