QLoRA paper explained (Efficient Finetuning of Quantized LLMs)

QLoRA is the first approach that allows the TRAINING of Large Language Models (LLMs) on a single GPU. It does this by using three contributions namely: 1. a novel NormalFloat data type, 2. Double Quantization, 3. Paged Optimizers.
In this video, we explain the idea behind all three approaches and explain how they are put together to arrive at QLoRA.
⌚️ ⌚️ ⌚️ TIMESTAMPS ⌚️ ⌚️ ⌚️
0:00 - QLoRA
1:34 - Quantization
3:10 - Problem with Quantization
3:50 - Blockwise Quantization
5:42 - Normal Float
6:37 - Double Quantization
7:25 - Paged Optimizers
8:45 - QLoRA Finetuning
9:30 - LoRA vs QLoRA
10:28 - Results
🛠 🛠 🛠 MY SOFTWARE TOOLS 🛠 🛠 🛠
✍️ Notion - affiliate.notion.so/aibites-yt
✍️ Notion AI - affiliate.notion.so/ys9rqzv2vdd8
📹 OBS Studio for video editing - obsproject.com
📼 Manim for some animations - www.manim.community
📚 📚 📚 BOOKS I HAVE READ, REFER AND RECOMMEND 📚 📚 📚
📖 Deep Learning by Ian Goodfellow - amzn.to/3Wnyixv
📙 Pattern Recognition and Machine Learning by Christopher M. Bishop - amzn.to/3ZVnQQA
📗 Machine Learning: A Probabilistic Perspective by Kevin Murphy - amzn.to/3kAqThb
📘 Multiple View Geometry in Computer Vision by R Hartley and A Zisserman - amzn.to/3XKVOWi
MY KEY LINKS
KZbin: / @aibites
Twitter: / ai_bites​
Patreon: / ai_bites​
Github: github.com/ai-bites​
WHO AM I?
I am a Machine Learning Researcher/Practitioner who has seen the grind of academia and start-ups equally. I started my career as a software engineer 15 years ago. Because of my love for Mathematics (coupled with a glimmer of luck), I graduated with a Master's in Computer Vision and Robotics in 2016 when the now happening AI revolution just started. Life has changed for the better ever since.
#machinelearning #deeplearning #aibites

[@pierluigiurru962]

Your videos on LoRA finally made the concepts click for me. It was clearly explained! Thank you for the content you make

[@AIBites]

Glad it helped. Welcome 😊

[@vuluu4942]

Thank you for the explanation! I find that it's very helpful!

[@haz5248]

That was really well explained with intuitative diagrams and explination. Thanks for the video , just subscribed .

[@AIBites]

thank you! :)

[@cacamaricano]

Thanks for connecting the dots!

[@AIBites]

glad you liked! :)

[@huitangtt]

Very well explained

[@AIBites]

Thanks so much 😊

[@adarshsharma8039]

amazing explanation

[@AIBites]

Glad you think so!

[@wilfredomartel7781]

Waiting to see it.

[@AIBites]

Sure! :)

[@yeduniya657]

Hey. I need your help. I have a curated set of notes and books and I wish to use it to finetune a model. How can it be done?

[@AIBites]

would you like to see a fine-tuning video on text data? Would that be useful? Do you have any suggestions on the dataset I can show fine-tuning on?

[@yeduniya657]

@@AIBites Yes, I have suggestion. Finetuning a model on my journal in which I have written about the truth of nonduality and illusionary nature of reality. I am also actively curating books on truth, and would love your help.

[@haz5248]

@@AIBites That would be very help. There arent many good videos on fine tune out there.

[@AIBites]

hope the fine-tuning video was of some help

[@AIBites]

hope the fine-tuning video was of some help