LoRA - Explained!

[@Mohamed_Shokry]

Your explanations are easy to understand and in-depth at the same time. Thank you for making my life easier.

[@IntegrandoIA]

I don't understand why you don't have much more views and engagement. Your videos are some of the best explanations out there. I've sent my students to your channel multiple times. Not a great timeline where virality reins over veracity. Amazing work.

[@CodeEmporium]

Thanks! This means a lot. I am just glad the channel is able to provide value. So thanks for sharing this around

[@KhushPatel-x2n]

In finetuning of LLM we have 2 options. 1) change the parameter of actual Base model. But this require High resource and time. 2) Add new layers and change the architecture of the model. In finetuning only change the weight of this additional layer and Base model remain frozen. In inferencing we use both Base model and this additional layer. LoRA helps us in reducing this additional layer by using Low Rank Matrices. This is my knowledge. I want to please react on it So I can Verify my knowledge!😊

[@CodeEmporium]

This is a good overview 👍

[@shisoy4809]

I like simple methods yet extremely effective

[@harshsharma5768]

Awesome explaination! I have few questions though: 1) At 24:00, you said we can do some matrix multiplication and addition to update the value of Wq so that the fine tuned information gets kinda infused in Wq which inturn allowed us to have faster inference time, but won't that hurt the performance in comparision to the case where we don't update Wq and keep A and B? Are we just trading performance for inference speed? 2) what if we do the same 'update Wq' part with additive adapters? That will also speed up their inference time?

[@isaiahcastillo898]

LoRAs are the biggest thing to come out of AI since the transformer

[@canygard]

Custom GPTs or Gemini Gems are pretty spot on after you get good at making them. I would play around with these before building an AI agent with LangChain and vector embeddings.

[@pauljones9150]

Cursor with claude 3.5 or o1 mini is great. Use their shortcuts to save time. Still struggles with new languages and frameworks though

[@pauljones9150]

The quizzes aren't well connected to the content. Heck if you could add a timestamp after each quiz of "if you got this wrong, check out this timestamp" that would be helpful

[@minasefikadu]

I enjoyed this video. Can you do QLoRA next?

[@isaiahcastillo898]

Appreciate it!

[@pauljones9150]

When did you explain benefits of loras over adapters? I seem to have missed it

[@Coding-for-startups]

Amazing, thank you. Can u do one for latent diffusion

[@Ishaheennabi]

Back again ❤❤❤