Fine-tune Gemma models With Custom Data in Keras using LoRA

Gemma is a family of lightweight, state-of-the art open models built from the same research and technology used to create the Gemini models.
Large Language Models (LLMs) like Gemma have been shown to be effective at a variety of NLP tasks. An LLM is first pre-trained on a large corpus of text in a self-supervised fashion. Pre-training helps LLMs learn general-purpose knowledge, such as statistical relationships between words. An LLM can then be fine-tuned with domain-specific data to perform downstream tasks (such as sentiment analysis).
code github: colab.research.google.com/git...
---------------------------------------------------------------------------------------------------------
Support me by joining membership so that I can upload these kind of videos
/ @krishnaik06
-----------------------------------------------------------------------------------
►Fresh Langchain Playlist: • Fresh And Updated Lang...
►LLM Fine Tuning Playlist: • Steps By Step Tutorial...
►AWS Bedrock Playlist: • Generative AI In AWS-A...
►Llamindex Playlist: • Announcing LlamaIndex ...
►Google Gemini Playlist: • Google Is On Another L...
►Langchain Playlist: • Amazing Langchain Seri...
►Data Science Projects:
• Now you Can Crack Any ...
►Learn In One Tutorials
Statistics in 6 hours: • Complete Statistics Fo...
End To End RAG LLM APP Using LlamaIndex And OpenAI- Indexing And Querying Multiple Pdf's
Machine Learning In 6 Hours: • Complete Machine Learn...
Deep Learning 5 hours : • Deep Learning Indepth ...
►Learn In a Week Playlist
Statistics: • Live Day 1- Introducti...
Machine Learning : • Announcing 7 Days Live...
Deep Learning: • 5 Days Live Deep Learn...
NLP : • Announcing NLP Live co...
---------------------------------------------------------------------------------------------------
My Recording Gear
Laptop: amzn.to/4886inY
Office Desk : amzn.to/48nAWcO
Camera: amzn.to/3vcEIHS
Writing Pad:amzn.to/3OuXq41
Monitor: amzn.to/3vcEIHS
Audio Accessories: amzn.to/48nbgxD
Audio Mic: amzn.to/48nbgxD

[@indranisen5877]

You are the best. I am a big fan of your teaching.

[@anas67890]

thank you sir for providing all these stuff free for us best teacher

[@piyushpawar1518]

Krish Bhaiya, thank you for your insightful videos! I'm a second-year engineering student fascinated by AI and keen on building a career in this field. I recently came across a video discussing the value of learning to build AI from scratch versus fine-tuning existing models. Could you share your thoughts on whether aspiring AI professionals should focus on building from scratch or refining existing models? Your guidance would be greatly appreciated!

[@ashraf_isb]

awesome and simple video, thank you so much Krish

[@khalidal-reemi3361]

Thanks Krish I would like to know how to transfer the model to my local machine/server and do the inferencing part locally.

[@mohsenghafari7652]

Hi dear friend . Thank you for your efforts . How to use this tutorial in PDFs at other language (for example Persian ) What will the subject ? I made many efforts and tested different models, but the results in asking questions about pdfs are not good and accurate! Thank you for the explanation

[@abutareqrony4513]

You are xoss. Amazing ❤❤❤

[@amritsubramanian8384]

This one is cool ❤

[@algozilla7488]

Sir many many thanks for uploading this lectures for free but could You create some videos regarding Fine-tuning of LLM usint LlamaFactory its quite nice and able to run in Cloud.

[@SHIKHAGUPTA-yj8ze]

Hi.....Can we find a tutorial for deployment for Gemma model after finetuning and how to use for mobile application ?

[@aparnapradhan0198]

Please make video on production and deployment of open-source llms 😊 with integrated RAG pipeline 🎉🎉🎉❤

[@SHIKHAGUPTA-yj8ze]

How to update dataset in this Code ? I am trying to pass some other data set i.e. 5mb but it giving me error which is Authentication failed ? Please help me on this !

[@SHIKHAGUPTA-yj8ze]

I am getting error while loading dataset i.e. OutOfMemory

[@srich-km3wh]

can you please upload codellama finetuning with Lora

[@ayushbhardwaj5260]

Sir do you have any paid course or structured course for ai ml? Please..

[@srishrachamalla9607]

For this you can watch huggingface courses for free 😊

[@RishiRajxtrim]

👍

[@Nicknamee-zj2qf]

Using what??

[@rd806]

LoRA

[@mohsenghafari7652]

tanks krish .please response my email.