How To Use Meta Llama3 With Huggingface And Ollama

Llama3 is available now in huggingface,kaggle and with ollama.
code: colab.research.google.com/dri...
-------------------------------------------------------------------------------------------------
Support me by joining membership so that I can upload these kind of videos
/ @krishnaik06
-----------------------------------------------------------------------------------
Fresh Langchain Playlist: • Fresh And Updated Lang...
►LLM Fine Tuning Playlist: • Steps By Step Tutorial...
►AWS Bedrock Playlist: • Generative AI In AWS-A...
►Llamindex Playlist: • Announcing LlamaIndex ...
►Google Gemini Playlist: • Google Is On Another L...
►Langchain Playlist: • Amazing Langchain Seri...
►Data Science Projects:
• Now you Can Crack Any ...
►Learn In One Tutorials
Statistics in 6 hours: • Complete Statistics Fo...
End To End RAG LLM APP Using LlamaIndex And OpenAI- Indexing And Querying Multiple Pdf's
Machine Learning In 6 Hours: • Complete Machine Learn...
Deep Learning 5 hours : • Deep Learning Indepth ...
►Learn In a Week Playlist
Statistics: • Live Day 1- Introducti...
Machine Learning : • Announcing 7 Days Live...
Deep Learning: • 5 Days Live Deep Learn...
NLP : • Announcing NLP Live co...
---------------------------------------------------------------------------------------------------
My Recording Gear
Laptop: amzn.to/4886inY
Office Desk : amzn.to/48nAWcO
Camera: amzn.to/3vcEIHS
Writing Pad:amzn.to/3OuXq41
Monitor: amzn.to/3vcEIHS
Audio Accessories: amzn.to/48nbgxD
Audio Mic: amzn.to/48nbgxD

[@rumingliu9787]

Thanks sir. Very helpful. Just one question, what's the benefit of Ollama compared with hugging face? I guess it is Local deployed but has some basic requirements for your laptop's hardware.

[@sanadasaradha8638]

Instead of showing all new models it is better to implement a single open source llm for all use cases including fine tuning. At the same time it is better to make an end to end project with opensource llm.

[@THOSHI-cn6hg]

Agreed

[@devagarwal3250]

There are already same video about showing new model. It is better to make a video on how to implement it

[@KumR]

I am with you. New models will keep coming. Focus needs to be on an end to end project

[@Shubhampalzy]

how to fine tune ? I need some help to build a custom chatbot trained on custom dataset using llama 3. Please help

[@siddhanthbhattacharyya4206]

Krish i wanted to know what would be the pre requisites to follow your langchain series? How much knowledge do i need?

[@KunalDixitEdukraft]

Hi Krish, Firstly, thanks to your consistent efforts to keep us updated and learn the latest techs in the realm of Data Science. How can I sponsor you on Git Hub and earn a badge?

[@vysaivicky4724]

Sir one doubt how much knowledge of dsa is required in data scientist field please clarify

[@gan13166]

do we really need ollama to run llama3. when we are able to download/ clone the entire model from HF, do we still need Ollama for running the model? What is the next step after you download the model from HF? how to use it in the Langchain code without Ollama? is that possible?

[@janneskleinau6332]

Please make a Video on how to finetune LLaMA! I would appreciate it :) Love your videos btw

[@nitinjain4519]

When using the Llama3 model, sometimes it gives me an incomplete answer. What can I do to avoid incompleteness when generating responses from the Serverless Inference API?

[@r21061991]

Hey Krish, It will be more helpful if you can take a session on how to use an offline LLM on a custom dataset for QnA

[@herashak]

When doing Question answering I got an error about logits and LlamaForCausalLM not being compatible, not sure how you got that to work as you said

[@JorgeLopez-gw9xc]

I have ollama on my computer and I am currently using it to run AI models through Python. I need to correct complex instructions that I can only run with the 70B model, the problem is that due to its complexity it takes a long time to execute (2 minutes), how can I lower the times? Currently the model runs on the CPU, how can I configure ollama to use the GPU?

[@viratsasikishorevarma3535]

Hi Krish sir I need a help, please make a video on this basic topic: how ,why to setup virtual environment for python.❤

[@TheIITianExplorer]

Guys how to fine-tune this model, I mean, i want to train in colab free version Does it support Qlora configuration?

[@kavururajesh1760]

Hi Krish can you please upload a video on Moirai for Time Series LLM Model

[@girishkumar862]

Hi, there will be 10 billion models coming in future and so on..

[@claudiograssi5192]

to run locally which gpu do you use?

[@asadurrehman3591]

sir plzzzzzzzz tell me about this error. RuntimeError: "triu_tril_cuda_template" not implemented for 'BFloat16'

[@mhemanthkmr]

Hii Krish I too tried the llama3 in ollama response is slow but in your machine the response is fast you are using GPU then what GPU you using ?

[@shotbotop3790]

He has a Titan RTX (around 64gp vram) 💀

[@vamsitharunkumarsunku4583]

How to download llama3 model in local from NVIDIA NIMS? kindly make a video on it please. Thank you

[@anaghacasaba9351]

How can we fine tune llama 3 with a pdf?

[@cairo8905]

Hi I have a voice model on Google drive but I don't know how to upload it on huggingface can you tell me how to upload it? or giving you the model link and you upload it if you don't mind 😁

[@tejas4054]

Ye kaam.chatgpt bhi krta hai to ye kyu use kre hum. Llama

[@itzmeakash9695]

Hello sir, I have a doubt. Is there any platform to find the latest research papers to read? Also, how can I stay updated about the latest developments in the fields of general AI and AI?

[@vipinsou3170]

It's Google 😂

[@itzmeakash9695]

@@vipinsou3170 please that onces again

[@user-ue6lv9in8s]

Papers with code

[@siddhanthbhattacharyya4206]

Arxiv, it's managed by Cornell Uni

[@Superteastain]

This guys good.

[@0f9yxtizitdl]

Liked your new look, Mr clean.

[@KumR]

New models will keep mushrooming every day. I think now videos should focus on more end to end projects using these models. Not just sentiment analysis or language translation or text summarization. Some real life project end to end.

[@OmSingh-ng3np]

This can be fined tune in the same way right?

[@Shubhampalzy]

how to fine tune ? I need some help to build a custom chatbot trained on custom dataset using llama 3. Please help

[@ChemFam.]

Sir how and from where we will get the api key

[@happyhours.0214]

Sir, please make a llm video on how to train llm models on custom data.

[@THOSHI-cn6hg]

Yupppp

[@aryansalge4508]

Thats fine tuning. He has videos on it

[@itxmeJunaid]

😮

[@spiritualworld842]

Sir I'm totally stuck between data field and software field plzz suggest me to overcame from depression 😢😪

[@tejas4054]

Best way don't see youtube its too much overloaded ,,,,,with so much go back to time travel use books read books programming and use pen paper this overload information on youtube is dangerous

[@kshitijnishant4968]

my command prompt is raising error saying Ollama not found? any help guys?

[@krishnaik06]

U need to download and install it

[@rishiraj2548]

🙏🙂

[@podunkman2709]

Take look at this demo: >>> How many liters of water per minute can a Dutch windmill pump out? That's an interesting question! The answer depends on the specific design and size of the windmill. However, I can give you some general information. Traditionally, Dutch windmills are designed to pump water from shallow sources, such as polders or wells, for irrigation purposes. The capacity of these windmills varies greatly, but a typical small to medium-sized windmill might be able to pump around 0.5 to 2 liters per minute (L/min). Some larger industrial-scale windpumps can pump much more, up to 10-20 L/min or even more, depending on the turbine design and the pressure head of the water. Really? What a sh****

[@deepak4166]

What's app meta ai is awesome 🎉

[@tarunmohapatra5734]

Sir please activate neurolab

[@rajsharma-bd3sl]

Dude, don't just copy from hugging face and make a video... try to implement these models on some problem like NER

[@danielfischer4079]

Ollama is downloading really slow for me, any1 else?

[@surajramamurthysuresh7446]

Yes it's very slow..

[@mohsenghafari7652]

tanks krish . please answer my email ❤

[@tejas4054]

Pair kyu hilaate ho bhai video me

[@AnkitVerma-62990]

First Comment 😅

[@mohsenghafari7652]

😂😂❤

[@JourneyWithMystics]

Bhaiya how do I convert Hindi video into Hindi text, please 🙏 reply much needed ❤