Gen AI Project Using Llama3.1 | End to End Gen AI Project

[@codebasics]

Check codebasics.io/ for practical AI courses where I teach AI concepts in an intuitive, industry relevant way.

[@dhanraj4552]

What a coincidence! I created a POC in my company with almost the exact same tech stack and almost similar application 😊

[@reelsloverlife]

Hi

[@venktharish2329]

which company?

[@SHIVAMGUPTA-wb5mw]

I dont think this language work efficiently, unable to extract data from ocr text

[@rashedin6356]

poc means?

[@venktharish2329]

@@rashedin6356 proof of concept

[@MaithilGuy]

I Just finished my End to End NLP project, now I'll start this one 👻👻

[@anirudh8212]

what project did u make bro?

[@ayush07310]

From where did u make

[@NightCyphergaming9243]

sir can u make a end to end project related to vapi Ai assistant plzzzzzzzz

[@adeshsingh2418]

Once you get this please help me in that also. I am also working on this

[@plasmak3297]

I am getting portfolio.csv not found error please help

[@Rushidarekar21]

Sir I thank you from bottom of my heart for this amazing tutorials . Really getting to learn a lot!!!!

[@MAANASRUCHANDANI-q1y]

bro how did you get the csv file?

[@srinivasadineshparupalli5139]

Thank you very much for this crip and clear content on the LLM with llama. I would rewrite your video of Restuarant suggestion application (which was using OpenAI) with llama. Once again thank you for this video. Appreciate your efforts.

[@codebasics]

Go for it. Wish you all the best 👍

[@1itech]

Outstanding exploration of Gen AI with Llama3.1! AI .. Thank you sir

[@codebasics]

Glad you liked it!

[@javajava-v8g]

@@codebasics Hi bro, Your videos are excellent, may I translate them to uzbek lang, for may channel?

[@ambujbaranwal9351]

00:04 Building a cold email generator using Lama 3.1 02:38 Automated email generation based on job post skills 08:19 Using Llama3.1 for fast response 10:55 Creating and manipulating collections in ChromaDB using Python 16:27 Web B loader for web scraping and data extraction 19:09 Utilizing prompt extract for data extraction and email generation 24:08 Creation and retrieval of data using Python code 26:28 Creating prompt templates for email generation using Gen AI Project 31:02 Streamlit framework for quick UI prototyping 33:42 Best practice for storing API key separately from code 38:34 Automating job application process with Gen AI Project using Llama3.1 40:46 Using Llama3.1 for Gen AI Project

[@pratiek8s]

Wishing you a happy teachers' day, Dhaval sir 🤍 Thank you for uploading yet another amazing tutorial!

[@ilhanfirka8310]

1:47 LMAO I DIDNT EXPECT YOU MENTIONED INDONESIA (fr I want to go to overseas company because even in Indonesia it's too low 💀)

[@XuanThao23]

Amazing Tutorials. For those looking for something industry-specific, Immersive Translate now allows you to customize your own AI expert, it also allows translations in the technology field become more accurate and professional.

[@bharatsaraswat]

Thanks again for the detailed tutorial, I have two questions 1. What is the cost of running such models in production. 2. While scraping the links, any rate limiting issues you have faced ?

[@LittleLab9]

Your guidance has been greatly beneficial to me as a data science student.

[@dankstern]

What a great lesson!! I always learn so much from you. Thank You

[@JackSparrow-fc6wk]

Sir when can we expect the launch of full and proper data science course like your data analytics bootcamp 3.0 ?

[@AlHasan-sh3il]

hindi video sir

[@utkarshsinha4594]

Hello Sir while using chroma db it is not running and a dialogue box appears and shows the kernel for chromadb.ipynb appears to have died. It will restart automatically. I am using it in Jupyter notebook please help

[@architsaxena7790]

Great video!! I have a question What about the cost? Will it also incur cost based on the tokens or is there any way to run it locally?

[@codebasics]

It is free

[@architsaxena7790]

@@codebasics that's good to hear. But I believe it would be only for personal use. If I want to scale it up and use for production purposes at my work, will this work? If not, is there any other way out?

[@dogoarmy2776]

Sir can you please help me to build a generative AI project. Topic- Generate Time lapse video by predicting the growth of a crop. I mean it will generate futuristic time lapse video that how a crop will look while growing by scanning or taking the photo of the crop at its current state

[@sirishkumar-m5z]

Outstanding exploration of Gen AI with Llama3.1! AI agents such as SmythOS provide infinite integration opportunities and pre-built templates for individuals that want to investigate additional solutions. #GenAI #AIInnovation

[@rajeshbhosale2008]

Thanks for the sales nuggets-key input for contextual cold emails!

[@ashankaswath7868]

can someone throw light on how we decided to get the job requirements in JSON format from the webbased loader? i would like to know the thought process behind the decision please

[@AIWALABRO]

while running code locally i faced this issue:- USER_AGENT environment variable not set, consider setting it to identify your requests. C:\Users\Asus\.cache\chroma\onnx_models\all-MiniLM-L6-v2\onnx.tar.gz: 61%|████▎ | 48.7M/79.3M [02:58

[@devloper_hs]

Sir I made a Law Based LLM app which can answer questions based on Indian Context and no rag / fine tuning was required with lamma 3.1 So does lamma 3.1 have that much data about india, isn't a threat then?

[@dhrubojyotidey8267]

Hi sir, maine bhi aisa hi ek script banaya hai gemini se colab pe. Love your videos. Can I add you on linked in please?

[@MAANASRUCHANDANI-q1y]

is that csv file of portfolio necessary ? if so can you provide it it would be of great help,Thanks!

[@AlHasan-sh3il]

hindi mlops video sir

[@6001navi]

This is great , thank you

[@neelkanani7230]

This is Amazing ! The best part you described the very basic things going to the website document which builds the confidence in us.

[@ashishnegi7000]

Hope this will help me I am working on llama 3

[@VemuHanu]

Great work, Thank you. Pls keep on adding more videos like this.

[@NisargShah-h8u]

phenomenal work dhaval bhai

[@naveensharma2939]

Hi. Should I buy MacBook Air M3 pro 16GB for AI development? Please let me know, I am to start following your 8 month AI developer roadmap, already learning Python on my company Windows system (restricted by them). Getting a PC is not worth for me (even though that would be cheaper).

[@noadsensehere9195]

LOved it!

[@bharatsaraswat]

Kudos to you for explaining in detail 😀

[@kartik6968]

Facing a lot of issues with Python 3.12 and latest chromaDB. Also numpy version conflicts arising. @codebasics please mention the python version you are using.

[@jhonikhan1107]

How the person who don’t have development background can get the job in AI In my case I worked in IT infra domain since last 10 years

[@CyberSavvyMind1]

Also, please talk about AI/ML security in some videos. If possible, give code examples in the cybersecurity domain.

[@RB11-ftr]

Sir I am a fresher. At 7:10 u opened a terminal.Which terminal was it? please add those steps in video

[@late_nights]

same my doubt too

[@SahdevSingh-io3qp]

It was git bash, come with git(optionally), not exactly based on linux, but provide some linux type command line interface

[@AmanMishra-tw7ih]

AttributeError: 'Collection' object has no attribute 'model_fields' i got this error in 3 line of tutorila_chromadb while making collection

[@Raian_1_]

What a session!!!

[@RafikKouissar]

Very helpful project which can be expanded and leveraged to many other use cases. Thank you sir for your excellent teaching and detailed explanations!

[@CyberSavvyMind1]

Thank you for the video. When you send a prompt containing more text than the LLM can process as input, what happens to the extra text? How do you manage this?

[@AmanMishra-tw7ih]

In tutorial_chromadb , there is error came in 3 line while making the collection, if someone knows kindly helppp

[@adeshsingh2418]

Not able to get he api key of lamma3.1 in console.groq is not able to verify you are human. Please help me in that.

[@ramanandr7562]

Sir, when query like you did in the tutorial i got an empty response. Why would it happen? Does it require an internet connection to work properly? It works on juoyter notebook but not in vscode why?

[@TheAjnabiBoi-k4z]

Sir I want purchase your course but how connect with you. You have not provide any calling number in your site codebasics..🤔

[@codebasics]

drop an email to [e-mail]

[@avdsuresh]

Hi sir, I would like to upskill my self in gen ai. Could you please reply what i should i learn from scratch to make my hands dirty in gen ai.

[@rekhadolse]

Can i add this project in resume Sir? can you please tell me which project should i add to get job in data science or data analytivs to impress manager by this projects??

[@pranayshah5456]

attributeerror: 'collection' object has no attribute 'model_fields' facing this issue on mac os

[@ritikkumarsah7]

AttributeError: type object 'ListOutputParser' has no attribute 'model_rebuild'

[@subinkrishnakt4058]

Is there any way i can add documents through UI into chroma db. Like milvus have attu as UI

[@AGIInovation-o8n]

give this video in hindi on hindi channel

[@farhansiddiqui5382]

I want to learn machine learning and make a project on it, so is the graphics card from Intel Iris enough or will a dedicated one be required

[@savitharachuri]

I am getting pydantic import error, while importing chromadb. Can anyone help!

[@sarjakmaniar369]

Exactly, I am getting the same error!

[@nick_ragin]

Great! Now create a cold email reader/analyzer and action taker, make them middlemen, managers useless!

[@nguyethangvu9165]

tks sir

[@SamirDahal38]

you are great sir🎉❤

[@debjeetmukherjee4591]

How to deploy please make a video because llm file is not inserted in chatgpt

[@manavgora]

Hello Dhaval sir, first of all thankyou for the the quality content..😁 I had a little doubt. I think this code is good enough for a college project, but for solving the same problem on an industrial level, do we need some extra tools or services. And how can I learn to code like industry standards. Thank You😇

[@codebasics]

This is pretty much an industry standard. Additional enhancements you can make is to deploy streamlit app on a community cloud or in your company's internal cloud.

[@manavgora]

@@codebasics ok sir, thankyou for your response

[@raghulvaradarajan7268]

Hi sir make communication master class For data analyst modules

[@monstrouschannel1526]

Sir could you make video on diffusion Diffusion is getting famous in AI

[@NotesandPens-ro9wx]

Really amazing sir

[@manojb4127]

When you’re going to launch generative ai course ?

[@notime9560]

Thanks for sharing new stuff with us.

[@MuchMore-ke9c]

Sir please do python dsa

[@codebasics]

I already have DSA playlist in python. Please search in youtube "codebasics data structures"

[@arpitaingermany]

If I want to store the groq api key in .env file then how can I call it?

[@codebasics]

You use dotenv module. from dotenv import load_env load_dotenv() This will automatically locate the .env file and load those variables in an environment

[@arshsafi7850]

create a video on the roadmap of a blockchain engineer/developer

[@KiyanshKiya]

Looks like, you are busy in your company work now a days. ! video after long time. As usual its great !!!

[@t4n_shahin]

Sir i got my job in London as remote ML engineer. Your video helps me to crack the interview

[@felixkuria1250]

Thank you. This is so wonderful. Can I use FAISS db instead of chromadb

[@codebasics]

yes

[@ArpitYadav-ws5xe]

Wonderful project. Keep it up

[@AIWALABRO]

i have one question that did you deployed this on instance or doing locally. whenever need just run code and get the cold email like that. if lets suppose i am in TCS and i have to create such application then can you tell us as deployment wise how we will do.

[@codebasics]

This is running locally but using streamlit public cloud you can deploy it to cloud very easily. On youtube, you will find videos on this (trust me it is very easy and straight forward)

[@AJDesiBoyz-n2y]

Nike Job posting has been removed fellas :)

[@codebasics]

no worries, you can use a different job postin

[@AJDesiBoyz-n2y]

@@codebasics That's what I did as you mentioned in the video sir..just an FYI for others :)

[@arshahin9788]

Awesome. Please make more videos like that.

[@kunalr_ai]

what was the paid promotion in this video? is that the promotional video for groq?

[@codebasics]

fireducks. It is an opensource library that makes pandas program faster

[@bobgoodi-jd4dx]

Thank you very much sir

[@siddharthasingh6902]

streamlit : The term 'streamlit' is not recognized as the name of a cmdlet, function, script file, or operable program. Check the spelling of the name, or if a path was included, verify that the path is correct and try again. It is showing error.....please any help who completed this project

[@codebasics]

pip install streamlit

[@siddharthasingh6902]

@@codebasics I did this on my PowerShell terminal.....but still not working

[@siddharthasingh6902]

@@codebasics I have put all effort required to make this project.....but at last its not working......showing the above error.....Please help to fix it.

[@abdellatifBELMADY]

Great job, thank you !

[@DeepakVerma-wb6jc]

Awesome work. Love your videos

[@manoharpatil7006]

make it into Hindi please urgently

[@Venky-with-Data]

Learn english instead😅, ❤

[@bhattaraitheaxe]

Thanks 🙏

[@AliHaider-k5t]

can we use this application for writing upwork proposal?

[@codebasics]

Yes.

[@AliHaider-k5t]

@@codebasics can you give me some detail, like in existing email generator we use portfolio with techstack and email generates. But when I want to write proposal then how I adjust it? Please explain this concept.

[@codebasics]

You need to adjust the prompt such that it generates an upwork proposal (instead of an email). The portfolio links part remain the same, you will have your upwork portfolio link somehow. IF you have a single portfolio then you don't even need that entire chromadb part, you can just put that single link inside your prompt so that in every proposal same link is included

[@AliHaider-k5t]

@@codebasics Thanks! I will do that.

[@abhinavmane60]

By the way this is not end to end so please dont say end to end in your videos. End to end means building CI/CD for this and deploying it to a cloud.

[@Guy_w_jockitch]

at 12:31 while runing my kernel dies and it says it will restart, how to overcome

[@plasmak3297]

Same

[@Guy_w_jockitch]

@plasmak3297 hi bro I uploaded the ipynb file in vs code and it worked. Try that,it says it's running out of memory in jupiter notebook.

[@plasmak3297]

@@Guy_w_jockitch alright thanks friend

[@pranjitdas2198]

@@Guy_w_jockitch bro showing the same error? how did you do that

[@Guy_w_jockitch]

@pranjitdas2198 I uploaded the ipynb to vs code and it worked, try to do this ir use some other online kernel..