Python AI Voice Assistant & Agent - Full Tutorial

[@TechWithTim]

What kind of voice assistant do you want to make?

[@UlanKurmanbekov]

J.A.R.V.I.S.

[@ai_backend]

​@@UlanKurmanbekov ULTRON?

[@andyeme1109]

For a few year's I have been thinking about making a voice assistant / virtual assistant which you can call and have it answer F.A.Q.'s about a subject. For example a plumbing company would host this voice assistant using a dedicated phone number (through Twilio or similar service) and customers can call to get minor issues resolved. Ideally it would also be able to book appointments and answer billing questions etc.. If you can make a simple version of this it would be super useful. Love your content Tim! been watching you for many years

[@TheGamer_youtuber]

Can we use local Ollama LLMs to power our AI assistant?

[@jangleegamer_yt6326]

PIP ❌ UV ✅

[@useronetwothree-z6f]

best developer, best youtuber, best programmer, best explainer.

[@edersonoliveiradasilva6817]

Hi Tim!!! I´m a Brazilian and you inspired me in the Python's world, I work in the Oil and Gas Industry already for some years and I had already condition to apply part of the knowledge obtained in programming to improve the process and the safety on board of huge FPSOs (Floating Production, Storage and Offloading Vessels which operate far from the coast, in the middle of the ocean, and require a high level of technology). Currenty I´m in Singapore working in huge and new projects for Shell, Exon-Mobil and Equinor, preparing the Ships to operate in Brazil, Mexico and Guiana. It´s incredible how many things we can do when we have the programming fundamental. This changed my life completely!!! You are the best my friend!!! Please, continue inspiring others with your precious information.Thanks for your excellent videos.

[@victoroliveira7684]

Fala Ederson, beleza? Cara, também atuo no ramo de oil e gas aqui no Brasil, tu poderia me passar teu linkedin pra tirar algumas dúvidas de como você evoluiu na carreira sendo que nossa área tem pouca prospecção para tecnologia?

[@lukmonabdulsalam]

bro you are literally the best developer i have ever seen

[@Just_A_Tech.._]

Awesome Tim👏👏 Your voice plays in my head while awake and in my sleep because I follow along on CourseCareers as well. Many thanks for being always clear.💯🤝

[@davidtindell950]

Thank You. I am currently investigating a "Python AI voice assistant " for a "speech impaired" friend.

[@Luiblonc]

Hi Tim, nice video, and nicely explained. Even for those who have never delved into Python, you break in down nicely. I’ve came into python back from when it was still under the radar before AI or LLMs were not on our road map. Another thing that you should include in your video is the network devices that communicate with your ChatBot, ie sensors or network switch box’s etc. Thanks for sharing your video.

[@davidconteh2231]

This is the best video. Exactly what I was looking for

[@TheDailyMemesShow]

Maaaaaan! You saved me from the headache! I was looking for that project's name - I tried a live demo before, and I liked it, but I missed the bookmark, thanks 👍 Subscribed, by the way 😊

[@NathanLoboOfficial]

Seriously! Thanks so much!!! I've been wait for a tutorial like this.

[@Ayyubzee]

Subscribed to your channel recently but man am i in love with your content

[@seanolivas9148]

You have talent. Do you think you could make a video on having live word prompting for sales calls? E.g. someone says I’m not interest, goes to vector database to pull from knowledge base for a rebuttal

[@voncolborn9437]

YAGV - Thanks Tim, for yet another great video. I always learn a lot. By showing the process (both mental and developmental) that you go through, you convey a lot of subbtle hints, in addition to the primary subject.

[@smallhat1]

I’m going to make it and if it works I will like ever video you make for a year cuz I have been looking for this for 2 years

[@OfficialVaroxCraft]

best video of all time didnt even explained how you setup your visual studio code top of the line content and than this awkward startig "that you are the best tech youtuber" :D would be nice to know where to paste the first line to install python do i need a wsl terminal or WHICH KIND?!?!??!?!? the promt python -m venv ai dosnt work cuz some people install visual studio code for the first time and didnt know if they have the right terminal to paste the prompt

[@princekhatri88]

Buddy wow i am quick in 19 minutes now i don't know what time i am commenting at but i came at 19 minutes ago.

[@miguelcabaero5843]

Nice bro imma make jarvis fr

[@nassosdimou3337]

Will you do mojo tutorials in the future? Also greate tutorial, your channel truly is one of the best programming youtube channels.

[@ChristophHams]

What is the approach to build such AI assistant in Dart/Flutter? Do I have to run the python code inside Dart by setting up a server?

[@muhammadfadhilamri5621]

It was an impressive video!! Thank you so much

[@oussamajmaa9205]

nice tutorial ! is there a way to use livekit without their frontend and use only python , for example reading voice with pyaudio and pass that into their stt and tts agents ?

[@AnishKM-k8o]

bro the video is so cool can you suggest me like how do we do this via hugging face or the ollama

[@akhenatontubba9950]

Mükemmel ve kaliteli bir içerik... kanalınızı yeni keşfettim.manuel olarak altyazı eklediğiniz için otomatik çeviri ile videonuzu izleyebildim. lütfen diger iceriklerinizde de manuel altyazi ekleyiniz. otomatik çeviri ile başka dillerde izlenebilir ve daha geniş kitlelere ulaşabilirsiniz...

[@zeusco1588]

Currently building a similar project, Jervis 😊

[@calvo_en_moto]

Hello Tim, beautiful an useful video as usual, thanks =) I like to ask, what plugins are you using in your visual studio, looks great. Thanks again, regards from Chile.

[@eggsandbrioche]

Thanks for the tutorial! I'm making a Corinthian Helmet with a built-in AI of Athena and Ares. Is it possible to use two separate AI personalities in one playground?

[@prodigy4836]

Hey Tim, Thank you for this video! Question -> what if i don't want to manually connect and reconnect using the livekit UI? I want something like...i run my python program and it starts running and i just have to speak in my mic locally. Is that possible?

[@CreepyFilmz]

Impress us all and make a gemini live like mobile app. Basically your own voice chatbot.

[@josephmyalla3611]

As always great content. Can you provide more content using open source llms please?

[@VaibhavShewale]

wait, maybe i can used this for interviews! hehe

[@usmanyousaf-i2i]

kindly when you use open api tell us the pipe line in detail like how to use it with free models 🙏

[@Sachin-ww1ej]

Hey, I really need some help! We’re working on a project with a tight deadline next week, but we keep running into an error saying the OpenAI limit has been reached. It’s really holding us back! If anyone has tips on how to resolve this quickly, it would be a lifesaver. Also, we're looking to add video functions to our project. Any suggestions would be hugely appreciated! Thanks in advance!

[@StephenPaolicelli]

Great video, I will subscribe and look forward to seeing your other videos. Tried to follow along on this video but ran into a problem in the playground. "agent connected" - does not connect, just spins then ends up False. I will try to figure it out but want to ask this question in your comments section. Would appreciate any help. Thanks,

[@freeabt9916]

it is really nice, thanks a lot. How would you do the exact same but with your own UI instaed of the one provided by liveKit? maybe add a part using react, FastAPI?

[@marcationoo7105]

Tim please can you make a tutorial about ai program that extract text from a pdf or photo that contains text, and i love your videos so much bro keep it up

[@jeffnariesokoth8626]

I thought this can already be done through OCR and there are some free APIs available

[@martcologne7320]

Thx for the good content. Can somebody give me an information how to deploy the agent so that a chatapp can connect to the agent > NOT local!

[@starnine-b6b]

Upload a video on how to customize the frontend like video calling app.

[@NasserTabook]

Excellent tutorial,thank you, please can we use Agentic RAG with LiveKit,

[@flmn7866]

🐐Behavior

[@narcospro7797]

Bro you are the best in the world ah one time please may you make voice assistant for us please by train your modal and use your audio datasets

[@SoulSeeker]

Did I miss something here, what is it connecti g to to actually change the temperature? Is it some sort of IoT or what? I got confused at some point. Also how do you get it on your phone?

[@Warley.Araujo]

Great Video

[@some_07]

hey Tim, can this assignment work on our voice commands. like if we said open Google so can it be,???

[@FabricioMTL]

can you make a tutorial on self host mode , it will be cool as well

[@Migueldicostanzo]

Great Video , Question how can you ad an avatar , so let say i want and to build a Friend assistant hero but i want to talk to the hero in my phone screen . Can you please guide me ? Thank you

[@mazharulislamleon8672]

How do I connect knowledge base I mean RAG to livekits voice agents, In my cases I wanted to add more than 50 pdf files. Could you please provide some information regarding this topic ?

[@mystealthlife6991]

How would I make this work with self hosted?

[@kingneptune2295]

hey im having an issue with implementing this. I keep getting the error` api_key is required, or add LIVEKIT_API_KEY in your environment` when i have all of the keys inside my .env file. idk what the issue is as im new to coding

[@vitchenzopenas5156]

Hey, thank you for the video! I need some help. I'm making an assistant for accessibility, and I want the agent to respond when the user calls it by name (only when the user calls it by name). How can I do this?

[@AdarshSingh-qy6mt]

Thanks man, it really solved my problem. Kinda simple advice but effective. Actually I was doing a project on Steamlit, it was about stock predictions, it fully visualised the data. But it used an old module that took data of the stocks that was the error.

[@Sachin-ww1ej]

Hello we did everything and there are no errors but in the end when we talk it says something about open ai limit reached or something and we can't seem to connect we rlky need this , we have a deadline coming up next week and this is inactive for it , if this works we can make our own version of this and we rely like how it turned out so far , also pls tell us how to add video functions to this, pls reply fast

[@oprix8910]

The limit is reached because OpenAi requires you to pay per use. You only get a free option for the first 3 months of usage of your account, but I suppose you have created your account long ago and that does not work anymore. If you want to fix that you could either add your card information and add like 2e, or something like that, or use Ollama locally. Tim also has a video about using Ollama locally ("AI WebScrapper").

[@TheManOfTheHourEveryHour]

🔥🔥🔥🔥

[@AIWALABRO]

can we create voice assistant for SQL queries , i gives the input via voice commands and it will be generate the dashboard or visualization for us. or gives the table from the database. can we get videos on this topic? eagerly waiting !

[@TechWithTim]

Sure you can! You can simply ask the model for a query and then connect it to the database and show the result

[@AIWALABRO]

@@TechWithTim for this use case ? is any video tutorial available on your you tube channel.

[@MarlonSalewski]

Is there any way to update an old google nest to something like this?

[@BeinspiredbyN8ture]

Can you make an AI Voice Assistant for a wordpress website, that was feeded with the website and pdfs?

[@Mustang_G]

Not sure why I'm getting error, unable to create directory

[@RaghavKumarR]

Bro how do you read my mind? im literally working on the same damn thing using groq and ollama

[@reiiigns]

wondering how I can connect this locally with ollama?

[@Vedant-z9y]

Everything's great but Whenever I see that thumbnail I don't know why but instead of Hi Tim I always read it it Hit Tim

[@jazz5919]

so it can not report anything other than temperature related stuff?

[@TechWithTim]

It can do anything you want, I just make a simple example to get you started

[@CyberDevilSec]

Tim please show us how you install the Ollama plugins bro CMOON..

[@pradhumnkanase8381]

The agent is not able to understand what I am saying when I try to set it up. I am using the same code as your's.

[@starnine-b6b]

how to make a function that sends the whole conversation to an llm after the conversation ends?

[@LolProgrammer]

Can i make this using Gemini ?

[@JayJayworld-gf4sw]

it's telling me to add the livekit api key to the environment but it's in the .emv file that you instructed. it doesn't see it.

[@kshitijdeshpande6272]

it should be `.env` and not `.emv`

[@kingneptune2295]

@@kshitijdeshpande6272 I am having this same issue yet is called `.env` any ideas?

[@VaibhavShewale]

now al i need a smart devices in my home

[@swapnalidhotre8265]

Is there a way livekit agent identifies given wake word and listens only when it is said?

[@rupesh6518]

How can we capture the audio duration?😊

[@LiQuiDPlays69]

can anyone help me I finished the whole video nad my assistant is not working at all i tried copying his code with my own keys and secrets but it still is not working \

[@TechWithTim]

What kind of error are you getting?

[@eggsandbrioche]

@@TechWithTim I'm getting a Value Error, "ValueError: api_key is required, or add LIVEKIT_API_KEY in your environment"

[@kingneptune2295]

@@eggsandbrioche you ever fix this? im getting the same error

[@beleiveme2350]

Can i use it even if am offline

[@sabbirhossan3499]

I want to build it with my custom voice, but I don't know how ?

[@antoniocarlosjuniorrr]

What is this theme you are using?

[@ishantstech6878]

I don't have money to buy OpenAI key, any other way around?

[@muhammadafaq1454]

Hi in this vedio you gave just some temperatures and it is giving answers of that temperatures. My question is how to give large data there so it can give answers from that? Anyone please?

[@rmt3589]

You need to either train the model(not fine tune), or do a thing AI forget the name of so it can pull external information.

[@rmt3589]

Searched through my saved stuff, the other thing is called RAG. Retrieval Argumented Generation I think.

[@musicon1636]

actually I'm doing this project guided by your video , now facing an error please make clear

[@smallhat1]

Hey I’m super new to coding and I was wondering if I would be able to make it were I can tell a robot arm which way to move and power it on and off with the voice assistant

[@JS-kb4bk]

I would use an arduino to do that

[@mohammaderiqat1598]

how can i build a custom application on that

[@renovacio5847]

But why do you cut it when you find out how long it takes to respond in real time?

[@TechWithTim]

You can test yourself just don’t wanna make you sit through that in a video

[@WizzyAlex]

Nice ❤

[@TechWithTim]

Thanks 🔥

[@potaz02]

​@@TechWithTim how to custom voice for this ai?

[@FofouAudrey]

am kinda stuck here not knowing what to do it keeps saying can't find dotenv what should i do pls

[@PJTheAnalyst]

did you do load_dotenv()? for the imports do: from dotenv import load_dotenv load_dotenv()

[@owenchilwalo7944]

How can I use gemini in this project?

[@bloggerdsc8422]

Voice assistant Can be in french language ?

[@omnivers-ce6hi]

Yes

[@InAMinute-ws3yv]

does this support voice interruption?

[@-paperwings6986]

does livekit support edge_tts ?

[@ElementalPlayz]

Question can I use this to translate

[@omnivers-ce6hi]

What if we use Ollama instead of OpenAI to avoid paying per API request is it possible?

[@TechWithTim]

Yes of course!

[@omnivers-ce6hi]

@@TechWithTim What a quick answer to my question, thank you Tim ! Keep it up 💪🏼

[@reiiigns]

@@TechWithTim any idea how?

[@justheretocomment6410]

@@reiiigns yeah a fully offline version with a great ollamma LLM would be great

[@inavillichirannjevi7638]

ImportError: cannot import name 'AssistantFnc' from 'api'

[@abdul.rehman_.x]

My Agent is not connecting

[@loyalendeavor7991]

Change interpreter: If using vscode hover over the unrecognized dependencies and select change interpreter, use the one that utilizes your venv packages. You'll find the venv name on the left side when checking different python interpreters

[@SageServices-pd7yg]

are we spelling assistant as assitant for a reason?

[@TechWithTim]

Just typo

[@patricalaun5709]

Can this be made offline?

[@muhammadumairramzan9419]

Do I need a paid version of chatgbt api

[@eggsandbrioche]

I keep getting "fnc_ctx not defined"...

[@jayeshgamerx]

Hey @TechWithTim I am facing errors while installing livekit-plugins-openai and livekit-plugins-silero (I even tried to install it from requirements.txt) it just shows an error "Getting requirements to build wheel did not run successfully. │ exit code: 1" Please help me if you could!!

[@thabomonamodi1436]

Can it be Interrupted?

[@bene88597]

Bro is there a way to get live data from Amazon without to use these expensive third party APIs? I need live data of products with 40+% discount thx mate ❤🎉

[@ernstb1234]

Bro I was lost from the beginning imagine I’m a 6 year old trying to figure this out

[@HAL9000-B]

Why don't you use AI to assist coding?

[@rmt3589]

It's either impairing or worse than just coding raw, depending which one you use. He's a competent coder, so it can only slow him down. I on the other hand, plan to.

[@Muhammaddhaseeb]

Please make a video on how to use use it for free using other llms

[@CyberDevilSec]

FUCK YES LDEGEND!

[@billykotsos4642]

Im getting an SSL certificate error… anyone else getting the same error?