How to Create Jarvis AI Assistant | Like Iron Man

Creating Artificial Intelligence Assistant | Jarvis | Friday | EDITH | Ironman
Creating Jarvis powered by OpenAI and Python | ChatGPT
pycharm = www.jetbrains.com/pycharm/dow...
home brew = brew.sh/
Find the code at = github.com/crackallcode/AI-As...
0:00 Setting Up
3:25 Importing Modules
4:56 Windows Install pyaudio
5:24 Mac Install pyaudio
7:08 Mac/Windows Install
7:57 Writing Code
15:11 Testing The Project
16:30 Complete Code

[@guilhermevinicius6007]

I was thinking about having a Jarvis this week! Great content man! :) A big hug from Brazil!

[@mais-famoso-do-youtoba]

tbm sou do Brasil

[@ryan_phdsec]

If you are having issues check out the troubleshooting portion of this video for "common issues" I see people having. kzbin.info/www/bejne/onTaaHh9jJqCY9U

[@houssamchehadiofficial]

this is not a personal ai, if you use ChatGPT or any API provider then you do not have your own AI, for example you can teach it how to do illegal things and let it give you back a prompt about it or let even make bypass simple things like NSFW filters. Your personal AI will learn any dataset you want and will provide you with any feedback you want, and you will be able to modify its training and algorithm.

[@alrimvt02]

But to achieve that, how much computational power is needed, how much investment in components?

[@houssamchehadiofficial]

@alrimvt02 if you are going to download pre-trained sets and alter them, then all you need is 16GB RAM because language models that are commercially available don't have long term memory, though I suggest 32GB for smoother work. If you are going to do the training from scratch and expect replies similar to what you see in GPT 3.5, then you will need the following: If you're programming through Python, such as using pytorch, then you will need GPU since Python requires GPU, and the best would to buy an Nvidea RTX 4090 GPU currently costs around $2000 USD. If you are using Php or C++, go with CPU such as Intel Core i9-13900KS, which costs around $1000 USD. You could always use plugins that translate your code behind the scenes to different languages so you can use the power of either GPU or CPU, whichever you have on hand. Also, you can use TPU to increase tensor performance for as low as $150 USD, especially if you are using Tensorflow. To begin with deep learning and I mean just learn and test AI a $100 computer will do the work, all needed software will be downloaded and will work but won't be a smart AI only a learning AI. For something that runs models such as GPT turbo and learns from the internet, a full option computer will cost as low as $4000, surely the faster you want it to work the higher the cost up to a $100,000 for computers running Nvidea A100 GPU, 512 GB RAM, and a Ryzen Threadripper processor. Again, $4000 would still be great and give you all you need. Lastly, keep in mind it's the learning process for the AI that needs resources, but after it learns then the AI would run on any cheap computer would run it just have between 16 to 32 GB RAM. While saying this, since we need the resources just for training the AI then we have an option to rent powerful computers that are made specifically to train your AI, those are found on clouds such as Google cloud and AWS Amazon cloud, and they are very cheap because you pay only for time your AI is being trained. Once the AI is trained, you can have it installed on your personal computer. If you never worked with AI before it might take you between one month to three months to learn how to do every by yourself on your personal computer and develop your own AI. Just expect to use platforms and plugins that are already made, because to create something like Pytorch yourself that needs a community of specialists, and neither chatgpt have their own platform they just use what's made already.

[@peytonmac1131]

You can run something like KoboldAI or Oogabooga. Running them purely from your home PC obviously won't be as powerful as something running of billion dollar computer like ChatGPT, but these other versions are perfectly capable of holding (mostly) coherent conversations.

[@ogogogog8807]

Can you show me how to do that to my computer I'm willing to pay also??

[@masterstrange9554]

that how elite block you from growing

[@badrelkoudia2210]

What if we want to connect it to a visual interface to optimize the conversation experience

[@piddy1235]

00:00 Create an AI voice assistant using open AI 02:01 Learn how to create and use an API key 04:17 Installing Pi audio can be challenging 06:24 Install necessary packages for Pi audio and speech recognition 08:49 Creating a while loop and setting up microphone 10:58 Creating an always-listening AI program 13:01 Using OpenAI's GPT 3.5 model with Google speech to text and MP3 file creation 15:07 Learn how to carry on an audible conversation with chat GPT Crafted by Merlin AI.

[@fitlikeaglove7396]

Any ideas on how to package this for deployment like a smart home speaker? Parts lists or anyone doing this commercially or simi commercially?

[@christiancastro8931]

The code is seemingly recognizing that I am speaking to it, but will not speak back and the terminal only says exception. Anyone else finding this error?

[@nbow_ow]

I am also having that issue, maybe its probably to do with the open ai part

[@ryan_phdsec]

Are you writing on kali linux or your host computer?

[@ryan_phdsec]

if you are using kali linux you may need to change the output settings manually

[@p_mi1]

same here, Im on Mac... what could be the issue?

[@ilonwadominic8452]

Same with me, I think the issue is with mac

[@thomasbolton2121]

Can this be used on a phone with the app? I am wanting to make something like KITT on Knight Rider. I'll be using a Wireless mic connected under the hood (Similar to echo auto) to my phone so it can use the phones ChatGPT. Okay, so I currently have a 2016 Cadillac XTS that I have turned into Knight Riders KITT (Knightrider Cadillac on TikTok), I use echo auto but its so limited. I'd like to give it the ability to answer as something other then Alexa, and i'd like to give it some attitude. thx

[@soyumapple7195]

hi, i tried following the steps and it only shows the file path in the console. i changed the (device index) part to 1, 2 and deleting it entirely. all gave the same result. i copy pasted your code and it still gave the same result. is this an error or do i just have bad pronunciation and it is working?

[@smibii-plus]

You can simply determine ur mic with sr.Microphone().list_microphone_names(). You could also just write ur mic name into a var like mic_name = 'Mikrofon (NVIDIA Broadcast)' and set the mic index directly like mic_index = sr.Microphone().list_microphone_names().index(mic_name)

[@user-tl8es7xe2m]

mas, colocando o API da openai do chatgpt, oque for fazer utilizando essa API não vai ficar armazenado no banco de dados da OpenAI não?

[@Verkerg-u3u]

At 12:52 in July 2024. I can't seem it find the Documentation Tab anywhere. Could anyone help?

[@shawnjakubec6672]

it won't let me type anything in the terminal on pycharm, I'm using a pi4

[@andreagessner9199]

Is there a way to make like an visual jarvis? Like the sphere, when it speaks it gets bigger and so on.

[@bcnukenny]

I tried this, I was using a Windows PC The first error I had was "You exceeded your current quota, please check your plan and billing details." I added my CC details to the API and gave them $5... The next error I had was "The specified device is not open or is not recognized by MCI" To fix this I found the new version of playsound didn't work so removed it and installed 1.2.2 pip uninstall playsound pip install playsound==1.2.2 Then I was able to hear the Voice. Note that from asking the question to getting a response was about 30-60 seconds. It does not do follow up questions but you can keep asking questions at any time. Until it stops answering.... and you have to reload the script. Overall a fun learning experience

[@mattlantin4504]

underrated comment. I also had to pay $5 :). And the current version of playsound is 1.3. Was fun indeed

[@user-it8so9bu7j]

i couldn't install playsound. but i fixed it with "pip install playsound==1.2.2". thanks dude

[@dariuszg.8026]

can I get the output voice that way that someone who Im talking to would hear that answer too?

[@morganandrade7786]

Have you experimented much with ElevenLabs in regards to this sort of thing? Wondering how easy it would be to combine. I'm trying to find an AI that'll let me set reminders and then specifically speak to me TO remind me, to jar me out of hyperfixation/help with memory issues.

[@slinkybaton]

Tell me if you find any news. I am seeking a similar AI tool that I can build that'll help me with my memory

[@ryan_phdsec]

If I were to do something like this I would probably use something like twilio or smtplib to send me a text or a email as a reminder... I would save my voice input in a variable and use os.system to create a file for the reminder... OR use an api to store my reminder and then then give a voice command (store it as a variable) for date and time to send me a text or email.

[@mohdjekke]

you can do that using the latest api of openai where you define the behavior and functionalities of the ai by writing an invisible system message. response = openai.ChatCompletion.create( model="gpt-3.5-turbo", messages=[ {"role": "system", "content": {"role": "system", "content": "You are a helpful assistant."}, {"role": "user", "content": user_input}, ] ) gpt_response = response['choices'][0]['message']['content'].strip()

[@only1muppet]

Or try setting an alarm on your phone or PC

[@Eternallymzx]

@@only1muppet that defeats the purpose of the ai

[@adjeteyannang7228]

when i run the code it only prints out what I say and "Exception"

[@wolve2546]

Mine always writes what I say but I dont get answers and no sound can somebody help me please?

[@chethank8995]

i am using pycharm professional 2022.2 and i am getting an error "ModuleNotFoundError: No module named 'speech_recognition'" even though i installed the package using "pip install SpeechRecognition" same error is ocurring can u pls debug this

[@jennayaberridge7039]

i honestly cant complete it due to not having pip is there a way to download pip

[@sahilkopardekar4423]

Its saying: File "[The File name here]", line 38 SyntaxError: expected 'except' or 'finally' block Process finished with exit code 1 what do I do in this case?

[@DJSAM9]

what if I want to make my own custom voice or other voice as a assistant what i have to do ?

[@user-hc6mf1lq7d]

Am having an issue to install play sound import it gives a long error

[@kristala3776]

Import speech rocognition as sr is showing module not found error

[@luigimiguelstamaria619]

Ryan, why she didn't talk back? i already right the code correctly and test it without api but with other alternative codes, she talked, but if i input the api she did not answer, it seems i need to pay? is that what she want? do i need to pay using cc to activate her talkback? please enlighten me

[@Raven-ol7nd]

I have a question, can i do this with another kind of voice?, like, a more human like voice?

[@jonathangauthier1968]

Hey everything work fine to me, but i cannot heat a single sound coming from it. Even delete mine and try your from Github and i can see it print message but I hear nothing. Any idea how to fix this ?

[@DebojitBera-ze9bg]

Can we make the type of AI that can be really attached with my computer and my personal mobile phone , to use it in both of devices ( Android + Computer) that can assist me with my voice like Jarvis or FRIDAY ?

[@cliffordjohnp.adalin2656]

im using window but icant see intalled all of the import i ask

[@AC-os1bb]

Sooo many errors :( Didn't work and couldn't come close to get it working. no formatting errors copy and pasted from doc too and changed key .. nothing i do works :(

[@thepotatosandwich982]

super confused looked over this video and notice that he makes corrections off screen but thought I had them all but mine doesnt respond to me it can hear me but has no reply help?

[@brintonotieno9309]

my program is printing Exception what may be the error. please help

[@Nerdtronic]

Will the prompt continue to have context of previous parts of the conversation? For example if I tell it my favorite color is blue. And then ask it a few other things and then ask what my favorite color is. Is each prompt isolated from the rest? That would be a great next step. You'd have to keep track of the conversation in a string and send that along with the new prompt. And then also make sure to truncate that log so that it doesn't exceed the token limit. Another mod would be to use the API to customize the personality of the bot.

[@ryan_phdsec]

You would need to set up the API for it to keep the context of the conversation...

[@Nerdtronic]

@@ryan_phdsec do you simply set up the api to do that or do you have to submit the history as part of the prompt? Like is it just a switch to flip in the API?

[@AdDiCtEdZ]

homebrew error when trying A parameter cannot be found that matches parameter name 'fsSL'. At line:1 char:22 / The term '/bin/bash' is not recognized as the name of a cmdlet, function

[@adrianmagana153]

Homebrew link is not working, parameter cannot be found that matches parameter name 'fsSL' and '/bin/bash' not recognized. Please help!

[@surendrakumarsahoo9878]

Hi, I am getting this error "def get_audio(): KeyboardInterrupt". Please help

[@ronopalec5346]

project name , do you replace whats already there? or do add your project name next to pythonProject?

[@hashimkhan9269]

how do i integrate this with a front end ive designed and make an actual project ?

[@KINGTWOCHAINZ595]

how do i turn it into an app or a feature on my device

[@athulkrishna.p.d903]

Bro are this code voice asistence can work like when we ask like 'open you tube and play this video' is this query work?

[@d-tech7258]

i don't know why if i grab your code all the way to the pycharm and wen its run,but terminal shows expecting and if i say someting it did not speak back to me 😶

[@uvinduranga2896]

can we do this using arduino? i mean, connect it with chatgpt and make a personal assistant ? maybe plug a small screen too?

[@guilhermevinicius6007]

Ryan, its possible to use VSCode and use the Python extension to create this AI?

[@ryan_phdsec]

Yes. When originally created this it was on kali linux with vscode. However, it is possible you will have to install pip on your host computer.

[@user-jz3jr7sp9q]

it says there is no module for import playsound and openai

[@zeburgerkang]

i can do all this with my visual studio code no?

[@timothyy7]

i keep getting the exception error but i have no idea whats the issue

[@arch.samertaleb]

I get the error AttributeError: module 'pkgutil' has no attribute 'ImpImporter'. Did you mean: 'zipimporter'? while trying to install the pip libraries on windows, apreciate the help

[@thatch8537]

Can you add skills to it, or os this just a “my parameters dont allow it” overly fancy bs way to use gpt on an alternative software window?

[@nikeshpatil2879]

sir i am having an error of execption. for every input its showing exception

[@navnitsinha7259]

So, I am ready with the code but when I run it, it just shows me the path to the File. Any idea why?

[@cliffordjohnp.adalin2656]

i have a problem in creating Ai can you help me? in pip install

[@imamethyx]

I run the code and I have no errors, but it just doesn't do anything at all. I have listed my device index and everything should be fine but still nothing... someone had the same issue?

[@sussybaka77569]

does anyone have the open ai documentation code for the if blank is in said part?

[@anandhuramesh3462]

how do you done the last run of program

[@user-sz2jo5gm6i]

Im getting this error = def get_adio() ^ SyntaxError: invalid syntax please help

[@gustavojimenez7030]

Can I add this code with the API into my esp32 and would it work?

[@TahaAli110]

can we put Cortana voice int it?

[@shoaibdalal4036]

homebrew key i have copied and paste in code. but is it not recognised is coming. error is comig. so plz tell me what should i do.

[@17_samarthwagh_aids33]

But after some days it requires payment to access that API key or some queries are free so something alternative options is there? Please make video on it

[@jordann_S]

Is there a way to change the voice of the ai at all? 🤔

[@arcgamer_tv]

FINALLY THIS ITS THE BEST ND ONLY VIDEO IT EXPLAIN WITH DETAILS ❤🎉🎉🎉THANK YOU ❤

[@HeeradSadeghi]

Traceback (most recent call last): File "C:\Users\Heerad\IdeaProjects\untitled3\venv\Scripts\activate_this.py", line 5, in import playsound ModuleNotFoundError: No module named 'playsound' Process finished with exit code 1 this is my error HELP

[@odessasingh4771]

pip install --upgrade setuptools wheel then reinstall playground

[@Celeste108butbetter]

Hi, so I have wanted to make a python AI assistant for quite some time now but I've never found a decent tutorial until this one I followed along with everything and was a bit disappointed when my code wasn't functioning as I had intended or in anyway as yours is but I thought it's okay as I am able to just copy your code directly but still it won't do anything it just keeps saying "Exception" I have no idea why

[@ryan_phdsec]

Check out the Trouble Shooting part of this video at the end kzbin.info/www/bejne/onTaaHh9jJqCY9U

[@naman80067]

what's the error?

[@JoBricks99]

Great video! I did never do anything with python, but this video is really easy to understand.

[@jackomokallen2971]

After install brew I could pip install pyaudio. I don't get any of this.

[@ryan_phdsec]

Use the following commands to get pyaudio to work with homebrew. install homebrew: --> /bin/bash -c "$(curl -fsSL raw.githubusercontent.com/Homebrew/install/HEAD/install.sh)" install portaudio: --> brew install portaudio install pyaudio --> pip install pyaudio

[@reinsein518]

i dont if get the setup running because its always different when u have it already instaled thes video makers dont get it

[@adrianmagana153]

I cannot install playsound, error: subprocess-exited-with-error. Please help!

[@odessasingh4771]

pip install --upgrade setuptools wheel then reinstall playground

[@locoabi]

where is the tamplate from the documentation

[@jjrumsey2001]

I cant get playsound to download with pip!

[@kassabro7919]

can you just run it in normal python or in a terminal ?

[@kingyoyo4726]

Is there a way to download pip without using pycharm?

[@jemesraynor3296]

so does OpenAI control the assistant? or how ?

[@adamdewitt2054]

error on line 7 " import openai " no module named 'openai' and thats straight from your git hub,

[@kingyoyo4726]

pip install openai did the trick for me

[@ilmarots7338]

Okay, so everything else works, but i can't install playsound. as it says error 1...

[@odessasingh4771]

pip install --upgrade setuptools wheel then reinstall playground

[@erasec5088]

I need to know a thing, how can I chaing the voice? For example whit the voice of, Idk, Madara? Kratos? Obama?

[@Admiral_kizaru1]

It doesn't run but have a syntax error at line 16

[@swagmixtape5647]

How could i add a text-to-response element to this?

[@optimusprime1634]

when i run it it tells me "you exceeded your current quota, please check your plan and billing details"

[@ForIEqualsZero]

pls help! i always get this error: You exceeded your current quota, please check your plan and billing details.

[@regulartalk177]

I need help and I can't find the answer anywhere.....I do not have recognize_google only recognise_google_cloud. Is this the same just updated or a different option?

[@user-uu7ub5gb6l]

What re the alternatives for Google TTS? I live in Russia. so it really sucks not having access to google cloud.. I try to learn many things but because of my location and nationality I can't do many things

[@cy_wareye7395]

Definition of quality content.❤ Edit: Every single time i have no audio back, and the only response i get now is: "You exceeded your current quota, please check your plan and billing details." Any ideas :) ?

[@bcnukenny]

You need a Open AI API billing account, you will need a CC and you can put $5 on the account to get it up and running.

[@torbilan6292]

yes, pay open ai.

[@mohammadazmi5102]

That simply means it is not your own assistant that we are searching for😂

[@anv-xj2mg]

so now it wont work if i dont pay

[@Allfather4428]

whenever i speak to it it just says exception and doesnt talk and fixes

[@dezideriuvarga6002]

is it possible to make an AI like an computer who you can talk to like in star trek?

[@luky__1987]

Hi, I keep getting a yellow exclamation point when it says say = r.recognize_google(audio) and audio playback won't work, I still get a red exclamation point when playing audio. I need help :(

[@luky__1987]

I could also send a screen shot

[@Haha-yes22353]

I got mine to work so if u want I can send you the code ?

[@Vo0idsEmbrace]

can you send it to me?@@Haha-yes22353

[@luky__1987]

yes please :) @@Haha-yes22353

[@sussybaka77569]

why are there errors in mine? (im using visual studio code)

[@lemicmelo7713]

Any suggestion on a bot to be develop to keep learning from a cloud documente? For example, if the user prompt new questions and the admin join the chat to answer, this answer could be sync on real-time to the bot similar as ChatGPT learn from your inputs? The purpose of this is to create a more specialized virtual assistant to suggest answers for customers

[@tonyplayesgames5316]

Have u found anything yet lol I wanna add this too

[@lemicmelo7713]

@@tonyplayesgames5316 I’ve learned so far using botpress to create this knowledge base chatbot, I think is possible to create a variables to add this new information added by the user so the bot can use this information in the future with new customers and so on

[@ShekharKumar-lm2hu]

Can we run in the many devices

[@MzK-h]

can u use any python app or does it have to be pycharm

[@emazer21]

playsound is not working, I installed it, but when I run the program it says it is missing, can you help?

[@Hellopoki34]

Does anybody know how to make this a link?

[@Wiezeexcoos]

what apllication is this

[@monday304]

how can you give it a 3d body and face that lip syncs the speech perfectly and also has accurate body language gestures?

[@kirbyismygod8825]

im not a 100% on this but you could likely use services VTubers use and connect it to the AI

[@villaratanaphom-sg3hg]

how can i turn this into an app so i can gift it to my nephew ?

[@retrogamereaper]

Is there a way to wrap the project into a mobile app (preferably android) to have on the go?

[@ryan_phdsec]

yeah you can install Linux on your phone and transfer the program

[@JUSTNICE.DEVELOPER]

can i build it into a website?

[@Peacfull]

i tried to pip install playsound and did not install.

[@alakdan83]

Hi Ryan, great video and tutorial! I'm trying to run the code but get the below error. WHy is this package being called and how do I resolve the issue? ImportError: cannot import name 'override' from 'typing_extensions' (C:\Users\foldername\anaconda3\lib\site-packages\typing_extensions.py)

[@RasiahKala]

my problem is i dont have a microphone so how do i do it