GPT-4o API: Create Your Own Talking and Listening AI Girlfriend

[@MatthewChowns]

Just FYI, they have been consistently using a lower case o in the model name so it's clear it's the letter. Otherwise it looks like it's GPT forty or 4.0, which aren't right.

[@ai-for-devs]

Thank you for the clarification! I'll make sure to consistently use the lowercase "o" in the next videos.

[@trevordupp8734]

Thank you for putting this out so quickly! I've been wanting try something with the new release

[@ai-for-devs]

Thank you 🙏

[@Raptorjackson]

Can i replace voice with my own voice...?

[@nathanchilds3952]

Is it possible to save the entire conversation to a local db. Then in between conversations, before starting a new one, the code pulls the previous conversations and feeds that into the prompt first so the “girl friend” has all the previous context(memory) to pull from?

[@jichaelmorgan3796]

Yup, there are some tutorials out there for it

[@ai-for-devs]

There is an easy way to do this by using autogen teachable agents. Please have a look at kzbin.info/www/bejne/qau8lpSLodiUhLssi=DhT82kIjkLsxHSiL

[@arianaponytail]

it will take a few weeks before they release the full new voice system and api aswell as the video function and api. When they do , you should update this project. it will be a lot more imersive. and it should be able to litteraly watch a movie with you and comment on what it sees and have a very detailed emotional voice with very fast response time. :)

[@ai-for-devs]

Thank you for clarifying that, @arianaponytail! I can't wait either. It's exciting to know that the vision capabilities can already be used with the new model and API.

[@mauricio9581]

Hey thank you for that amazing code! I have a problem. The second moment i ask a question the output.mp3 file gives me an error. PermissionError: [Errno 13] Permission denied: 'C:\\Users\\Mauricio\\Desktop\\Gpt4o GF\\output.mp3' What could be the solution?

[@emkjuslen]

this is just what i was looking for. thanks. Would have been great if you dropped a repo link

[@baijnathmahto600]

Github link for this??

[@AhmetAKTA-qn8by]

Great ! , can I make it just answer from spesific own data ? Answer depending on the Sql table data or something ?

[@nathanchilds3952]

I was thinking the same thing. Like persist all the conversations into a local db table. Then each time the “gf” is instantiated feed it the previous conversations via the prompt so it would have “memory/context”. Granted this could amount to a ton of data over time. Or allow the chat bot a method to go search the local db and use key words on the table data so it would be easier to parse thru. Similar to the AI Car repair bot he made

[@ai-for-devs]

There will be a video next week about using vector stores with gpt4o at ai-for-devs.com

[@nathanchilds3952]

@@ai-for-devs sweet!

[@gutv]

is there any way to have that magical voice expression as showed in the openai presentation?

[@ai-for-devs]

That's a very good question. On the official page of the text-to-speech guides (platform.openai.com/docs/guides/text-to-speech), it still states the old text: 'There is no direct mechanism to control the emotional output of the audio generated'.

[@blasandresayalagarcia3472]

​@@ai-for-devs maybe not emotionally related outputs, but you could implement a system with natural interrupts

[@Yewbzee]

FYI this isn’t using the new conversation mode that they rolled out with 4o, this is the old version.

[@ai-for-devs]

We're using the GPT-4o model for the chat completion endpoint due to its faster inference speed, rather than the GPT-4 or GPT-4 Turbo models. As of now, I don't believe there is a way to use GPT-4o via API directly with sound files. If there is a method, please let me know.

[@TheInternalNet]

Absolutely CRAZY!! This is some really interesting/exciting things.

[@ai-for-devs]

It really is!

[@dr8544]

hey can we change the voice using by any open source model ?

[@ai-for-devs]

Absolutely, you can easily replace Whisper and the audio API call with any open-source model of your choice, or use a service like Replica, which provides easy access to such models.

[@Cryptowski]

very good! however, i get this error after the bot has created the output.mp3 on my first question, when i then ask a follow-up question, this error occurs. so it cannot change the output.mp3 once it has been created. Traceback (most recent call last): File "F:\BOTS\her-gpt4o\app.py", line 32, in response.stream_to_file('output.mp3') File "C:\Users\atzek\.conda\envs\her\lib\site-packages\typing_extensions.py", line 2636, in wrapper return arg(*args, **kwargs) File "C:\Users\atzek\.conda\envs\her\lib\site-packages\openai\_legacy_response.py", line 423, in stream_to_file with open(file, mode="wb") as f: PermissionError: [Errno 13] Permission denied: 'output.mp3'

[@ai-for-devs]

To avoid this issue, you can create temporary files or change the filenames based on timestamps or an increment. This way, each response gets a unique file name, preventing conflicts.

[@Cryptowski]

@@ai-for-devs i'm not a coder :( how?

[@DezorianGuy]

Is there a way to create such an ai gf or person with an offline model? With fast response times etc that updates itself with the latest internet knowledge base when needed etc?

[@ai-for-devs]

Creating an offline AI girlfriend or persona with fast response times and high-quality inference is challenging due to the significant hardware requirements. The computational power needed for real-time processing and maintaining up-to-date knowledge is substantial, making it difficult to achieve the same performance as cloud-based solutions without high-end hardware. However, you can keep everything local that should be private by using a local vector store for sensitive data. This hybrid approach allows you to balance performance and privacy by running core models offline and updating online as needed.

[@DezorianGuy]

@@ai-for-devs thx. I don't have Internet access all the time so an offline alternative would be awesome. Also the one thing bothering me when using gpt4 is the long response times as it has to check the web. For an ai companion it doesn't necessarily need the most recent news to be socially useful. Maybe I'm wrong but there seem to be more advantages for an offline ai person. Faster responses as it doesn't have to check the web (also no queues), versatile use as it can be used anywhere (isn't reliant on constant Internet access), cost effective as there aren't monthly fees, secure as it runs locally, up to date (kinda) with most recent Internet updates integrateable at will, like once every month (topics adjustable to the ai persona), etc.

[@Arjun-hc7ow]

Hi is that api u are using tgat it fir free version !?

[@antonkruger]

Greater tutorial as always. I can't find the code on your github. Can you provide it pls.

[@ai-for-devs]

Sure, please send an email to [e-mail] with your GitHub alias or join www.skool.com/ai-for-devs/about for free access to all courses and source code (only today).

[@trevordupp8734]

How could we say a phrase to end the conversation script?

[@ai-for-devs]

You could add a condition like: ... print(transcription.text) if "goodbye" in transcription.text.strip().lower(): print("Goodbye detected, exiting loop.") break

[@trevordupp8734]

@@ai-for-devs Would I place this at the beginning of the while True: loop?

[@InspirasiKita-ID]

Bro, i cant wait u make tutorial TTS Ai from Vtuber Studio. so i can talk my Waifu 2D Models. looking fowards for new Video.

[@dersinier]

If you use whisper, you dont use the multimodal aspect of GPT 4o. It's not the real deal.

[@ai-for-devs]

Please check the comment and the discussion in the previous comment of arianaponytail

[@Shulyaka]

+1, the title is misleading. I've been clickbaited.

[@chadgtr34]

can we discuss the recent football match with the ai ?

[@ai-for-devs]

Please do it and send me a screenshot 😂

[@chadgtr34]

@@ai-for-devs i mean, does the ai watch football ? so we can discuss football news with the ai

[@edwardsu7497]

Amazing! Thanks for sharing!

[@texrwind]

Can i find free gpt4o key? I want test my code just one time. 20dollar expensive for this😅

[@Happy_Swede]

👍 men saknar Xai’s #Grok…

[@Powdermonkey99]

$2.8 Billion in 2023 🤯🤯

[@ai-for-devs]

And this will triple this year

[@soulless8471]

U ROCK!

[@darkman237]

I'm guessing you have to be a paying customer?

[@ai-for-devs]

Correct

[@build.aiagents]

Phenomenal

[@fabriziocasula]

thank you very good

[@peterpui7219]

Any AI boyfriend?

[@ai-for-devs]

AI boyfriends? Absolutely! Just like AI girlfriends, you can create an AI boyfriend with the same tech. He’ll be attentive, always remember anniversaries, and never complain about watching romantic comedies.