CONTROL your Personal AI Assistant with GPT-4o mini & ElevenLabs (AI TTS & STT)

[@WeeklyTubeShow2]

That first one may as well have called you senpai. 😂

[@jorgeconsulting]

Your content is top notch man. It’s really easy to digest.

[@lakergreat1]

the #1 video I look forward to each week, sent you an email as well

[@ew3995]

would it be possible to further reduce latencies by streaming transcription and streaming response

[@jorgeconsulting]

That’s what I was thinking too

[@brianmorin5547]

Same thing I’ve been playing with these week. I want to carve out some time to take chunks from the streaming to create a loop of sending and receiving from the TTS API for super low latency I think the biggest problem is maintaining continuity of the voice so perhaps render the first sentence locally and while it plays assemble the next audio file or two server-side then send back?????

[@thetagang6854]

Amazing, so much value in a PA. Can't wait for speech-to-speech models to come to the market, super natural convos.

[@ronisaroniemi8501]

Amazing content - keep up this combo of practical + high level videos 💪

[@christyson4245]

As we say in the UK - this is the dogs bollox! Fantastic work as always Dan.

[@6lack5ushi]

you can get faster calls using Groq new LARGE whisper, and Llama 3.1 70bn if you stream the audio ASAP and have tiny chunk sizes you can down to sub 1 second responses

[@zipaJopa]

Do you have any repos on hand that showcases this setup? Many thanks!

[@6lack5ushi]

@@zipaJopa I can dig one up and put it on git gimme a few hours, I have an iOS version but it’s faffy. Will reduce it to python and write a simple readme

[@6lack5ushi]

​@@zipaJopa Just rewrote the script will post it to GIT in a few mins and share the link here. (y) might make a video on it actually... Thanks for asking

[@zipaJopa]

@@6lack5ushi my hero! 💕

[@pajarobobo4467]

@@6lack5ushiwheres the link?

[@ytubeanon]

that's neat, I've been trying to get TTS to work for open-interpreter which I use a lot with gpt-4o-mini

[@TimothyJoh]

This was so great. I left you a PR on the repo, waiting for your feedback. Would love to demo it for you.

[@yuniorgonzalez4638]

Amazing job !!!

[@ModernCentrist]

What would be the main difference between the custom voice assistant and the OpenAI voice mode?

[@seventhapex]

do you know what the word "own" means?

[@YorkyPoo_UAV]

Is there a way to run this on your mobile device and have it in a call/open conversation function?

[@andrewandreas5795]

Does anybody know a STT model that could be run locally for live transcript?

[@ariramkilowan8051]

Love the content but I think it would be helpful to at least mention relative costs. You've said in the past that the API costs are worth the investment. You are likely correct but probably still worth mentioning. Thanks again for the content.

[@mrd6869]

The top area for this will be Cybersecurity hands down. In years time there will be entire cyberwars being waged and run by AI systems.

[@Mosen_xd]

perfect

[@EternalKernel]

Eleven labs pricing structure is prohibitive. Very prohibitive.

[@BaldyMacbeard]

"Personal AI is TOO valuable to leave in the hands of Big Tech"... proceeds to build his AI assistant with APIs hosted by "big tech". Kinda expected to see whisper, llama, mycroft or sth.

[@littledovecitydust]

this is just a voiceflow type chatbot, it's not your own assistant.

[@orthodox_gentleman]

Good point. I don’t really understand the point of this.

[@itskittyme]

cringe lol