Kokoro Local TTS + Custom Voices

[@andherium]

hmm Tiny TTs is definitely an interesting name

[@dinoscheidt]

Took a bit… 🧿🧿

[@mageshyt2550]

love to see video on conversation with local agents

[@khangvutien2538]

Thanks. You have given me another reason to buy a Mac mini M4 😉

[@MeinDeutschkurs]

Sky is back! Wooohooo!!! ❤❤❤❤

[@djstraylight]

Were there any instuctions on how to train voicepacks?

[@samwitteveenai]

No I don’t think they have made any

[@MojaveHigh]

Very helpful, thanks! Any chance you could take a look at RealtimeSTT? And maybe put that and Koroko into a single local conversational AI agent?

[@pin65371]

This would be good for people that want to run something like Alexa locally at home. I know some people have been putting together systems for home assistant. While maybe the OpenAI integration might sound slightly better I'd consider this more than good enough to replace that and not have to send your data to OpenAI.

[@samwitteveenai]

Yeah that is how I feel too. It’s not the best but it is damn good .

[@lovol2]

Thanks for making this video.

[@altmediamedia9654]

Sam, I can't access the shortened URL links. I can't name this website shortener in my comment but you know which one you are using. it either timesout or is unreachable. Anyone else bothered with this issue?

[@MeinDeutschkurs]

What I‘d use it for? Voice Chat, based on aya-expanse.

[@helloworld7796]

Is it possible to train own model for some language other than US from scratch?

[@samwitteveenai]

Yes or you could fine tune this to another language, but you would need some training code as well which currently isn’t in the repo

[@MeinDeutschkurs]

Is it possible to fade from one voice to another voice? Could help to find great voices. (With values in terminal)

[@samwitteveenai]

Good question unfortunately it’s not really possible to fade between them because you need to put the full embedding in at the generation time and you can only put one in.

[@MeinDeutschkurs]

@@samwitteveenai , ok, so I should iterate word by word from 0.0 to 1.0 for both of the values. 😆 Why not? At least the same sentence multiple times to compare it.

[@figs3284]

Transformers js version coming soon from Xenova 👀

[@moundercesar3102]

Very interesting, can we use it as a pdf reader where it reads in real time and not after processing the whole text ?

[@samwitteveenai]

You would probably process a sentence or a line at a time(maybe even a paragraph to help it with prosody), but should be possible

[@VanillaGun]

Is there a defined context length it can parse and process at a time? I want to test it out for large text sources.

[@finbenton]

Idk but I just generated 25min long audio file but it took 5-10mins to generate.

[@Quantum_Nebula]

Interesting -- definitely is fast for the quality

[@SyamsQbattar]

Do you know how to add a new language, like Indonesian?

[@samwitteveenai]

To get a good result you would probably need to mix some real Bahasa audio into the train mix. Or fine tune it later. Might be able to do something with with a phoneme dictionary but really need some example audio

[@SyamsQbattar]

@@samwitteveenai Is there a step-by-step tutorial on this?

[@miklosprisznyak9102]

Yes, adding a new language is what I would be also interested in... Please enlighten us if you have any clue. 😊

[@Notifest]

I would appreciate a fine tuning tutorial for a custom voice in any language

[@concretec0w]

Is it better than piper-ttts? piper is sooooo fast and decent