My Top 5 Open Source Text to Speech Softwares Starting off in 2024

[@RobertJene]

⌚ Timestamps 0:00 - introduction 0:14 - Suno Bark 1:22 - Valle-X 3:00 - StyleTTS2 4:07 - CoquiTTS - XTTS 5:40 - Tortoise TTS

[@ahmetab06]

which is the best tts ?

[@kanavwastaken]

​@@ahmetab06Tortoise

[@RobertJene]

@@ahmetab06 watch the video

[@lemonline3719]

@@ahmetab06 Tortoise

[@hemat_energi]

can it run well in m chip apple? is there specified can handle indonesia voice? thank you

[@vikramr60]

Coqui TTS is not open source, means it can't be used for commercial purposes,only for research and educational

[@motionmix2523]

It says commercial use now.

[@lukasnesvarbu1485]

@@motionmix2523 i think its because it died

[@maikelm20]

Coqui XTTS is. Not for commercial use. It does have others models which are open source

[@willmedrano98]

Not sure if CoquiTTS is open source or not, but open source does not mean that you can use for commercial purposes.

[@DihelsonMendonca]

There are two different categories, tts-1 which is free and hd voices, which are not for commercial use.

[@chaks2432]

I built a GUI for XTTS using flask and svelte and finally got rvc running yesterday. Got inspired by your audiobok_maker, but it was missing some features I figured could be pretty useful (Like allowing users to edit text inside the GUI, add/delete/reorder lines), I'm pretty happy with the result, even if the UI looks like crap and it's still a little buggy. I also got everything to run together, so I don't need the ai-voice-cloning webUI running for it to work

[@Jarods_Journey]

Awesome! Usually it's best to get things working first, then you can make it look pretty. Glad to hear!

[@Hellosirrrr]

You’re my new idol! What’s your GitHub?

[@TheMegadeth350]

Hey. I am working at similar project by myself and I have a couple questions. Could you please give me some contact to yourself??

[@dontrez8412]

Pretty good results. I didn't think that first Bark voice bad, though. Thanks for the comparisons.

[@jonathandawson3091]

Hi can you please make a tutorial of the Audiobook Maker, or how to create such pipelines? In particular you mentioned something along the lines of "RVCS" which seemed to make a dramatic difference in the last voice that you demonstrated! How is it done?

[@Mowgi]

Tortoise wins out, but I'm very interested in seeing more from Eleven's. From these examples, Coqui definitely seems to get the closest to your voice out the box, but the actual quality of the audio sounds very low. Is there a way to set the bitrate?

[@PROJECTSSourceEngineLessons]

if we talk about XTTS, the initial quality is 22 hz, but there is a resample function at 44 hz, of course, artifacts may appear

[@blender_wiki]

not about bit rate, you get the file in WAV, the issues is that XTTS model is working with a temporal resolution of 22.05Khz so you must have a very good recording and EQ your voice sample taking this into consideration. If you have certain harmonics that are "flanging" . The voice at the beginning of the video is generated with XTTS: kzbin.info8YyHxD42k-A Still not perfect but better than the example shown here just because the sample provided to the model is recorded ans prepared in a better way. We are trying to train a fresh model with 44.1Khz data set

[@Jarods_Journey]

I think the commenters gotcha answered here, but not to my knowledge. That's why running through RVC is kinda an "audio upscaler" as i am using the 48k models in RVC.

[@nielsieboy19]

From what I've seen StyleTTS does a much better job of cloning a voice, it's also an order of magnitude faster than Tortoise. Only thing holding it back are the absolutely mental VRAM requirements for training and multilingual models (which are being worked on by the community).

[@Jarods_Journey]

The samples I've heard have been pretty awesome and I agree on the speed as well

[@Superchunk-k2h]

Is there any tool that doesn't require downloading a 70gb model

[@Lenox-bp3lu]

Which one of these did you use for the accent conversion at the start of this video? Please and thank you

[@poco7193]

With tortoise TTS I have been issues with training it. I will upload my audio for training and go through the first two steps smoothly, when I actually try to run the training it freezes with some text then just never unfreezes no matter how long I wait. Also I was wanting to know what the 2nd software you were using in this video to make the tortoise tts sound smoother. I am trying to make a podcast for a school project and desperately need a smooth tts for some of my characters

[@tylerchambliss8379]

Hey Jarrod. It's me Tyler again, and I'm still having issues training models on my machine with Tortoise. I've set the batch size and gradient accumulation as low as I can and it's still not training. It just gets to the loading auto regressive model and doesn't go any further. Might some of these other TTS models be easier for me to use instead? I'm just about ready to give up on Tortoise because it's been almost 2 months and I still can't figure it out.

[@Jarods_Journey]

I see your post on GitHub, I'll have to get back to you on this tomorrow!

[@robertbutcher222]

Sorry if this is a bad question for this sort of this video, but is there a way to use one of these in Linux Mint or Ubuntu to read selected text? I like to have selectable text read to me when I highlight text with the mouse cursor. There is a script I could make, if I find the instructions again, but the voice is very robotic. So, I was wondering if one of these could somehow be used, preferably offline.

[@spiritual_audiobooks]

A Open Source local, fast neural text to speech system that sounds great is Piper TTS.

[@Raghav_Kapoor_]

3:21 , how to use this voice ?

[@stefanomonziocompagnoni8302]

hi Jarods! Nice video! I'm looking for software (better if open source) that changes a recorded audio voice. I mean, If I record my voice, I would like to use a different voice, keeping my prosody, tone, speed, etc....just changing the timbre. Any advice?

[@moqingyu730]

Hi, excellent work, have you found out which one is the fastest one?

[@ferysery]

hi . where can i get my hands on ur AUDIOBOOK MAKER windows desktop app?

[@braivco]

Hey Jarod, would you consider building an XTTS > RVC pipeline app similar to what you've built with Tortoise?

[@svenbjorn9700]

Where can we get the Audiobook Maker app? It’s not linked in the description.

[@ferysery]

huggingface

[@timeship]

Tanks for everything. BTW, what was that A.I. Audiobook Maker you showed in the video? I can't seem to find it anywhere ;-) THX

[@Jarods_Journey]

Search up AI audiobook maker on KZbin, it should be on the search results :)!

[@timeship]

@@Jarods_Journey, I tried, but it lists millions of A.I. voice makers, and not the software on your screen. Which company made it? Give me some clue ;-) THX

[@Edward_ZS]

What option runs the fastest And do any of these work without a GPU

[@Jarods_Journey]

In this example, style TTS is the fastest. They do work with CPU, it's just much too slow to utilize ATM.

[@Seeker_Now]

Hey man, thanks for your amazing work. I can't find any info on this-Is there a way I can integrate these trained AI voices with Balabolka? Hope you can answer this.

[@DavidSegura99]

Thanks so which is the best open source for Spanish tts or voice cloning?

[@Jarods_Journey]

Xtts is your best bet. Just has some licensing things you'd need to look at

[@johnyoung4409]

Hi Jarods, Did you fine tune the tortoise tts when generating the example of your voice used in this video?

[@Jarods_Journey]

Yup!

[@beetlejuss]

I am just starting to learn about TTS, but it seems you can run an app with different models, for example coquiTTS with bark model or tortoise model etc. But it seems from your video you are comparing models not software. Or maybe I am confused. Also can you please make a video about the best options for CPU, I don't have a GPU.

[@0chiel]

Dumb questions(novice): -Are these free to use commercially? -Can a standard m1/m2 level mac run them locally Thank you

[@psalmy26]

Find their repos and look at their licenses. Anything with a MIT license is, other things get a bit more nuanced.

[@Jarods_Journey]

I'm not a lawyer, but the ones with MIT licensing are Tortoise TTS, bark, and valle-x. Xtts has a non commercial licence for their free stuff and styletts has a unique one where I think you have to have a disclaimer about it... That is unless you train up your own base models.

[@idkman8520]

Hi! I love your videos!! Quick question! I made a chatbot... how do i use these voices??

[@sigma_z]

You integrate it in.

[@me-cm8or]

Does all of these or one of these have like a local API that allows you to link them up with other local apps throw API calls?

[@Jarods_Journey]

Any graido interface you should be able to... But the only one I know for sure is tortoise TTS with the AI voice cloning repo

[@Disastorm]

If anyone wants to hear more examples of StyleTTS2, the AI character in my most recent video ( Mirai: Ai Plays Streets Of Rage ) uses it to talk ( pretrained checkpoint, no finetuning, using zero-shot cloning of a fake voice, goal isn't to clone an existing voice but make a good sounding ai. To be clear it still ends up pretty monotone though, but realtime performance is near instant. ).

[@trush1090]

Hi Jarod can you make a video on how to resume training? Say I finished training at 50 epochs. How would I add 50 more without resetting. Also how to eliminate static sounds from generated sounds. I trained 2 hours on 60 epochs just for it to have a static sound.

[@sujetodelta1019]

i have a question, if i plan to use any tts for voicecalls and use it with virtual cable any of these can help instead of download the audio files?

[@RobertJene]

6:15 - what do you mean, pipeline from Tortoise TTS to RVC? Like you train a model in Tortoise and then use it in RVC or something?

[@Jarods_Journey]

This video I think: kzbin.info/www/bejne/g5TOhWqwbLySp68 But yeah, run tortoise audio into RVC to make it sound better

[@orpit48]

I'm searching for a software to train my own voice models and use it tts, is there an option you could recommend?

[@Ulibert]

hey can you tell us where to get SAPI5 file of text to speech tagalog accent?

[@marcusunivers]

Is there also some open source text to sing vocal generator. 🤔 Something like Vocaloid, Utau, SynthV or ACEStudio where you can also add Midi information to your vocal to pitch it? ☺

[@ea02ca6f]

Why not order the links in the description in the same order they are mentioned in the video with missing links added?

[@khajask8113]

Which one is best for clone my own voice..?

[@k9clubme]

Thank you very much for sharing your knowledge with us. Is there a way that we can modify a lyric of a song and then make it sound as if the artist is singing the revised lyric?

[@ruudygh]

What is that Audiobook? how does it magically makes a bad audio to become a good audio?

[@hassanawan3622]

How can I deploy a Tortoise TTS trained model on the Flask web App ?

[@blackswan6386]

pro why skip the installation part, how i can get this run ? it says i need python ? would be cool if you can some help

[@sergialbert97]

Jarods just for my benefit, when you apply RVC to some of these. First you do a voice cloning with for example XTTS, and then apply RVC or directly u use one default voice that has a similar tone and apply the RVC. Or maybe ir better apply finetuning and then RVC. Thanks for your videos mate!

[@Jarods_Journey]

The workflow is: train a finetuned model in xtts and then train a finetuned in RVC. You then use the audio from xtts and run it through the RVC trained voice model.

[@justindaniels5923]

@@Jarods_Journey Do you have a guide/tutorial for setting this up? Just starting diving deeper into this stuff, but I've been loving your content. Thanks man!

[@Morpheus.999]

i can't find the audio sample at 3:21 , how could download this?

[@dthSinthoras]

Which ones can handly german well? Tortoise was failing very hard when leaving englisch...

[@Jarods_Journey]

I think xtts is the only multilingual one. Bark is as well, but it's quality is not there

[@dthSinthoras]

Thank you!

[@aruncanra2084]

Hey @Jarods_Journey How can I train Tortoise-tts in other languages? Or is there any alternative to get multilingual tts with emotions? I'm currently trying to translate and clone the voice of a podcast that has many voice modulations and emotions. My current flow: Audio in language A -> transcribe -> Translate (Language B)-> TTS (with emotions) -> RVC Any help is appreciated!

[@aruncanra2084]

Looked into Tortoise-tts threads seems I need 10k hrs of dataset.

[@Jarods_Journey]

Some people have had success with just fine-tuning it with an appropriate tokenizer for the language. Look up nano nomad on KZbin!

[@aruncanra2084]

@@Jarods_Journey Thank you man👍🏻

[@dohyunio]

Could you include your mic in your hardware list? Great vid!

[@Because_Reasons]

What does RVC after do? Do you have a tutorial?

[@opaleyeakintunde4827]

How can i finetune or Configure , my Tortoise TTS to clone good just like yours ? Thank you

[@Vt-gm3pz]

this is works only on nvidia gpus ?

[@rohanrjoshiimakemyvid7285]

Can you suggest some totally free APIs that I can integrate on my website. I am looking for "videos" related API. It will be great help

[@johnlenoob6951]

Hi Sir, thanks for all of your original and well done content !!! May you give some tips and tricks to become an organized guru dev as you. I m a lame at managing my python env and all ai project ;) Tried env, conda/miniconda ...

[@davidhazout6009]

Very smart !! do you have a French voice for me ?

[@king-zu3ih]

can you suggest any ptocject can make an audio when people sing or rap a song. thank you

[@KJ7JHN]

many of these voices are fantastic!

[@djwhispers3157]

is there a platform for generating sound efx?

[@blender_wiki]

a short comment just to wish happy new year and improve your YT engagement score. I think you must check your recording workflow and final quality sample because all your voices sound too robotic compared to to what i am used with this tools. Maybe you record with the mouth to close to the microphone and the low frequency of you voices are too present and this models dont like a too much low frequencies, maybe is just enough doing an EQ with -3db under 80Hz

[@Jarods_Journey]

Happy New years too! It's funny you mention that because the dataset on my voice is a pretty crappy one. I just grabbed it from a KZbin video and the eq I do on my KZbin videos are generally bass enhancing 😅. Id say models trained on my voice are not as good as others that I've done with other voices

[@SyamsQbattar]

Does those LOCALs AI Voices support Indonesian language?

[@christophermoreira6198]

What about PiperTTS?

[@mohsenghafari7652]

hi coquiAI library support Persian language ? thanks

[@ElmorenohWTF]

Please make a tutorial on how to train using Google colab to the AI that you think gives the best multilanguage result

[@TerrennonPriv]

By the way, thanks you Jarod, update on my side, for my lore my language project. xtts was the way to go and I'm happy with the results.

[@Jarods_Journey]

Glad to hear it :)!

[@ALAN-lv1zj]

Are all this free for commercial use

[@luigivitofrancesco6221]

Which is the fastest to install? like wokada, so just one click to install everything

[@Jarods_Journey]

Probably tortoise TTS as I have an installable package for that one on KZbin

[@lismoiunehistoire]

are these free for commercial use?

[@FatheredPuma81]

If Tortoise is the number 1 then I think AI TTS isn't worth using right now. I just don't have the time to manually transcribe dozens of lines for training and manually regenerate each line a dozen times until it gets it right.

[@AntiAnti]

Is there any ready-to-use via local http server? I mean, I want to send json http requests from another app and receive audio data. I know it should be very easy to do, but python isn' t my thing.

[@Jarods_Journey]

You can use the gradio interfaces for this. Tortoise launched on localhost:7860 and so you can interact with it using the Gradio API which you'd find at the bottom of the Gradio page.

[@AntiAnti]

@@Jarods_Journey Found it. Thanks.

[@Nightcortex]

How can I get pre trained models?

[@makiroll6815]

Which one would you use for Vivy for speed?

[@Jarods_Journey]

Tortoise TTS. It's still my go-to and can process voices fast enough with deepspeed+hifigan

[@makiroll6815]

@@Jarods_Journey cool thanks

[@zonas7915]

A video on how to train a model would be great, like the best settings etc

[@Jarods_Journey]

You might wanna check out my tortoise playlists for tortoise TTS!

[@HOWDO7]

Is there any software or TTS tool that has caribbean accents?

[@Bigjuergo]

Can you explained Nr 5 in more Detai please? How does the audiobookmaker work?

[@Jarods_Journey]

Probably wanna check out this video! kzbin.info/www/bejne/rpPLloefZr6dpK8

[@EmpowerMuse]

Have you tried GPT SoVITS tts?

[@Jarods_Journey]

Still trying it out, but the audio isn't too bad. It's not completely finished and the process is difficult to follow as there are areas I'm running into difficulties with, so I'm still waiting a bit on it.

[@nufh]

How about emotion, like laughing, giggling, mad etc.?

[@Jarods_Journey]

The only one that I've seen that's done this has been bark... But nothing new I'm afraid

[@nufh]

@@Jarods_Journey That is what I want the most actually. Having the expression will make it more alive.

[@everybodyguitar5271]

Bark is really slow when doing training in Mac.

[@Lenox-bp3lu]

Nevermind my last comment, you answered it at the end of the video

[@breakmillions2347]

not gonna show how to run it locally?

[@RobertJene]

you forgot to put the link for Tortoise TTS in the descriptables

[@Jarods_Journey]

Oops 🤫😅

[@aruncanra2084]

What are the languages supported by tottoise TTS?

[@poly06033]

only english

[@aruncanra2084]

@@poly06033 Are there any other TTS that support Hindi or Urdu and as good as Tortoise?

[@nielsieboy19]

You can train your own language, I have a dutch model on hugginface for example

[@danzai]

Nice, but i'm not interested in cloning.. just a realistic voice. Would be nice if you made a tutorial on how people can just set these up

[@keithmorse9716]

It seems like you have this targeted for probably a broader audience than I am. attached to. because I'm dyslexic, so I'm trying to find something to help me keep interested in material while having. difficulties being able to consistently read materials.

[@Powerlevelover9000]

Does anyone here know a good database for tts voice models ? RVC has lot of voice models available but I can't seen to find a good database be it a website , discord etc for tortoise tts.

[@Jarods_Journey]

Tortoise TTS, not too widely adopted unfortunately. Haven't seen anything pop up

[@davidtindell950]

NEW SUBSCIBER ! Arigato 😮

[@billyindrajaya]

Hi jarod .. for your subscribers why you didnt give us link google colabs?

[@Jarods_Journey]

Any of the repos that have collabs will be on their githubs

[@trilogen]

I don't like how the word Open Source is used loosely. Open Source means it can be used for commercial purposes and none of these give you that type of license.

[@phil5583]

Tortoise sounds so good! I really hope there will be a multilingual model for it in the future.

[@Jarods_Journey]

Xtts is multilingual! Using it with RVC you could get similar results I believe

[@ahmetttt10]

can u try@@Jarods_Journey

[@subured]

Does it supports Tamil language?@@Jarods_Journey

[@SosyalMedyaArge-so5bs]

Thanks buddy!

[@lukerbs]

Nice job! Thanks for the vid

[@CooloSolo]

No 1 suno is awesome

[@ArlGeales]

Thank you!

[@gabrielv.4358]

Very good recommendations, but they need to be installed, which I dont like... And you probably need a $1000 GPU also.

[@enriquemontero74]

I also need to add open voice here

[@RobertJene]

intro be like "why are you bri-ish"

[@wagnerfreitas3261]

thanks bro

[@mikeg9b]

It's 2024 and I still use espeak.

[@yusufcan1304]

thanks man

[@YannMetalhead]

Good video!

[@THEKL7773]

they all feel like lazy code people trought out there, none of them even have a proper Ui or can even be considerd a proper program. You have to literallty do all the work rather than just getting something you can just trough text and have it work, imagine actually working on a full book with this itd be a nightmare. Why are you all just cool with this level of shit.

[@qodeninja]

Do you have videos on setting this up? oh yes look at that you do

[@videozontherapy1440]

What is the current top live ai voice changer?

[@noonesbiznass5389]

It's too bad Bark doesn't seem to be maintained or improved in the last year or so. It's the only one that has any form of truly convincing inflections, granted at a very poor quality and lots of hallucinating.