Yeah would be interesting to see if it can be used with other software as well
@font_net3 күн бұрын
Hello, I want to make a text-to-sound conversion model for Farsi, which videos should I watch now, where can I contact you?
@font_net3 күн бұрын
Oh, I found your LinkedIn
@alx84393 күн бұрын
What is the device with microphone, button and led round light is on your table? Can you please give some more details?
@DichtMe3 күн бұрын
That is what the video is about. Watch his previous videos.
@alx8439Күн бұрын
@DichtMe thanks a lot. Will do
@alx84393 күн бұрын
New nvidia minicomputer (jetson if I'm not mistaken) which was released just recently is a good replacement for regular bulky PC with full sized GPU card.
@ianicius5 күн бұрын
Can I use it for German?
@ThorstenMueller2 күн бұрын
Hello, IMHO currently not. But you can use my german Thorsten-Voice in Piper or Coqui 😉 (thorsten-voice.de/).
@rabeemohammed53517 күн бұрын
what is language suport and can help me for give me inforation about modle support language arabic
@MuhammadShahid-bl5hh7 күн бұрын
@ThorstenMueller I am facing this error please help me: PS C:\Users\Apple Compter\tts> pip install TTS--0.22.0 Defaulting to user installation because normal site-packages is not writeable ERROR: Could not find a version that satisfies the requirement TTS--0.22.0 (from versions: none) ERROR: No matching distribution found for TTS--0.22.0
@MuhammadShahid-bl5hh7 күн бұрын
@Thorsten-Voice I am installing latest TTS but it not work for me please help...
@ThorstenMueller2 күн бұрын
Good question. Do you run it with admin privileges? Is free diskspace available? Just thinking because of this message "installation because normal site-packages is not writeable".
@herofahimshahriargaming82887 күн бұрын
is there any way to run this in python code?
@ThorstenMueller2 күн бұрын
That's an interesting question, i thougth about too. But last tine i looked at it, it was just an early codebase on python integration. According to this (github.com/rhasspy/piper/tree/master/src/python_run) there's no recent updates on that.
@jez99999 күн бұрын
Coqui appears to have folded now. Confusingly there is a community run fork that is sorted but its docs look very similar to the original.
@ThorstenMueller2 күн бұрын
Coqui already shut down by beginning of 2024 and imho the code in the original repo is not maintained any more. I heart about a fork too but didn't have time to give it a try.
@mrechbreger21 сағат бұрын
@@ThorstenMueller the license is garbage and prevents any further interest... why should anyone keep developing it if he cannot use it for further commercial projects...
@font_net11 күн бұрын
دوستت دارم
@adamrastrand940913 күн бұрын
Hello Torsten I have heard that some languages in Piper TTS sound pretty bad for example the Swedish model like that when you train a new voice like when you find tune from the existing checkpoint mall that exists it sounds quite bad and such is that true because the default Swedish NST voice sounds very monotone but when you find tune from that will it sound like me or will it sound different just with the pronunciation errors and when you find two from scratch How many hours of speech do you need I have an RTX 40 6016 GB card so is that good for AI training and the thing is also that do I need to set up Linux and Windows at the same time and fiddle around with complicated stuff because it’s just easier to have a Windows set up And not worry about Windows for Linux so can I just do it with a command
@ThorstenMueller2 күн бұрын
Hello, i only trained my german "Thorsten-Voice" tts piper voice. So i have no experience on other languages, their quality and need for training material. I used multiple hours (around 10 for finetuning my piper model), but i additionally played around with just 1000 phrases and these worked too. It's a little bit of a try'n error.
@mariuszandrzejewski65514 күн бұрын
This is exactly what I was looking for. Unfortunately, after I installed "tts" using "pip install tts --use-deprecated=legacy-resolver" and resolved some dependency issues, I encountered a "Bus error." Installing "tts" without additional flags causes it to take a long time because pip tries to resolve all required package versions. I tried everything, even attempting to install it with "pip install tts --no-deps" to install only the "tts" package. However, after running "tts --list_models," I still get a "Bus error." The version I have installed is 0.22.0. I am trying to install it in a Python virtual environment, of course.
@ThorstenMueller2 күн бұрын
Which python version are you using? As Coqui TTS isn't actively maintained this might be a problem with too new python versions.
@mariuszandrzejewski6552 күн бұрын
@@ThorstenMueller Thank you for your response. I’m using python version 3.9.2. Later, I’ll try changing the python version and also run tts from a Docker container, which I haven’t tried yet, but I’ll get back to that later. I managed to find free audiobooks for the books I’m interested in. Once again, thank you for your response, and greetings from a viewer in central Poland. P. S.: Wait a minute, aren’t you the guy from AutoIT? I used to work with it years ago, and I recall seeing your name in the libraries.
@EdTimTVLive17 күн бұрын
It is a nice and useful video. Thank you. I am looking at various options right now.
@ThorstenMueller16 күн бұрын
Thanks for your nice comment 😊.
@jimmyjam7717 күн бұрын
The voice quality is OK, but not great. Did you ever figure out a way to make it better?
@ThorstenMueller16 күн бұрын
No in xtts, but (just in case you're looking for an english solution) do you know my f5 tutorial? kzbin.info/www/bejne/d4SpoIeEpdCAbtEsi=gyYl6R8W1xuKoZZM
@rvanner18 күн бұрын
What's the best TTS for use in an Apple and Android app locally (ie no server connecting)?
@ThorstenMueller2 күн бұрын
That's a good question. Honestly i have not taken a closer look to tts on smartphones so i can't tell you (yet).
@CarlinComm20 күн бұрын
Wow, that's great, thanks for showing this! Subscribed :)
@ThorstenMueller16 күн бұрын
Thanks for your nice feedback and welcome 😊.
@charlenechen250720 күн бұрын
Hello Thorsten, can you have a check and review of PopPop AI text to speech?
@ThorstenMueller16 күн бұрын
Thanks for your topic suggestion 😊. I've added it to my todo list.
@TimothyBakerhistorygym21 күн бұрын
tried getting this to work on my own, couldn't came here, watched this twice and it's up and running. Thank you @ThorstenMueller
@ThorstenMueller20 күн бұрын
Thanks for your nice feedback, happy you got it working 😊.
@funcSAGE22 күн бұрын
can piper switch between voices? previously i have used mimic3 server and requested texts with different specific voices, can piper do the same or is it limited to the voice you start server with? Nevermind, i've found where i can make a few adjustments to the script to pass in a speaker together with a text.
@ThorstenMueller20 күн бұрын
AFIK is ssml (which you are looking for) not yet supported in piper. Mimic3 was able to do it. As the developer (Mike) is the same for both projects i am optimistic that ssml will come to piper somewhere in the future.
@maraka010024 күн бұрын
okay sehr schön. Im Piper adon funktioniert es. In einer Automation sagt eine weibliche Stimme: set public URL in configuration. Muss da noch was rein geschrieben werden in der Config.yaml?
@ThorstenMueller20 күн бұрын
Ich bin gerade nicht sicher, ob man Piper TTS Stimmen in Automatisierungen verwenden kann. Gute Frage, aber müsste ich selber erstmal testen.
@BlackOtaku_Edits25 күн бұрын
As a Ghanaian i'm happy to hear TTS in Twi and Ewe and Hausa
@ThorstenMueller24 күн бұрын
More effort for underrepresented languages is really important to provide open voice technology for everybody. Happy you found a matching tts voice 😊.
@mercuryin125 күн бұрын
I tried this morning and the cloned voices are the best I have never used. I wonder if I can use the cloned voices in some way with Home Assistant through I don´t know know..piper might be ? I can´t find if this is possible to do with this software, it is only tts ? is possible to synthesise a dataset with this ? Thanks
@ThorstenMueller20 күн бұрын
AFIK you can use piper tts voices in Home Assistant. But for this you have to record way more audio data to train/finetune a piper tts model. Do you know my video about piper tts voice cloning? kzbin.info/www/bejne/mJDalpKgosZlaJI
@beneadie320225 күн бұрын
that's really really good quality for open source
@ThorstenMueller25 күн бұрын
Absolutely 👍🏻😎
@yahyajohnlorenzen471326 күн бұрын
I like the shirt
@ThorstenMueller25 күн бұрын
Thank you, i like these type of shirts 😎.
@MuhammadShahid-bl5hh7 күн бұрын
@@ThorstenMueller I am facing this error please help me: PS C:\Users\Apple Compter\tts> pip install TTS--0.22.0 Defaulting to user installation because normal site-packages is not writeable ERROR: Could not find a version that satisfies the requirement TTS--0.22.0 (from versions: none) ERROR: No matching distribution found for TTS--0.22.0
@Queztapotel12328 күн бұрын
Bär-er nicht Bier-er-Token. just fyi
@ThorstenMueller27 күн бұрын
Thank you 😊. I try to keep it in mind for upcoming videos.
@kardiokode-g8v28 күн бұрын
hey @ThorstenMueller, great work as always! one thing that caught my eye: you mention that the code is released under MIT licence, which is right. But i think its also important to note that usually inference code and models have different licences (which you covered on other videos!). Here the model itself has a different licence: at 3:13 you can see it on top middle and in the text under it, that the model files are CC-BY-NC-4.0 licenced, which means no commercial use. This means you can not use generated voices for anything commercial like voice overs for youtube channels or in companies. It would be great to have this information as well in your videos, since people using this in any commercial environment or a simple monetized youtube channel can bring you in trouble if the owner enforces the licence. It would be great if you could make a video with an overview of fully open and free TTS/cloning models, that allow also commercial use.. i havent seen such a list anywhere and im sure lots of people would be interested.
@ThorstenMueller27 күн бұрын
Thanks for the clarification 😊. I've seen another comment asking for usage as voiceover - did you reply to this? I added your hint to the video description and linked you - hope it's okay for you. I added your video topic suggestion to my list as i think it is a great idea 👍.
@SyamsQbattarАй бұрын
Is online Huggingface better than local?
@ThorstenMuellerАй бұрын
The tts model is the same. It's just the question of your local available compute power. In my case huggingface has been more performant.
@smilingstranger100Ай бұрын
coqui tts is shutting down
@ThorstenMuellerАй бұрын
Yes, sadly 😞. They already shut down by beginning of the year 2024.
@mahmoedghazy1745Ай бұрын
first time to see the channel and the video. was talking about this app with a friend of mine who told me about it yesterday while we were in lunch break. Now i'm interested LOL . thanks for the guide
@ThorstenMuellerАй бұрын
Hehe, you're welcome 😊. "Sorry" for making you interested 😉.
@JubayerAhmed-f5iАй бұрын
can we use it for making KZbin videos and monetize it ? i mean is legal
@PatrickAngwinАй бұрын
I'm no expert, but from what I understand, no, because although the f5 model itself is open source and available to use commercially, the license for the dataset on which it was trained is restricted and does not allow commercial use. I would love someone to tell me I'm wrong about this as I was getting really excited about f5 until I found this out...
@ThorstenMueller28 күн бұрын
I can not give any legal advices. Here (huggingface.co/SWivid/F5-TTS) is written: "2024/10/14. We change the License of this ckpt repo to CC-BY-NC-4.0 following the used training set Emilia, which is an in-the-wild dataset. Sorry for any inconvenience this may cause. Our codebase remains under the MIT license." So i guess @PatrickAngwin seems right.
@vijisrangoliАй бұрын
OMG, you are life saver for me!! Awesome!!
@ThorstenMuellerАй бұрын
Wow, thanks for your kind feedback 😊.
@-bretАй бұрын
I tired this out on a rtx 3600 12gb model and it's fast. Quicker than speaking, maybe 2x faster to process than to listen to. Sounds really good to me.
@ThorstenMuellerАй бұрын
Thanks for your helpful comment and performance indicator on a 3600 👍🏻.
@-bretАй бұрын
@ThorstenMueller I should have said it's paired with a 2700 ryzen. It's a pretty cheap rig now, I think you could buy both parts used for about 300 pounds on eBay. 30 pound cpu and 270 for the gpu. Or wait a year and pick up a 3090 24gb for same price, currently sitting around 500. I did pick up a tesla 24gb I forget model number, from China for 245 which is good for really large llm. Thank you for showing me this, I have project I can purposely upgrade now.
@dtesta7 күн бұрын
Where can I buy a 3600? I've only have a 3060...
@-bret7 күн бұрын
@@dtesta I'm sorry, I meant rtx 3060 16gb version
@dtesta7 күн бұрын
@-bret Cool! Where can I find that 16GB version? I only have 12GB.
@Panda_explains-007Ай бұрын
can we run piper tts in gpu using cuda ?
@ThorstenMuellerАй бұрын
Not tried it myself. According to piper community there seems to be some active discussions on gpu/cuda support. github.com/rhasspy/piper/issues?q=is%3Aissue+cuda
@adityapatil6723Ай бұрын
This error originates from a subprocess, and is likely not a problem with pip. error: subprocess-exited-with-error im getting this error please help someone
@ThorstenMueller29 күн бұрын
Which python version are you using? Did you update "pip" first?
@adityapatil672328 күн бұрын
@@ThorstenMueller yes sir i did update it. and python is 3.11.9
@ThorstenMueller27 күн бұрын
@@adityapatil6723 I originally thought python 3.11 is not supported, but according their github readme 3.11 should work. But as coqui tts isn't under active development, maybe you should try python 3.10, if this is possible for you.
@christoph9620Ай бұрын
Hello Thorsten, thanks for your great channel. I came about these videos which shows how one can train F5 with different languages kzbin.info/www/bejne/i4CXpqaXhNSdr9U kzbin.info/www/bejne/iIK7eX6Faqtsnsk As you are experienced with training of speech models, I am wondering how much hours material would be required to train a German language model in good quality and what things should be considered in regards to training data. In the referenced youtube video the creator simply takes audiobooks. Can one expect to get a good quality model in this way?
@ThorstenMueller29 күн бұрын
Hello Christoph, thanks for your nice feedback on my channel 😊. Currently f5 tts can't be trained in german, but they are working on it. github.com/SWivid/F5-TTS/issues/87#issuecomment-2418043522 For my german "Thorsten-Voice" datasets i recorded over 30k audio files, but this should not be required now.
@ernieprevost6555Ай бұрын
Hi Thorsten, thank you for another excellent tutorial. I have installed f5 on a Raspberry Pi 5 and it generates very good quality output but to be expected it is very slow. I am trying to understand how f5 works, does it take a standard model and modify it in some way using the ref_text & audio before generating the desired output (gen_text)? Is there an intermediate stage that could be executed separately? Thanks Ernie
@ThorstenMueller29 күн бұрын
Thanks for your nice feedback 😊. As i can't answer your question you might want to ask this question on their github repo to get (useful) responses.
@jayeshkadam14Ай бұрын
How much time it took to train one model??? And how powerfull is your system?
@ThorstenMuellerАй бұрын
For my Thorsten-Voice piper models i used an nvidia jetson agx device and training 24/7 took around 2 month.
@jayeshkadam1416 күн бұрын
@@ThorstenMueller oh my god. thats 2 months. 2 months!!!!! wtf
@edu.33Ай бұрын
If anybody is encountering errors when installing TTS, try pip install coqui-tts (tts is deprecated as of november 2024)
@FP_95Ай бұрын
I went down this rabbithole myself last year. Alas! Have I watched this 6min video I would've saved lotsa disk space and time (weeks). Cheers! ✌
@ThorstenMuellerАй бұрын
Thank you for your nice feedback and welcome at the "rabbithole" 😄.
@stefankarglАй бұрын
Hi, Thorsten, the community thrives because of people like you - thanks for your work!
@ThorstenMuellerАй бұрын
Thank you for your very kind words 🥰
@ikarosound2504Ай бұрын
thanks! it is faesabel to do all of that trought scripted pyton code?
@ThorstenMuellerАй бұрын
Good point 👍🏻. I took a quick but did not see an obvious solution for native python integration.
@andtrixr3284Ай бұрын
the greetin comes from hessen in germany right? :D funny intro and exactly what i am searching for :) abo
@ThorstenMuellerАй бұрын
Ei sicher 😄. Greetings back from Hessen and thanks for joining my community 😊.
@RaminAssadollahiАй бұрын
What GPU do you have on your computer?
@ThorstenMuellerАй бұрын
An nvidia 1050 ti in this case.
@dtesta7 күн бұрын
@@ThorstenMueller You need RTX card for this kind of thing. Anything else would be dogshit :)
@dontmindbeingblinddАй бұрын
May I ask what gpu you are using, or if it is using a gpu?
@RaminAssadollahiАй бұрын
when you start gradio the fist time and the model is downloading, it shows that pytorch loading the models into CPU, i'll investigate on that
@RaminAssadollahiАй бұрын
correction: I'm running it on a 1080ti, it takes 16 sec for 4 sec of speech to synthesise. Don't know, whether it's always re-analysing the reference as well.
@RaminAssadollahiАй бұрын
okay, further investigation: i let the output text the same but uploaded a longer reference, it then also takes longer to synthesise. so, the whole time is comprising reference learning as well as synthesis. would be interesting to see how much time mere synthesis would take...
@ThorstenMuellerАй бұрын
If you use f5 on huggingface it will use a random gpu that is available in that momoment. If you use it locally without cuda (nvidia gpu) it will use cpu.
@hashtag_Ай бұрын
For anyone coming recently, the tts repo isn't maintained anymore according to an issue post on the github. It results in an error when running 'pip install tts'. This fork worked for me instead: 'pip install coqui-tts'
@ThorstenMuellerАй бұрын
Thanks for that fork hint 👍🏻. Maybe an issue with a (too new) python version.
@elexg6982Ай бұрын
is there a way to use this with nvidia gpu on windows to speed up performance?
@ThorstenMuellerАй бұрын
Didn't try it myself, but there's some discussion on CUDA (nvidia gpu) on their repository. Maybe you can find additional info there 😊. github.com/rhasspy/piper/issues?q=is%3Aissue+cuda
@mogbattlesappАй бұрын
can this be deployed and hosted on a server?
@ThorstenMuellerАй бұрын
Yes, absolutely 😊.
@SimpleTechAIАй бұрын
I tried it and it works but it did not sound like me. Nothing close to what you did. Not a fan at this time it really should have done better. Thanks for sharing you got my thumbs up...
@ThorstenMuellerАй бұрын
Thanks for your "thumb up" and sorry to hear it didn't work for you as expected.
@SimpleTechAIАй бұрын
@ThorstenMueller not your fault, you laid it out perfectly. Its probably the quality of my samples. Thanks again
@FrankGraffagninoАй бұрын
great stuff!
@ei23deАй бұрын
Haha the F5 joke😂. The progress is amazing, right? Still waiting for german support for F5... Anyway in english it is now already easy to create synthetic voice datasets for piper for example, just an idea😊
@ThorstenMuellerАй бұрын
H(ei) 👋, thanks for your nice comment 😊 and yes, progress is really impressive.