How to Clone Any Voice With AI | Tortoise-TTS Tutorial

[@engineerprompt]

If you liked the video, you should check out the video on how to create your own AI Avatars here: kzbin.info/www/bejne/jGPIl4mJjbifp8U

[@pacovazquez665]

where can i find help to install it on my anaconda pormpt window, its displaying errors

[@ROM_2OO3]

It is incredible. I saw some comments where they say that the accent is totally lost, but I tried it and the accent is the same!!!! I thank you very much for this, it is what I was looking for a long time. Its just perfect ❤

[@engineerprompt]

Thank you and glad you found it useful.

[@prakash.pathak]

I have seen this problem with many KZbinrs who say AI clones of their voice is not matching with their original voice. The output created above is "exactly" sounding like you. But you can't realize that because we hear our voice in a different way than how others hear it!

[@ChristianIce]

The timbre is ok, the inflections and the accents got totally lost. Last year, this technique would have been incredibly good. Today there are much better options. AI is evolving at the speed of light.

[@MyTobirama]

@@ChristianIce Can you link some of them?

[@engineerprompt]

Interesting point, that could actually be the case.

[@engineerprompt]

@Mutual induction Its absolutely free. Watch the video for number of audios :)

[@ProVideoScribe]

@@engineerprompt what if we want to render long paragraph? should we cut it into sentences and render it one by one, or is there any way to render all of it at once?

[@postwhateverwhenever]

Thank youuu~~ i'm gonna use this for my favorite video game characters 😎

[@MrTalhakamran2006]

Always love your videos...no nonsense ... straight to the topic

[@engineerprompt]

Thank you!

[@MyOtherworldlyLove]

Could you please make a video with fully detailed instructions on how to install Tortoise and get it working? Like, instructions for total beginners? 😅You skipped the part of the process between finding it on Github and adding a new voice, and that's the part that's the biggest mystery for me. I'd love to use voice cloning, but I've never used Python and basically all I know about it is the fact that it exists. So detailed step-by-step instructions for those of us who know nothing about coding would be very appreciated! 😅

[@2beornot2bable]

What a great tutorial. Thanks!

[@WhyHelloReader2Me2You-wc2br]

Can you download that model to run it locally on your machine? Is the resulting file a .pth?

[@Nabuuug]

It does sound EXACTLY like you, it's crazy. I guess it's the "hearing our own voice is weird" phenomenon that is at play here

[@engineerprompt]

that seems to be the case.

[@Spozinbro]

Not exactly, the replicated voice still has some missing accent.

[@robbieweld7928]

@@engineerprompt I disagree it sounds as if it gave you an american accent

[@user-op3yd5gi9p]

Good job! It sounds like you, I know we hear own voices differently from audio recordings We hear ourselves thru our own bodies/bones

[@usagiracha]

"ModuleNotFoundError: No module named 'einops'" any idea how to solve this?

[@DamienRourke]

Great walk-through, thanks! BTW, the HQ sample did sound like you. It lost a bit of your accent, but overall it did sound like you.

[@engineerprompt]

Some others have pointed out the same. I guess, I am not used to hearing myself like that :)

[@saifshaikh8828]

Hey brother, is it safe to install in my pc ? As my windows showing harmful and dangerous risk?

[@MrDaydreamer1584]

"It lost a bit of your accent, but overall it did sound like you." It lost all of the accent, not just 'a bit'.

[@hoovy1163]

here's a few issues that i have: it doesn't have the same exact voice, it's lower pitched and sounds more older? it also has british accent for some odd reason. and when i try to form long sentences it starts babbling and making weird robot and inhuman noises lol

[@Mox53]

is it possible to make this text to speech work in another language?

[@engineerprompt]

Not with Tortoise, I think coqui supports that.

[@georgezlei]

LOL. The generated voice really sounds like you. I thought it was yourself talking then I noticed you already clicked the button.

[@cybergigafactory]

Great video, thanks. Is there a limit in how much it can generate at once?

[@engineerprompt]

If you use it locally, then I think it will be limited by your RAM.

[@planetgamecommunity817]

no ...its limited by the price of GPU spexs..hheheh

[@JukeBoxDestroyer]

the voice sound just like your voice, minus the accent, sounds very good

[@mahmoud_ali_963]

thank you very much .. dose it work with language other than english ???

[@ajitkumar15]

Can we use this for other languages too or is it limited to English Language, thanks in advance.

[@adrianaagresta]

Same question I was about to ask

[@ozzy1987mr]

muchas gracias estaaba buscando algo asi... excelente material y contenido del canal.. apesar que no hablo ingles muy bien y el traductor es malo sus videos se entienden y son muy claros

[@engineerprompt]

Thank you, I am glad you found it helpful. Consider subscribing to the channel, have something big planned for Spanish audience in near future 😀

[@starcitycreations]

This tutorial is awesome! Thank you SO much!

[@DailyStoicisme]

Hey why do I always get a message "maximum stack size exceeded?"

[@xs6819]

Thanks for sharing this. Is there anyway to make it read 1,000 words at a time?

[@st.magnic8592]

can the segments be less or more than 10 seconds? or does it have to be exactly 10?

[@engineerprompt]

No, its can be much longer, I have tested it on upto 30seconds. Its based on the hardware you are using.

[@basictutorial88]

I love it bro, Thank's for sharing 👍

[@amejrarmohamed8524]

I'm asking before cloning my voice, is it possible to upload a large file and then the software will record it for me (of course with my cloning voice ) ? Thanks

[@Han_Ngoc_Quang]

your last codes not working, everyhting is " not recognized as an internal or external command, operable program or batch file."

[@csomi35]

Is it possible to add emotions to the generated audio? I mean after successfully cloning some voice I would like to fill up it with some emotions (exclamation, fear, sad, fading etc... like a voice actor).

[@mattlegge8538]

I don't know if that's possible with any software yet. Maybe bark?

[@BigDaz]

The documentation says ---> you can evoke emotion by including things like "I am really sad," before your text. I've built an automated redaction system that you can use to take advantage of this. It works by attempting to redact any text in the prompt surrounded by brackets. For example, the prompt "[I am really sad,] Please feed me." will only speak the words "Please feed me" (with a sad tonality).

[@weluvtech]

Awesome tutorial thanks. I was looking for a good Google Colab of Tortoise-TTS. By the way, I found your generated samples sounded just like you. It was hard to pick when you were playing them.

[@Seii-FPV]

I don't have GPU option and have pretty powerful nVidia card installed. I only get GPU T4 and for some reason it won't accept that as an option. Has anything changed in how this works now? Does it need paid subscription?

[@kevinehsani3358]

thanks for the video. Have you tried bark? Looking for voice cloning model that I can train longer locally for better results. Thanks again

[@RamonValdez2014]

I get this error after running the "generate speech" cell: "NameError: name 'text' is not defined". Anyone???

[@ecstasycheese7390]

Play the "# This is the text that will be spoken." box first before going down to the "# Generate speech with the custotm voice." box

[@RamonValdez2014]

@@ecstasycheese7390 Spot on thanks a lot! I tried to install Bark on my PC last weekend but I got stuck in some dependency that just won't work. Gotta stick to Collab for the time being!

[@ulisesjorge]

Thanks, this is extremely useful; I suppose that one can feed this algorithm a file so that it can read it and output a recording?

[@engineerprompt]

Yes, there is a text variable in the notebook. Assign the text to it and it will do the rest.

[@akashshesh]

@@engineerprompt Can you elaborate on this? I am trying to have may sentences read, but it says its too long

[@aka70222]

Can I use this for other languages except english?

[@senate_shakya_]

You sir have my respect!

[@engineerprompt]

Thank you!

[@r_pydatascience]

I wanted to try this. Allas, it is taking months to upload the audio files. Then I upgraded my colab to use a pro version. No success.

[@didiervandendaele4036]

Great found feature ! But is it possible to use this clone voice to speak in another language with the same accent ? 😮

[@engineerprompt]

Check out the latest video on thr topic

[@zyrazuric1499]

Can it run in a low end pc?

[@tiagolourenco7158]

Hi, when I run the second code block I don't have the option to upload my files, and it shows "fileexistserror", I believe is something basic but I don't know what to do. Thank you

[@naze8793]

hello. i tried mine but it doesn’t play my text but the default text that comes in the colab. please any fix?

[@chesper_miguel]

There was a Brazilian who translated this video with the tool, LOL

[@engineerprompt]

😀

[@jorgemarz]

thank you! Do you think this could work if i use other language? or you can upload other language models or somethig?

[@engineerprompt]

This specific one only supports english but check out github.com/coqui-ai/TTS for multilanguage support. Hope this helps

[@jorgemarz]

@@engineerprompt Thanks!!!

[@Nethrex]

I haven't yet experimented but this, but great video!! Do you think it's possible to run locally and use it for a personal/local assistant on a PC? Also is there a way to get it running and working even without internet (so completely local)?

[@InquisitorGeneral]

Is it still necessary to chop audio up into 10 second segments at 22khz sample rate? I have many audio samples from 10 minutes to 45 minutes all at 48khz. Would these not work at all or would they cause some problem?

[@engineerprompt]

They will work, but you will need good hardware to run it though!

[@UnderratedKitchen]

does this work with other languages ?

[@NewImperivm]

no

[@flowsolo]

Mine made a crazy demon noise in the middle of a sentence.... SWEET. XD

[@engineerprompt]

haha, it can be unpredictable some time. Hope you had fun with it.

[@saifshaikh8828]

Hey brother, is it safe to install in my pc ? As my windows showing harmful and dangerous risk?

[@lalaland322]

great video!

[@funginimp]

I cannot actually hear the difference between the you and the first sample. Remember that you probably sound slightly different to yourself because you're hearing it through your body.

[@ss-np9gx]

how do i fix this unterminated string literal (detected at line 4) when i write my text

[@gisonnisylvio818]

Does it work only in english ? If I want to make it better in a certain language, do i need to only add more and more samples ?

[@engineerprompt]

This one is limited to English

[@thegodsbrand]

Do i have to reupload audio everyime i use it?

[@redlinrangerstudio5331]

i keep getting load_voice' is not defined

[@vyqh]

Great product showcase, can I use this to generate a 1000 word text to speech in 1 go?

[@engineerprompt]

With local installation, probably yes.

[@grim789]

​@Prompt Engineering Do you have a video on installing this locally? I'm struggling to get it setup.

[@cybergigafactory]

Is there a way to use it on a iPad Pro?

[@Araujo_gabbriel]

Oi. É possível fazer a clonagem em português nessa área que você mostrou no tutorial? Ou teria que pegar a área de um brasileiro para eu conseguir fazer isso?

[@engineerprompt]

This specific model works only with English. There are some other models that I can explore.

[@SokratesStudios]

@@engineerprompt That would be fantastic. I just wonder, is there any voice model generator that works with tones and regardless to the language that's spoken??

[@UnrealSideBiz]

Thanks for the video I found it really helpful. I played with it and created a synthetic voice using a Spanish speaking person as the voice model but my results were not as good as yours... is it me or the model works best with english language mainly?

[@engineerprompt]

This specific model is tailored towards English language.

[@UnrealSideBiz]

@@engineerprompt small question. Can you tune fine the model with the files you give it in different runs?

[@NowOrNeverAI]

Is there a limit on how many words can be spoken?

[@1000trilliondollars]

Does this model work well with languages other than English such as: Japanese , Chinese , Vienamese

[@engineerprompt]

This model can only generate English but you can retrain the whole model for any other language. Here is the link with steps: github.com/neonbjb/tortoise-tts/issues/5#issuecomment-1112705908

[@pacovazquez665]

im having trouble installing the tortoise, can anyone here point me to a place where i can find help

[@gaetanomegna4436]

NameError: name 'load_voice' is not defined How can I fix it?

[@spectrecular9721]

It seems the AI struggles with non-American accents

[@fkxfkx]

So do Americans.

[@saifshaikh8828]

Hey brother, is it safe to install in my pc ? As my windows showing harmful and dangerous risk?

[@crypticutopia7228]

​@@fkxfkxas an Australian who went to the US for 5 weeks I can confirm this is very true🤣

[@KeytoChannel]

It's a racist AI

[@geese5170]

It’s mostly American companies and American voices being used as examples mostly cuz it’s US English 90% of the time

[@TylerThomas]

Def gonna try this iut

[@elizalapteva]

Hey guys. I’m just wondering - if you were able to download your voice over there and sign any note like Whitney Houston - would you use it? I mean it’s it cool to record a love song to somebody but with your own song?

[@planetgamecommunity817]

easy

[@jayr7741]

How long passage it will take to cloned the voice? I wanna create the big passage in my voice, is it possible with it? Passage of At least 5000 words

[@engineerprompt]

You will probably have to divide the passage into different parts and then feed that into the model. That's the best way to do it.

[@shailendrarathore445]

Make a video for specific person voice cloning for hindi language using google colab..

[@黄毅宁-o2w]

Are other languages supported?

[@ryusuikagaku]

Can it clone other than english voice?

[@engineerprompt]

Not with this version. There are other packages that can do it.

[@tendaimurevanhema1166]

I’m getting “Maximum call stack size exceeded.” On the second last cell

[@nanigh2913]

It's support any language like kannada, or only English?

[@engineerprompt]

This specific one, only supports English.

[@shledoncooper]

Can we use different languages?

[@wnrandom98]

great tutorial thank you

[@engineerprompt]

Thank you.

[@boulimermoz9111]

Great Great Ai thank you very much, do you know if it works for other languages ? french ?

[@engineerprompt]

I think currently it works for English only but if you can collect data, you can retrain the model on other languages.

[@lkbanztheman]

bro it doesn work cus my ram is too high and it doesnt allow me to do it again after my first try on all my google accounts :(

[@manoelvitor-dev]

How make translate from portuguese in this?

[@karonwhitehead2383]

Can you do this on phone

[@Paulinhox88]

I get this when i try to upload my audio files "MessageError: RangeError: Maximum call stack size exceeded." Any ideas how to solve this?

[@engineerprompt]

I haven't faced but make sure you have enough space on your google drive and have stable internet connection.

[@saifshaikh8828]

Hey brother, is it safe to install in my pc ? As my windows showing harmful and dangerous risk?

[@GfLast]

Bro I find a problem to # Imports used through the rest of the notebook.

[@saifshaikh8828]

Hey brother, is it safe to install in my pc ? As my windows showing harmful and dangerous risk?

[@imashark241]

niceeeeeee now do not have to use effort on reading using my woice but just using woice clone

[@azab14]

Is it work with other languages such as Arabic

[@mrGapMan1]

The clone is spot on, but a bit cleaner english accent.

[@saifshaikh8828]

Hey brother, is it safe to install in my pc ? As my windows showing harmful and dangerous risk?

[@desstuctorr5263]

Hi guys , do someone know if an AI like 11labs or anything else exist but in French ? Im french and im really looking for that but it seems impossible to find

[@engineerprompt]

check the next video :)

[@Aaliyashi]

@@desstuctorr5263 11Labs do have a model now that supports a few other languages than English. French is one of them, so it should be pretty straight forward :) Just switch the model from "Eleven Monolingual v1" to "Eleven Multilingual v1" when generating your voice lines.

[@desstuctorr5263]

@@Aaliyashi Yeah I already tried it. The voice cloning is ok but it make a canadian accent that is pretty annoying

[@Aaliyashi]

@@desstuctorr5263 Oh I see, that's a shame. At least it seems like it's something they're working on.

[@desstuctorr5263]

@@Aaliyashi Yep . And its only an experimental version after all !

[@shanesteven4578]

Worked great until I used up the days GPU allocation!. Nice work, thanks for the effort and video.

[@engineerprompt]

Glad it was useful :)

[@SyntheticVoices]

Tortoise-tts also has a fine-tuning via a fork

[@engineerprompt]

Would love to have a look at it, any resources you recommend?

[@SyntheticVoices]

@@engineerprompt I have put a link in the description of my lastest vids to MRQs repo

[@engineerprompt]

@@SyntheticVoices thanks, I will check it out!

[@AMDSTT]

Thank you i will try then tell you

[@saifshaikh8828]

Hey brother, is it safe to install in my pc ? As my windows showing harmful and dangerous risk?

[@AMDSTT]

@@saifshaikh8828 I didn't test it

[@UnderratedKitchen]

bro i am getting error

[@amanisebele4073]

i keep getting an error every time I try run it

[@asterinycht5438]

How to train on other language ?

[@edwardecl]

7:33 - Best bit

[@harsh2624]

this is so COOOOL

[@engineerprompt]

Thanks :)

[@saifshaikh8828]

Hey brother, is it safe to install in my pc ? As my windows showing harmful and dangerous risk?

[@vancreo]

Please what is the python version, I keep scipy installation error

[@engineerprompt]

Python 3.9.16 (in google colab)

[@vancreo]

@@engineerprompt thank you very much

[@AntoniusTertius]

@@engineerprompt How do I install that version if there's no installer for it???? I can't install the latest Python because Tortoise doesn't work with it, right?

[@tharakamalli4366]

Use text to speech Can videos be monetized?

[@engineerprompt]

why not? watch this video to learn about Google's policy: kzbin.info/www/bejne/jJvTmXevhs2fjZo

[@jamrhxh]

How can improve spanish?

[@oussamael7304]

can i clone another language and make someone speak it

[@ValicsLehel]

Can be trained other then EN language?

[@engineerprompt]

This model can only generate English but you can retrain the whole model for any other language. Here is the link with steps: github.com/neonbjb/tortoise-tts/issues/5#issuecomment-1112705908

[@ValicsLehel]

@@engineerprompt That is not easy at all :-)

[@engineerprompt]

@@ValicsLehel That's true. Check out this repo, seems to have multilingual support, I haven't really looked into closely but probably something worth checking out: github.com/coqui-ai/TTS

[@ValicsLehel]

@@engineerprompt I will take a look. I want to find a solution to generate my voice (or actor voices) but not the default one. Elevenlabs is ok, but cannot learn Romaniann for example. Just EN.

[@mustafak.farouk1071]

Why does it have to be 10 second segments?

[@engineerprompt]

You can provide it longer segments as well but its just about the compute resources

[@privatesoft5006]

It Support Arabic Voices?

[@giooooo3522]

NameError: name 'text' is not defined. I followed you in every step. :(

[@engineerprompt]

Make sure you run the block containing this code: # This is the text that will be spoken. text = "Thanks for reading this article. I hope you learned something." Seems like it didn't run that part.

[@GreenHatAnimation]

@@engineerprompt was having same problem and this is the solution

[@oxanaivanova8007]

google colab now sucks because you have to pay it will only let you generate 1-4 voices then ur done this is so frustating i will just do story reading without it

[@gerriebullington]

The only problem is that the software doesn't pick up your accent.

[@RichardBonn]

cool!

[@saifshaikh8828]

Hey brother, is it safe to install in my pc ? As my windows showing harmful and dangerous risk?