DaVinci Resolve and AI Integration Part 4: Voiceovers

[@nathanabrahams5305]

As an editor of 16 years I approve of this idea. 💥

[@lanarkcd]

I am now beginning to see the power of Davinci Resolve and the control it gives over video intended for KZbin, so yes I would like to see more content like this

[@mylesconti1437]

Igor, I've really enjoyed watching all of your AI Integration videos, and enjoy many of your tutorials. I definitely think pursuing this as an app would be extremely valuable. Keep up the excellent work!

[@deadlandsmg]

DUUUUDE! This plugin is amazing! That would really make my life much easier. Hope you will make it commercialy available. Well done!

[@rneilhaugen9206]

Igor, that is definitely of interest ... will be looking forward to further design and details from you.

[@alzibaba]

This is fantastic, great job. I'd buy it in a heartbeat!

[@uroshavalon]

Ful dobr Igor. By my humble opinion this can be a tremendously useful tool for so so many creations we meet in our "put something together" route.

[@InvisageStudios]

Yea… I’d totally buy this. So many times you need VO or dialogue fix ups in post, this would be an incredibly valuable tool to have in the kit

[@DEAN-if8zp]

I am new to video editing and been searching for a video editor that's free and powerful, the Davinci Resolve. I know that the learning curve is steep. One of my problem on my videos is my deep accent. Sounds terrible even with a subtitle. Hopefully, in the future, your video(s) not only will help me learn the inner functionality of the software but also make my videos more appealing to watch. Thanks Igor! for making these learning videos available to anyone especially like me. Keep it going!

[@akaOmlet]

This is amazing … this could be a Game Changer in Saving Time and many More One thousands Things …. 😮… We Need This as fast as possible. Igor this ist a Must have…Great Work ( i Hope soon for all in Resolve 😅) Respekt . 🎉🎉🎉

[@OutdoorsEmbrace]

Huge! I need it for making my workflow more streamlined, but I would want to have it be my own voice.

[@TheVapingHeed]

defo shud make this available, especially if you cud use ur own voice as well awesome video sir

[@tomaston2464]

Nice work Igor - really enjoying this series - recognised the Welsh man RB straight away :)

[@lecafeaudiophile]

Thanks Igor, as always your content is very valuable.

[@andreadalpian7896]

It would be a dream tool in the documentary and social videos world. I'm wating!

[@ashishjatiani3356]

Tons of people are ready to buy it!!!

[@lesliecoelho]

That's excellent

[@TheEditWiz]

Yes, this plugin would be very useful!

[@CrazyAboutFlyFishing]

That would be extremely useful for me

[@Erazerproject]

This is really useful tool for documentary and commercials voiceovers especially integration possibility.

[@Hdhead]

It really is. Thank you!

[@mammifero]

AMAZING !!! waiting for buying

[@SkydiveSim]

Wow this is pretty impressive. Is it available for purchase?

[@Hdhead]

It's not available for purchase as annofd the shelf product but I could build it as a custom tool.

[@jhonatammartins8168]

Do not forget to put the language options, like português from Brazil ❤

[@kellyanzalone195]

I would love to have a plugin like that. It would be a game changer.

[@silversurfertech7922]

Just found this video. Brilliant idea. I'm working a military documentary, and finding it difficult locating a real sounding voiceover.

[@pedrolopa2]

that'd be amazing for sure

[@xemo1985]

I have been working in post-houses for years and I would say make this available as soon as possible. It would be a massive help for all post-house. More option on alternating the voices would be a good feature so people are not stuck with only few voices.

[@squirekev]

The idea of being able to change VO, like one would a title in a client session is pretty surreal.

[@abrohamlincoln2232]

Davinci definitely needs the voice over function, please release it👍

[@OutdoorsEmbrace]

I would pay $100s for something like this. Please make an app in the form of a VST or something to work with DR

[@fredstork]

This is gold! I would buy the plugin!

[@whowhatwherelife]

An excellent option for using AI generated VO. Artlist uses AI generated VO and haven't tried it yet. Yours seem very natural spoken words and even the rise and inflection of a voice for expression of the words and context. Please let me know the progress of your work and the AI VO app you use. Thanks

[@Hdhead]

I've used ElevenLabs via their API here.

[@coloryvr]

WOW!! ..such an AI languange tool will be a great thing in DR!!

[@JimRobinson-colors]

I would buy it Igor - just to make quick tutorials and use my own voice. It has to be faster than reading the same lines of text over and over, and second guessing your performance. Really interesting subject and product. Great demo

[@Hdhead]

Thanks Jim. That's exactly what got me thinking about this. So many times when I record YT tutorials I need a pickup line and have to break out the microphone, setup everything, record it, cut it in... It's a hassle.

[@joostvanderhoeven2969]

Awesome! What voice ai tool are you using under the hood?

[@Hdhead]

This is ElevenLabs.

[@hisroyalillness]

great idea and timesaver!

[@giorgiolovecchio]

Great Igor! Very good idea. Which is the engine used for voice representation? Can it be customizable when integrated?

[@Hdhead]

I'm using ElevenLabs. It is possible to customize some parameters. ElevenLabs is in beta and I expect much more will be possible soon.

[@ElYaucanoFilms]

i would buy this now! I am working on a documentary and i need to add voice place a voice over in a few areas to show the producer what it will be like when the actual actor shows up to record. So, this would be helpful excellent videos.

[@MeinVideoStudio]

Crazy. Very cool

[@juliandekeijzer]

Very useful for many purposes. Not good enough to do a real VO in the high end. Have you ever witnessed a VO session with a client, a director, a copywriter? All the stuff that comes up in such a session you will eventually have to deal with. The fact that you now work with an artificial voice will not change what they would require from the 'artist'. And because now the video editor has become the arms and legs of the VO, he/she will have to deal with it. This is not only the case with sound, same with images. - But.... amazing work with a definite place in the arsenal of the not too far future video/audio editor!

[@Hdhead]

Thank you for your response. Yes, I've seen voiceover actors at work and the degree of skill and fine control they have is amazing. I agree that what I'm showing here as a crude proof of concept is not ready for that level of work. However, it is above and beyond what video editors can do themselves, today, by recording a temp VO themselves.

[@juliandekeijzer]

@@Hdhead Totally agree. The tools that you should focus on when you refine this, are the things that a director may say to guide the artist to change the tone. 'A little lighter, somewhat more open, a twitch of cynism, a little more threatening...' Would be nice if you could 'shape' a phrase with a curve, like colours in the colour page.

[@Hdhead]

@@juliandekeijzer These are excellent suggestions. I was already thinking about using a layer of sentiment analysis that would attempt to understand what the director means before translating that into parameters that drive the TTS generation. Connecting some of those things to curves is a pretty interesting idea. I like that.

[@juliandekeijzer]

@@Hdhead try if you can talk to people in the music synthesis corner about 'shaping' sound. There might be a clue too.

[@juliandekeijzer]

You'll end op with a KORG MOOD synthesizer :) 😄

[@Zizos]

Amazing. Just in case this becomes available. Being able to delete unused clips both in DR and in the computer instead of gathering tons of clips in a random folder would be nice. Being able to specify which particular marks to generate would help. Maybe by color or currently selected ones. It needs many languages but English is a start. For me other than English, Greek would help a lot. Descriptions for the voices. Being able to have an idea before generating instead of relying on names. And the list can go on. Maybe the ability to set the pace, maybe have a range mark and the voice has to fit in there. But things like the last one may have to do with the AI's capabilities instead of an API connecting it to DR.

[@sisquack]

This is really intriguing to me. I'm an animator, and I imagines stories with dialogue all the time. But I can't stand the sound of my own voice, and I can't afford voice actors. I really want this!

[@GeekNetworkDK]

Would be cool for generating voice over for KZbin when your native language is not english, depending on the Price ofcourse, maybe some AI dubbing would also be a Nice feature in the longer run

[@FlipMuzic]

This is amazing especially if it was a plugin

[@BANGBONSCHANNEL]

This will be very helpful! Is it also available with various accents from different countries?

[@Hdhead]

Non-English languages are possible.

[@XTnautas]

That's absolutely great! Can it use non-english voices as it is now?

[@Hdhead]

Yes, there are non-english languages available too. Not every language in the world, but some.

[@racharbenjamin2318]

Love this!!!

[@DarrenVarney]

I would love to use a tool like this. However, the VO sounds good, but does sound fake (like other AI voices at the moment). It would be great if AI voices could add an element of randomness into the speed and pitch of each word, so that the same word does not sound identical each time it is spoken.

[@Hdhead]

Totally agree. There's a randomness in this one, every time you run it it's a little different but you can hear what you're describing in some voices.

[@newbsmedia]

This is great, could be used for crime investigation documentaries.

[@TransientMobile]

Yo I need that Make Voice Over like today Igor! I hope you release it.

[@wezlam]

I run a production company and for very quick turn around and social content this would work for us.

[@alcalina636]

Please!!!. I get here thinking was ready to use lol

[@ColMustard26]

This is great! It would also be interesting to take a recorded performance and then have the AI base its VO off that performance. Kind of like puppeting the audio. That would give the user the ability to achieve a specific inflection for a sentence.

[@hmarci]

A tool called Revoice Pro already exists for that purpose!

[@SandorDaroci]

Groove. Pozdrav. Hvala.

[@weshootfilms]

Def needed

[@kelseydutta1365]

This is great! How long does it take to add a new voice?

[@Hdhead]

Not very long. I was able to clone my voice in a matter of minutes, but it's far from 100% convincing. It is possible to get nearly identical clone with some more work. There is also a library of premade voices.

[@Panorafestival]

Would this work in other languages like german?

[@ereceeme]

a plug-in would be great

[@davidsiltz]

I would buy it.

[@TR-ei1cy]

What about being able to use Eleven labs voices - go with it I have a use for this

[@aariflaljee9990]

This is great.

[@resolveshark]

awe-inspiring!!

[@NathanPorter]

Dude. I need this.

[@jamied6166]

Hey, nothing wrong with a British accent! This is so cool!

[@Hdhead]

Guess who's voice that is? I didn't make that one. It sounded familiar. Then I copied and pasted the opening monologue from Jeff Wayne's War of the Worlds. Guess what happened next?

[@zeljkocerovic1882]

Sjajno.

[@Ephesians-612]

awesome stuff, where can i find out how to create ai voice overs like that?

[@Hdhead]

Check out ElevenLabs

[@UmarFarooq-t1u]

wow i really need that Make VO app integrated with my DR Amazing

[@DKairmax]

this would really help

[@rickpinelli1586]

This is great... am currently working on a video that needs a VO and this would be perfect. Is the VO available now? Thanks

[@Hdhead]

It is not. Sorry.

[@RTSWatson]

@@Hdhead Good day, are you still going to create this ?

[@Hdhead]

I think so, but I can't share too much now.

[@Predictor_]

Cool!

[@JohnKodiyil]

This would be useful in teaching, having the whole Bible available this way where I would just have to pick the book, chapter and the verse(s) on a drop-down list.

[@airfilm_it]

where can i find this interesting script? The system recognize the Turkish language?

[@Hdhead]

This is a proof of concept tech demo. I haven't released any of this.

[@airfilm_it]

Will you release it?

[@Hdhead]

Maybe.

[@LEUMAS_PLAYS]

can you please show us how to do it

[@jeffmcdonald5259]

The fake doco had me fooled, great video just found out coding Davinci was possible today and I could use this as product today, any chance you release a tutorial video on how to make this?

[@Hdhead]

There may be some hands on tutorials coming. Stay tuned.

[@ingsecingenieurburofurarbeitss]

it Would be really cool if we have a german voice integrated

[@peterkoomen1]

Go Igor go.

[@aqueminteressarpossa3445]

shut up, and take my money

[@MortenNormannAlmeland]

Do you know if you can do this in different language?

[@Hdhead]

Yes, currently there is a small selection of non-English languages. It will likely expand over time. The funny thing happens when you feed foreign language text to an English-only model, it speaks the foreign language but with a heavy American, British, etc. accent.

[@Aleksandar.D]

​@@HdheadSta cemo sa srpskim? 😂

[@Hdhead]

@@Aleksandar.D ima poljski.

[@Aleksandar.D]

@@Hdhead htedoh reci, kako gpt nauciti srpski? Kako mu objasniti npr. proslo vreme u budicnosti 😂 Malo sale... Svaka cast za ideje i trud

[@nevermoreexplorers]

so how and where do you get the voice over api?

[@Hdhead]

That's ElevenLabs API I'm using.

[@Ziz_clips07]

can i have the link of script to convert the text into speech?

[@Hdhead]

No, sorry. I haven't released any of this.

[@ElYaucanoFilms]

is this available now?

[@Hdhead]

It is not.

[@anonanon7368]

Update? Have you given up on this project?

[@Hdhead]

Well, I'd say for practical purposes probably yes. Any creative generative AI is toxic in Hollywood and a sure way to piss off a lot of people. I've been diving into other AI use cases that don't displace human workers but sort of create opportunities where none existed previously.

[@anonanon7368]

@@Hdhead Why you talking about Hollywood. People wanna use it for their youtube videos. Upload the script please. I will build it if you don't want to, I just need a little help since I don't know how to write DR script or where to start.

[@Hdhead]

@@anonanon7368 Because I work in Hollywood. While a product like this wouldn't be intended for Hollywood pros I don't want to alienate people I work with.

[@anonanon7368]

@@Hdhead Ok, I will try to build this myself then. Thanks for nothing.

[@alexanderbajkov2993]

VO 001 - is the voice of Orson Welles

[@Hdhead]

I thought it was Richard Burton.

[@alexanderbajkov2993]

@@Hdhead It might be, they are very similar.

[@evlnachoz9814]

igor this is gate keeping video. Tell us how to install the plug in

[@Hdhead]

There is no plugin to install. This is a software I wrote to test the whole thing out, just a proof of concept. I haven't decided yet to make this into a real product.

[@evlnachoz9814]

@@Hdhead ok Thanks for clarifying. I'm still looking for an alternative tts at the moment.

[@TMC3000]

@@Hdheadbummer! I was hoping you’ve got it sorted out already

[@Hdhead]

@@TMC3000 I hear you. The tech part is a no-brainer. The ethical considerations are tough, especially in the Media and Entertainment industry which is where I work. I'm carefully evaluating all that.

[@TMC3000]

@@Hdhead oh well,….I’m rooting for your success eventually.

[@ashishjatiani3356]

Please start selling your plugins 🤯

[@henrybirdseye]

"Amazing" barely begins to cover it. Wow.

[@marinrealestatephotography]

Guess we are going to have to start a Go Fund Me campaign for out-of-work voice actors... and graphic artists, and videographers...

[@MonkeyButtGamer]

is there a video on how to set this up

[@Hdhead]

No, but I've done a tutorial on AI integration in Resolve for Mixing Light.