Convert Voice into Music with this New AI Tool!

[@daniilsanders2257]

This is one of those Ai, when you say Expectation and Reality. It seems like it just scramble the voice with revurbs and other filters. Video 5+, Ai -1

[@missoats8731]

No, this is basically the same as a AI voice changer. They just trained it with instruments instead of other peoples voices. But in both cases you need to have some skills to make it work.

[@ShitMental]

​​@@missoats8731Your absolutely right. This is definitely NOT procedural manipulation. He should have tried a recorder or keyboard into it. I already subscribed to this and got mind-blowing results Anyone who can actually hit notes WILL get fantastic results. I'm not bashing MattVid!! You are awesome. But any minor hobbyist in music production can see the problem (and potential!) here.

[@missoats8731]

@@ShitMental Another aspect to consider is that you have to make sounds that are at least somewhat possible to recreate with the desired instrument. For example, Matt was way too low with his voice for some of the instruments. If you do it like that, the AI will not know what to do, since it simply doesn't know such a sound. It's the same problem with human voices. That's why men should artificially pitch their voices up when they use a female singer model and vice versa.

[@ShitMental]

@@missoats8731 This is my experience with these kinds of tools also, especially the voice part of this site. I can't just swap out a male for female vocal without transposing up 5 semitones. Also, I don't think true realtime coversion is entirely possible, as the ai probably needs a bunch of samples to preempt the note properly. Anyone who's used things like harmoniser peddles, which are far simpler and procedural knows it's never 100% tight real-time. (who knows what's coming though!). All this stuff is so fascinating, I could talk peoples heads off with the potential and just guessing what's coming next, or even inevitable makes my head spin!

[@danielisflying]

This tool matches your pitch very well. It’s potential with proper direction are actually crazy

[@loshunter]

Now we just need a second ai to "tune" your spoken or sung notes before converting to instrument so that you don't get an untuned instrument track back as a result! lol

[@taskmasterblaster]

Yeah man, if you can't sing for shit like me you're still in trouble. lol

[@JustFeral]

Lol auto tuning your recording then opning it.

[@stylezmorales]

Adobe has a pretty decent AI audio Enhancer I usually run my AI voices and text to audio stuff through that then I use the fair light tab in davinci, it's not perfect per se but you can def clean it up a lot. Between denoising and dehissing with a little compression then finally a tiny bit of reverb and I can get sometime palatable 😊

[@AvizStudio]

@legacylee but it optimized for speech, not every sound human can make

[@stylezmorales]

@@AvizStudio I have used it for regular audio before, like like they did switch it up now it just says voice but originally you could use it for any audio. I'm sure there are plenty of audio enhancers out there that can help clean it up a little and if you're familiar with DaVinci Resolve you could always use the fairlight table to tweak it even more

[@virtualshin0bi]

Just a tip…it’s going to copy your pitches so if you’re not in a tune you will get a not so desirable result. Try using audio files of some acapellas in key and then you’d get a better gauge of this tool in my opinion. Love this channel and always learning a lot. Peace and love guys 🙏

[@realitycheck1086]

Yep - I saw the original video and I gotto say, it's a scam, because it makes all of the instruments sound perfect (I suspect they used real instruments for that 'demo'). This video shows what it really sounds like and I gotto say - it's not great, at all. I do think, however, that it should be possible to use voice to dictate what an instrument sounds like - just obviously not this app - perhaps another developer will design something along those lines in the future.

[@olkazzshitpostvod9578]

@@realitycheck1086 the original video is not a scam, he adds a lot of audio fx and he can sing (unlike the guy in this video)

[@Eric-dd8bk]

​@@realitycheck1086 No. The original guy did have an actual singing technic or at least knew how to sing in pitch and a key unlike this guy. No hate on this guy.

[@MawPawsarksanctuary]

i agree

[@AcapellaFella]

Thanks Matt. You keep this old man in the loop. I can say we all appreciate your work.

[@GorilieVR]

Their samples/examples are 100% Fake. I purchased the expensive subscription and the quality is worse than any competitors I've tried 😢

[@EstamosDe]

Hello! What tool would you recommend? Hopefully with some free tokens to try it

[@sahid694]

Please suggest Free Ai Web site

[@inspirationaldave]

Sheesh thank you for SHARING I was going try it 😂😂 man that's crazy tho

[@AvizStudio]

You need to take 2 points into account while you compare yourself to the original demo: 1. In the demo there are some post effects like reverb. It written there. 2. You need to have good rhythm and some musical talent to make the sound close to what you want like any voice conversion process

[@realitycheck1086]

The demo is a scam. If you need to use another app to make the output sound like an actual instrument, then the demo is fraudulent at best.

[@Eric-dd8bk]

​@@realitycheck1086 lol What an idiot.

[@Eric-dd8bk]

Yeah seriously. the original demo guy did make sounds that mimic the characteristics of the instrument he tries to get with his voice, where as this guy doesn't know how to sing, nor does he follow the characteristics of the sound of the instrument he tries to get. You have to have that down. Then it creates pretty convincing instrument sounds just like in the original demo.

[@Zvezdan88]

I saw that video on YT long time ago (in AI world long time ago). The original video is from Emmet Ozcan, he is an incredible Artist, and he can do some crazy beatbox/singing. That is why that demo worked so good!

[@AcapellaFella]

Food is good.

[@haffey2]

@@AcapellaFellaok

[@robd7724]

​@@haffey2they're referring to your typo at end of the original comment

[@arnelilleseter4755]

Yeah, I got the feeling that the original vocals/instrument has to sound close to the instrument you are converting it into in order for it to work properly.

[@beanut-land]

you edited your comment but didnt fix the fact that you said "worked so food!"

[@FusionDeveloper]

It sounds like it is putting filter effects on the voice, rather than replacing the voice with instruments, because I believe I can hear your voice coming through. The "master" seems to just apply a stronger filter.

[@Edbrad]

Clearly that’s what it sounds like it’s happening when Matt does it but it’s more than that obviously: Unless the original demo faked it it’s not effects

[@Eric-dd8bk]

He sang in pitch that the instrument he was trying to mimic could not play in. Also, he needs to learn what the instrument he's trying to get atta this AI actually sounds like. He said an acoustic guitar yet proceeded to sing sustained notes with bends, which just is not what acoustic guitars do. If you can get that right, this actually does create convincing instrument sounds, just like in the original demo.

[@NickSBailey]

I was thinking that, singing through guitar effects would sound v.similar perhaps better in some cases, the demos seem to show it off at its best

[@SkepticalCaveman]

This is great, now I no longer have to regret that I never learned to play a instrument, I just have to sing instead.

[@TerenceBui]

Only here for Matt’s singing! Ps 6:49 burn it downnn

[@runvnc208]

This was absolutely hilarious!

[@Swickful]

You can't gaslight us into thinking those clips were good bro, they were bad 🤣 The percussion was the only exception 👍🏻

[@kinganime1x]

Lmaooo this right here , FACTSSS 7:41

[@jonmichaelgalindo]

Why would a violin say "ne"? This is an absolutely amazing tool... for certain users! Thank you for showcasing it!

[@petergedd9330]

ni....ni......ni...

[@joelface]

Perhaps the violin demands a shrubbery!

[@JoshuaRoch]

I've seen this guy's full video, and it's actually 10-15 minutes. He explains how he got the sound he did. Part of the reason you aren't getting the same quality as the guy in the demo video is that he was running the audio into a DAW to process the raw track (adding minor pitch correction), then adding effects in the DAW to the audio this tool produced. It sounded that good mainly because he's an actual audio engineer. This tool is more meant for people who already know what they're doing in a studio environment and want to work out ideas they hear in their heads without having to hire session musicians. :) Love your content man, and really appreciate the deep dives. Keep doing what you're doing!

[@meets2tarun]

Can you please provide the link to this guy's video?

[@JoshuaRoch]

@@meets2tarun kzbin.info/www/bejne/onqUfXacid1loqssi=759eQLTS8V9k0-Fz

[@CIZARTS]

​@@meets2tarunDid you find it? If not the guy is Ummet Ozcan 😉

[@joebonsaipoland]

so you're saying the demo is a F*CKING SCAM, totally unrealistic to the average user

[@lexscarlet]

Bro I am CRYING 🤣🤣🤣 "Never said I had a musical ear."

[@NoobieSnake]

Lol, Matt, this vid was hilarious! I was having dinner while watching and it almost made me spit my food out. As a musician, I’ve got to point out that one of the main reasons why it didn’t convert your voice as great as you’d like it to was because most of the time, you were singing in the same pitch or within the same few pitches. Kind of like monotone. But it’d work great if you made a big difference between the notes/pitches you were trying to sing. Maybe give this tool a try again in the future and try your best to sing an actual existing song, maybe you will notice the huge difference. 😊 cheers!

[@milesprowr]

🎷😙 _saxamaphooone... saxamaphoooooone_ 🎶

[@skittlznt2611]

Imagine having no context and tuning into the middle of this video

[@San4itos]

Ummet Ozcan has great voice even with out AI. And he used some audio processing on his results. I think that is what made the difference.

[@bagijaner]

chewbacca mating call :D ahahhaha 6:10

[@moply4life]

Super amazing, I am astonished

[@dhrumil5977]

I know you did your best but i couldn't stop laughing the whole time 😂

[@aribk]

glad you guys like our software

[@aribk]

we will be launching realtime soon

[@mylittleheartscar]

*I TURNED MY SELF INTO A 🎻 MORTY!*

[@kinganime1x]

7:05 the wayy I laughed soo hard when the master quality was the same as before 😂

[@westingtyler1]

not quite ready yet, but in another year, for sure. it may be a "post-vst" world pretty soon, which would be nuts.

[@gabrielsandstedt]

it's ready if you can sing

[@petergedd9330]

errmm.....not quite. which is good, because it means we still need to have skill.

[@HarryHeck2020]

The problem is that in the demo, the guy was using Pro Tools Studio to master the instruments.

[@micallbeard923]

I think its just the RVC software but just trained on instruments instead of voices

[@ratside9485]

Jop

[@JustFeral]

Sir, you are not musically inclined are you? lmfao, hilarious video thanks.

[@warmage007007]

Definitely seems like either the demo they used were heavily cherry picked, or there is actually some fine-tuning going on with the voices of the people in the demos. What was shown here was substantially worse than what was floating around Twitter for sure.

[@MM-ts9jy]

Bro, remember that this thing transforms your voice into instruments, Matt put zero effort into making a proper melody, that's why the result is shit. This could be the best AI, but if you don't put any effort into making a sound that's coherent with the chosen instrument, it will sound much better. I'm impressed

[@Eric-dd8bk]

No. the original demo guy did make sounds that mimic the characteristics of the instrument he tries to get with his voice, where as this guy doesn't know how to sing, nor does he follow the characteristics of the sound of the instrument he tries to get. You have to have that down. Then it creates pretty convincing instrument sounds just like in the original demo.

[@welovesummernz]

🤣 To the comments saying this is good... COME ON!!! This is terrible! Are we watching the same thing!? 🤣 It's just noise!!!

[@Im_that_guy_man]

This sounds absolutely nothing like the ad they showed. Actually, this sounds exactly like RVC but trained on dry indtruments. The voice always comes through. They charge you for this cr@p?

[@AlienetteColdfire]

The way it works is that you will have to vocally imitate the actual instrument and the AI only changes your timber.

[@Kingwithoutathrone]

This might be very heplful for me in my case. There's a song that I've had stuck in my head since childhood. I only remember the melody. With this tool, I can actually create the melody and hopefully use that as a way to find that song.

[@BlurAi]

5:57 the mosquito in my ear at night

[@WeissHS]

This is such a good idea! With some refinement, I could really see this taking off! I'll have to check it out when it's a little more refined. Great video!

[@JackDazey]

As a music producer for over 29 years and musician for over 40 years...this will be a game changer in the way i can express my artform. The guitar AI demo at rhe beginning was able to interpret intonation and expression and that makes for some next level music form. I'm blowned away about the time in human history that I'm living in. 🤕

[@realitycheck1086]

The AI demo you saw in the beginning is a scam - they used a real instrument to play that bit to sell an app, pretending that it was your voice converted to that instrument. I do think it's possible to create an app which will be able to use voice to play any instrument, as is the case in the demo. The demo gave a good idea for developers - but the demo was also a scam, since we can see that the real end result is nothing like what they were stating it would sound in that demo.

[@Eric-dd8bk]

​@@realitycheck1086 lol Random blank accusation with no substance nor evidence.

[@realitycheck1086]

@@Eric-dd8bk kzbin.info/www/bejne/onqUfXacid1loqs So, according to the demo dude, he trained his own instruments - he did not use the original app sample - AND he used a crapload of additional effects to make it sound passable. Curiously enough, even that explanation video could be BS, though I'd love to see someone try to copy his steps to see if it's legit.

[@StaredownGames]

lol I'm that guy making those noises ALL DAY. This was made for me.

[@guillermosanchez1224]

Bro Im sorry but the results made me laugh 😭😭

[@0x3e9]

Oh lol that's my guitar model from like june. I've noticed that human voices work best with the electric guitar models. Otherwise, I think they just put all the instrumental models in one place, it's just plain ol RVC :)

[@she3po945]

Music producer here. Omg!!! 🤣🤣🤣😭😭😭 I laughed so hard on the violin part. Let’s have a whole live stream doing this. So much fun!! But I would not pay for it quite yet.

[@ChurchofCthulhu]

I tried with actual sung vocals and it couldn’t handle the volume. Came out weak and clipping. Would have been cool to have an instrument accompaniment to my vocals.

[@PrinceWesterburg]

Dude, I have 40 years in music - You're singing out of pitch and changing pitch (drifting) all the time, thats whay it can't track you! But thats good as it shows both it's microtonal capbilities and that the Charles Babbage rule of GIGO is still true! Nothing personal ;o)

[@andrewgarley1400]

Clearly needs quality input, in time. Has the potential for sure

[@JM168M]

Heavenly Yeah! I am want to try it. Thank Big Matt ✨✨😁✨✨

[@NoCodeFilmmaker]

Bro, this review had me in tears. The results and your reactions 😂 Very informative and very funny bro

[@AvizStudio]

You can make it also with rvc open sourced. It's the same technology like human voice convert. It all matter of what model you trained

[@CIZARTS]

You mean that I can, for example, train an rvc model with samples of trumpet guitar solos or something else, and use it as a model in the Real Time Voice Changer software? 😲

[@Masterx3]

sorry but I laughed hard at 6:17 you hoping it converts better and having high hopes then you give this face lol

[@jijaji2198]

Same here😂😂😂😂

[@Armonyo]

At the moment it's pretty much oriented to people with good capabilities to emulate the components of an instrument, not for the average joe until it's able to just translate the intention of the rough notes and smartly recalculate the whole thing to the actual instrument, like using midi sampled libraries.

[@citruffioparapiglio]

You can actually do this with Ableton Live now and I know some music producers they use this for their business productions

[@TommyClark]

I think this app seems like it's for musicians or attuned users to get the most out of. The original demo guy was a professional composer. While I love your videos Matt and will continue to enjoy them, maybe the quality of the output reflects the input? It gave me a chuckle anyway! 😂

[@tiagotiagot]

Kinda seems like that trailer was a tad misleading. I mean, it's not completely useless, but it's much more limited than they made it seem.

[@jaimeburena8809]

I was thinking of buying a subscription for a few months but with these results I will wait for it to improve a little more haha

[@joelface]

Good video. Thanks for trying out the premium for us... so we don't have to. HAHA. I think their examples in the demo might be tough to replicate actually using the software, especially as an untrained musician. Still early days with this technology, though... interesting to see how this particular type of software will advance over the following years. I imagine by leaps and bounds.

[@BillMill]

Dude, that was totally the funniest video you've made so far lol

[@brainwithani5693]

Finally, we can make mayonnaise an instrument.

[@michaelmcwhirter]

12:56 -13:20 Those facial reactions are such a memeable moment 😂

[@RNDMTRNGR]

expectations of the promo video didn't turn out well. 😉 can't wait to try out Google's Lyria .. this could be a blast.

[@MeinDeutschkurs]

Your efforts are amazing, but the result is the same mean than your singing. But I think that if someone is good in matching the notes, it will work. Love it.

[@RockyBergen]

Wow, how festive Matt!

[@tristotech]

This is game changing, yesterday musician must pay a lot for musical instrument. Now the creativity is unlimited!

[@damnsonalabanca420]

As a beatboxer im pretty exicited for this

[@The_Light_Pharaoh]

THis is amazing cause you now turn acapellas into your favorite instrument

[@matfunnytb]

AI changes vocal scales and adapts according to the instrumental. (uploading a vocal as an example to analyze would be even better)

[@CoalMyn1382]

Beeeeest video to date. Really fun work, bro.😂☮️

[@BTMYYY]

Is it just me or does this sound like rvc with effects? the more I watch the more it feels like this company is charging for a free open source ai

[@EugeneBartholomewMcJigglebutt]

Exactly

[@BunnyOfThunder]

So what if you generate music with one AI, then use this AI to clean up the audio and make it sound more like a specific sound?

[@NeoKailthas]

The demo was great 😅

[@cloudstorage9026]

Thanks for covering this. Honestly though, this is... not great. Way too much of the voice comes through and just a hint of the instrument. Like someone else said, sounds like a audio filter. Not at all what the promo vid showed.

[@middle-agedmacdonald2965]

I just feel like some how "Primus" (Les Claypool) in in the a.i. that's creating this? Who's with me? Thanks Matt!

[@pareak]

I quite like it the way it is, because it still needs human skill to master that.

[@Onarchegable]

Well, to be honest you are not giving the program a good source material to work with :D It is not about you singing in/out of tune or anything like that. But you really have to sing with the intended instrument's capabilities and character in mind. Not really sure what they were trying to achieve with the "cinematic" one, but i.e with your first one - the acoustic guitar, you were humming long sliding notes that are not really what an acoustic guitar is capable of doing ;) It sure is still in the uncanny valley territory, but I was able to squeeze some pretty decent saxophone performances out of kits-ai. Definitely better than what most expensive VST (virtual synths) can achieve with the brass / woodwind instruments! The reason being the opposite - you can not have the same amount of control over the timbre and vibrato's with the keyboard, but with the voice you can, and it translates really well.

[@AvizStudio]

BTW violin indeed sound close to human voice that's why the conversion is easier

[@themasterofanalyticsandwie1342]

Tested it and i must say, even after serveral tries it just sucked. Either the trailer is highly cherry picked or the audio in there is straight up fake. Wont get my money with that

[@tokyobobcat]

Yea I tried this one and paid for it and regretted it immediately 😢. But let's hope it improves like SunoAI has

[@RedRisotto]

Okay, that was garbage... LOL! 🤣

[@randomscandinavian6094]

Well, garbage in, garbage out. 😂

[@DUDEiTHINKIMNUDE]

Let us know when it gets better 👌

[@dirt55]

Love your content Mattvidpro

[@saymydomain9504]

I’m a producer and I welcome it!

[@avi7278]

I feel like if you have negative -10 music ability in your skill tree, maybe this isn't the AI for you.

[@yanalajouanine]

That was educative and hilarious. Thanks man

[@cyberjet2004]

Ummet OZCAN.... that guy is a legend

[@pervinyavuz6243]

Wow I'm so hyped😁 but it sounds like there's still a lot of work to do with this ai

[@Eric-dd8bk]

The one that needs a lot of work is the guy in the video. That guy doesn't understand how each instrument works, nor sounds like. You get that down, it actually does create convincing instrument sounds.

[@concious_open_mic]

The demo video did look like AI made video

[@Fontgod]

A strange mix of your own voice and the intended instrument, it needs work to enable it to be more usable by the masses. Also similar apps have been available on iOS since about 2010, "Voice Band" for instance.

[@ed2win37]

Love it. That's so funny and awesome at the same time.

[@МаксимИванов-х4ю]

Who can tell me what kind of melody it was ? 10:49

[@supbrotv]

The video mentions the added effects on top of the instruments to make the sounds, you need a daw to add these effects.

[@Wren206]

Music but easier!!!!! Amazing stuff!!!

[@Fustercluck06]

So cool! You gotta test more, video part III lol

[@AvizStudio]

In voicemod they have AI Voices in real-time and it use the same principle of voice conversion. So I assume it possible to make it real time

[@CaritasGothKaraoke]

Now it’s time to sing the Doom Song! Doom doom doom doom doom doom doom doomydoomydoom doom dooooom

[@TeluguGoldendialogues]

that option in musicfy is now not there can any one check please

[@ratside9485]

ITS RVC Model

[@777tmack]

Just sounds like humming with the reverb to me

[@pan2pans]

06:15 I can't stop laughing at this part. hahaha!!!

[@onidaaitsubasa4177]

Now try Flight of the Bumblebee with your voice to a violin, lol JK, that would be as challenging as doing Dueling Banjos with your voice, but it's possible to do.

[@Oneirio]

More pls this is amazing

[@criss6945]

Wow, that's... amazing