How to use AI to motion capture with Move ai

How to use AI to motion capture with Move ai
bit.ly/moveaihome
Download Move.ai app: apps.apple.com/us/app/move-ai...
Dancers: Jess Jourdan & Ryley Clement
BTS Videographer: Rob Ponte
Location: AnneliPhoto
Environment I kitbashed Leartes and Kitbash 3d
Characters are @reallusion and some marketplace assets
Music from @artlist_io of course! Manroe - Remember me
@moveai @UnrealEngine #moveai #sponsored #iphone #mocap #unrealengine5 #aitools #ai

[@Jsfilmz]

MOVE AI IS OFFICIALLY OUT IN THE WILD! $1 Per day read more about it bit.ly/moveaihome

[@visualpoetry3d]

This is the best thing that happened to indie filmmakers since unreal engine and quixel. Thank you for sharing

[@Jsfilmz]

Glad you enjoyed it!

[@RemDovans]

Was gonna do the research in a few weeks, thank you so much for making my life easier, looking forward to this

[@Jsfilmz]

YW DUDE!

[@leonaraya2149]

The results looks amazing. I really enjoy this videos.

[@Jsfilmz]

hey man thanks for that, comments like yours is what keeps me going because we all know its not the money adsense sucks lol

[@NinoDefoq]

This is stunning!

[@RobinGrays]

Awesome... Thanks for sharing.

[@vidayperfumes7514]

Just Amazing,thank you for showing us this .

[@Jsfilmz]

here for the ride man!

[@brandongroce]

Incredible!

[@brunopascualetti7011]

Crazy! Amazing work

[@Jsfilmz]

thanks mate!

[@williamweatherspoon4527]

Beyond Amazing!!! Good Work.

[@Jsfilmz]

yea everytime i see the raw results of move it makes me cry a single tear

[@SuperlativeCG]

Great info. Very helpful.

[@stevenbaker153]

Great video. So helpful. I can't wait to start using it soon

[@Jsfilmz]

Have fun!

[@foyezuddin1632]

wow! that was just BEAUTIFUL

[@Jsfilmz]

thank you i really enjoyed this tbh i tried to tell a story in 3 minutes

[@birdonfiremedia]

Great video, thanks J!

[@Jsfilmz]

thanks dude!

[@infomaticfilms]

Love it!

[@Jsfilmz]

thx

[@savage_Creations247]

Thank you Again brother

[@Jsfilmz]

Always welcome

[@BrentLeBlancCG]

This is freakin' wild. Thanks Jae

[@baymetromedia]

Gotta love it! Sky's the limit now!

[@24vencedores11]

Very nice video and good steps 👌 Now I understood clearly. Many thanks.

[@Jsfilmz]

Most welcome 😊

[@24vencedores11]

Hello dear friend. You actually don't say much about go pro. Is the result the same as iPhone?

[@Native_Creation]

Very awesome, looks solid and an easy enough setup. How would you say this compares to Rokoko Video? Maybe a comparison video would be useful.

[@ramnicka_rk4]

Cool

[@suryakamalnd9888]

Amazing video bro

[@Jsfilmz]

oh thanks man!

[@HarryClipz]

I got 3 iphones already and plan on getting 2 more. Can't wait to dig in.

[@Jsfilmz]

letss goo

[@HarryClipz]

@@Jsfilmz I just got the iphone 14 plus. Will the 14 plus work well or will i need the pro max with the third camera for better results? I am asking before i open the box or should i return it for the pro max

[@VenturaDirector]

Nice tutorial!

[@Jsfilmz]

Thank you! Cheers!

[@LinusKVisuals]

Excited to see it! What do you think about captury vs move ai ?

[@Jsfilmz]

guess time to compare em right

[@funkyguy0]

Good job man, very good job. Results look amazing. Question, what are your thoughts between the results with this compared to Rokoko?

[@Jsfilmz]

someone actually compared it to their rokoko go check it out

[@rewwhiskas4234]

Awesome! This stuff is moving at such a rate at the moment. @jsfilmz - any idea about combining this with facial capture in the same shoot? Would be hoping to include an iPhone headrig but I'm guessing that will interfere with the tracking...

[@Jsfilmz]

yes ive tried it with facegood it works suprisingly

[@supercolor222]

I wish you have the full video how to make it from the ground to finish.. man this is sick.....................!!

[@Jsfilmz]

that would be too long of a video man people dont have the patience lookin at some of my analytics people stop watching after 2-3 minutes lol

[@ethanhinkle5369]

Could you do a dedicated video or test focused just on the current state of this technologies finger tracking capabilities? like in a normal conversational situation as opposed to a dancing sequence?

[@Jsfilmz]

like an exaggerated talking with hand movements like a speech?

[@ethanhinkle5369]

@@Jsfilmz Exactly! That would be a great test to see how usable the finger tracking is with this

[@Jsfilmz]

@@ethanhinkle5369 got it

[@chriswatts3697]

Very cool resutls - how long did the whole procedure took? after recording...setting up implementing?

[@Jsfilmz]

week and a half im just one dude so hahaha

[@chriswatts3697]

@@Jsfilmz very cool man, thx for sharing

[@Jsfilmz]

@@chriswatts3697 yea man thanks for checkin it out

[@ademolatosin1528]

Hey man, Amazing stuff you are doing, always gets me pumped, I wanted to ask, is it possible to retarget Move Fbx to metahuman?

[@ademolatosin1528]

And how can I go about it?

[@gooddimmi]

"I am the great Cornholio"😉

[@AICineVerseStudios]

O man o man o maaaaan, like wow!!!! this is awesome!! Can we take to next level to apply to metahumans?

[@Jsfilmz]

dude they have like 17 premade rigs and you can upload your own. wait for my next video

[@AICineVerseStudios]

@@Jsfilmz definitely looking forward for this!!!

[@TobiasLeanderOfficial]

Great video! also I'm really surprised with unreal engines groom physics, I gotta start diving deeper into unreal engine 😄

[@Jsfilmz]

this isnt groom broski its chaos

[@TobiasLeanderOfficial]

@@Jsfilmz oo I see, its crazy how performant it is while it would take quite a bit to simulate in traditional 3d software.

[@Jsfilmz]

@@TobiasLeanderOfficial oh yea hahaha for sure

[@hyperface2050]

@@Jsfilmz Great video. Amazing really. Still with respect to the groom, I"m not following. How did you get the hair to work the way it does?

[@Jsfilmz]

​@@hyperface2050cloth physx

[@mattmocap6499]

Did you already clean up foot animation with offset rig or only retargeting mocap for the sake of time?

[@Jsfilmz]

not alot of foot slide but i did filter some jitters and fix penetration some the bottom right of the video is raw result

[@kennykudla]

Nice video ;)

[@Jsfilmz]

thanks kenny

[@Darksector88]

I already have an iPhone 12, of I pick up 3 iPhone 8's would they be cross compatible so you know? Like do they all have to be the same phone?

[@WFilmUnreal]

Hi! We talked before and I asked if you were able to work with us on our Star Wars project, you said you were busy which I totally understand but I wanted to ask you something. So we have Jedi dojo in Poland, and I bought them six iPhones for MoveAI. They’ve been doing a lot of wonderful lightsaber stuff and action sequences, but they just keep having issue after issue with the program. I think it’s because they don’t have experience with this stuff. And I personally do not have enough knowledge to help them. I was wondering if you would possibly be willing to speak with them, and just help them flesh out some of the technical difficulties. I know it’s a big ask, but we would really appreciate it.

[@vigamortezadventures7972]

If only it was real time … and had live link overall great stuff potential !

[@NoorFilms786]

That's pretty accurate bro, is this DLSS render? Looks great

[@Jsfilmz]

nah bro thats that JSFILMZ secret sauce render, gotta have 16 RTX 4090's to pull it off so go tell the wife

[@NoorFilms786]

@@Jsfilmz 🤣 if I said that to her it, it might be the last convo we have lol, you gotta show us how you do it bro

[@Jsfilmz]

@@NoorFilms786 like i told you in our consulting sesh i do deprecated ray tracing. im making course on lighting ill touch up on it a little

[@NoorFilms786]

@@Jsfilmz nice, looking forward to it

[@RemDovans]

If you don't have that much room for set up, is it ok to place a camera slightly higher up on the wall so it can look down at the talent and be able to get the tablet from head to toe?

[@birdonfiremedia]

You can stagger the heights of the cameras, but all cameras need to be able to see the performers from head to toe throughout the entire range of motion

[@Jsfilmz]

dude iphone 13s have such a wide angle you can really mocap in a tight space

[@user-pu5yy6pu9v]

Would it be enough to use only 2 iphone camera for filmmaking? I have iphone and ipad

[@Jsfilmz]

kzbin.info/www/bejne/j3ucfH6Qo6mVq9E

[@nishadpawar1915]

I need to ask, if the characters are predefined in MoveAI or we can create our own characters?

[@basvandeneijkhof7230]

NIce. It would have been great if you did another pass and came in closer so you could get a better appreciation of the body movements.

[@Jsfilmz]

i tried but since they move in space alot zooming in and out would be too distracting, i wanted put them in the middle the entire time full body head to toe

[@KwasiAnimationStudio]

solid and i like it...not sure how long it took for you to acquire that many iphones...[money right] but this is nice....all day cool!

[@Jsfilmz]

99 percent of my family uses iphones so not long hahahaha but for this shot move ai let me borrow

[@FrisaacFit]

The render from 10:14 onwards blows my mind

[@Jsfilmz]

man u dont like my face? lol jk!

[@FrisaacFit]

@@Jsfilmz it's great but doesn't blow my mind 🤣

[@Jsfilmz]

@@FrisaacFit hahahaha

[@zeroy]

very impressive! What would be the minimum number of phones required, is 6 really what you need?

[@Jsfilmz]

3 two cameras one remote

[@zeroy]

@@Jsfilmz be good to see what results can be achieved with only 2 cameras, thanks for your reply!

[@Jsfilmz]

@@zeroy tons of people on discord sharing their work with 2 cameras :) go join up

[@zeroy]

@@Jsfilmz Will do!

[@Javawok]

this is sick! beautiful performance! whats the minimum number of phones you can use if you dont have 6 iphone 13 pros ? XD

[@Jsfilmz]

3

[@SagunManandhar]

Hi, Love it! BTW, could you tell us how much you had to pay for this 6 camera setup ?

[@Jsfilmz]

i think they changed their price idk what it is now

[@jamesalxl3636]

does this capture face movement too? lip movement etc?

[@LightWorkerBass]

That’s cool you can use iPhone 8 but what about facegood / iclone facial motion cap. Can you use iPhone 8 too or has to be 12 or up?

[@anthonyganjou2485]

You can use any model from the 8 upwards and loads of people including Jae have tested facial animation integration. It works with most facial tools and also works if you are using a HUD

[@kuperperdavid2099]

Iphone is device that I can install apps. But what about setup on Gopro...? please help me !

[@mgastudio]

Hello, I would like to ask whether the actor's clothes are ordinary clothes or they are dressed like this for better quality in this shooting. Currently, the effect is very good, thanks for sharing！

[@Jsfilmz]

Yes I bought the outfits, you will want your top and bottom to contrast and make sure it doesnt blend with the background check out their docs bit.ly/moveaihome

[@eliteartisan6733]

Any reason why you use iPhone 13 instead of 11 since they both have wide lens? I have a tight space and plan on buying 6 iPhone 11s but definitely need you to tell me why exactly you needed 13 pros. I just dont want to buy the 11s then realize it was for nothing

[@Jsfilmz]

i know some people on discord are using 11s, I dont think phones can change that much tbh im sure you will be okay with 11s, i have the 13pros. Only thing you have to google is overheating problems, move ai as of right now shoots 1080p 60FPS, depending on where you live that might cause some phones to overheat

[@jnanashakthidigitals]

How did you used it in iclone?

[@24vencedores11]

What's the difference between using iphone 8 and go pro? I just need to know if the result is the same.

[@anthonyganjou2485]

The result is the same

[@smepable]

Is it possible to use fewer cameras?

[@Jsfilmz]

kzbin.info/www/bejne/j3ucfH6Qo6mVq9E

[@soundcoaster3280]

Hi, can i ask for some sport/fight acting with dynamic movement in the future? And is it possible that shining floor causing feet sliding? I'm considiering 6 iphone x rig thats why im asking

[@anthonyganjou2485]

There’s loads of sport and fight clips on our KZbin and Vimeo channels. Shining floor shouldn’t create foot issues

[@soundcoaster3280]

@@anthonyganjou2485 then what is the reason cuz in other vids feets looks almost perfect.

[@anthonyganjou2485]

@@soundcoaster3280 most likely the closeness of the show colour to the floor

[@Jsfilmz]

dude im trying to find talents here in vegas but most are in LA :(

[@VictorTrifan]

As much as i know that this is the way to do it without the suit, it will take a while to buy 6 iphones a get a big enough room. So, for the moment, i will be using the other alternative. It will be less good, it will take a lot to clean it, but it is what it is

[@Jsfilmz]

yea iphone 11 has wide angle lenses too so u wont need bigger room

[@VictorTrifan]

@@Jsfilmz, I'll do this one day

[@birdonfiremedia]

I believe 3 phones was about the tipping point to compete with the quality of an Xsens suit. 6 Will help improve the results further, especially when capturing more than one person at a time, but you can definitely get good results with less!

[@Jsfilmz]

@@birdonfiremedia lighting and outfit super important to

[@VictorTrifan]

@@Jsfilmz i bet you're going to get those boots oneday :))

[@spacejourneywaves5420]

Is this possible with live link?

[@unrealdevop]

Nice, it's not quite up to par with the $20k+ optical camera setups from what I am seeing here but it's definitely better than what I've seen from undoctored Inertial Suits....and significantly cheaper too. I don't personally have much experience working with any of those setups though, so I could be wrong...I don't quite have the money to be investing in every form of mocap though so it's hard for me to say for sure. I will say though that I've personally worked with a Mocap studio and their animations were done using an expensive optical camera setup and those animations I can say were a lot cleaner but they were just doing locomotion animations for us.

[@Jsfilmz]

i would like to know a 20+ optical camera setup tbh

[@unrealdevop]

Not 20+ optical cameras I meant as far as price goes....some of them are over $5000 a camera and as you know it takes more then one.

[@marksmanstudios2528]

how do you use it on pc, i cant find a way to install on my pc

[@marksmanstudios2528]

Nevermind, i found out how. Awesome vid by the way

[@tahanymansour9931]

Is it possible to design a character for a young child in iclone? I need this because I am a content creator for children on KZbin

[@innanoshe]

They really need a solution for the feet sliding. Isn’t there something you can process the data through?

[@Jsfilmz]

blender, maya, iclone, motionbuilder whatever else takes fbx

[@ekmaukaKEJRIWAL]

The results are awesome . But what if you have a Android 😅

[@Jsfilmz]

super easy, go to your android device, open up web browser, type in amazon.com search for iphone 8 used, buy 3 iphones Wham Bam thank you maam!

[@preetikaur511]

Thank you#jsfilmz can you provide us these fbx files?

[@Jsfilmz]

yea let me ask

[@preetikaur511]

@@Jsfilmz 🙏

[@OldKingMaple]

Is there a reason why you use Iphone 13 pros instead of iphone 8's?

[@Jsfilmz]

kzbin.info/www/bejne/j3ucfH6Qo6mVq9E

[@kameleonlight]

Can it be used with android?

[@Jsfilmz]

yes

[@albi-tz4dj]

How can we use android?

[@Phantser]

Is this all for free?

[@music_creator_capable]

Hello ^^

[@24vencedores11]

No tracking fingers?

[@Jsfilmz]

it tracks fingers but you need to be close to cameras for good results as you can see here the talents needed alot of space to move

[@ndiagacxsse]

now I just gotta find 6 iPhones 💯

[@Jsfilmz]

invite some friends over

[@konraddobson]

Only ios?

[@MrGTAmodsgerman]

This looks too complicated when there is PlaskAI or Deepmotion or simular

[@Jsfilmz]

ive used both yes those systems are easier to use but the quality compared to this one, you will have to see yourself sign up for the free 2 mins

[@MrGTAmodsgerman]

@@Jsfilmz I sadly don't have any Iphone, so i am out any way

[@NeroForte_]

its pricing is ridiculous. SUCKS

[@Jsfilmz]

its not $30 a month anymore?