How to use AI to motion capture with Move ai

[@Jsfilmz]

MOVE AI IS OFFICIALLY OUT IN THE WILD! $1 Per day read more about it bit.ly/moveaihome

[@visualpoetry3d]

This is the best thing that happened to indie filmmakers since unreal engine and quixel. Thank you for sharing

[@Jsfilmz]

Glad you enjoyed it!

[@RemDovans]

Was gonna do the research in a few weeks, thank you so much for making my life easier, looking forward to this

[@Jsfilmz]

YW DUDE!

[@leonaraya2149]

The results looks amazing. I really enjoy this videos.

[@Jsfilmz]

hey man thanks for that, comments like yours is what keeps me going because we all know its not the money adsense sucks lol

[@foyezuddin1632]

wow! that was just BEAUTIFUL

[@Jsfilmz]

thank you i really enjoyed this tbh i tried to tell a story in 3 minutes

[@NinoDefoq]

This is stunning!

[@brunopascualetti7011]

Crazy! Amazing work

[@Jsfilmz]

thanks mate!

[@birdonfiremedia]

Great video, thanks J!

[@Jsfilmz]

thanks dude!

[@williamweatherspoon4527]

Beyond Amazing!!! Good Work.

[@Jsfilmz]

yea everytime i see the raw results of move it makes me cry a single tear

[@vidayperfumes7514]

Just Amazing,thank you for showing us this .

[@Jsfilmz]

here for the ride man!

[@BrentLeBlancCG]

This is freakin' wild. Thanks Jae

[@brandongroce]

Incredible!

[@HarryClipz]

I got 3 iphones already and plan on getting 2 more. Can't wait to dig in.

[@Jsfilmz]

letss goo

[@HarryClipz]

@@Jsfilmz I just got the iphone 14 plus. Will the 14 plus work well or will i need the pro max with the third camera for better results? I am asking before i open the box or should i return it for the pro max

[@baymetromedia]

Gotta love it! Sky's the limit now!

[@infomaticfilms]

Love it!

[@Jsfilmz]

thx

[@RobinGrays]

Awesome... Thanks for sharing.

[@stevenbaker153]

Great video. So helpful. I can't wait to start using it soon

[@Jsfilmz]

Have fun!

[@구구-u6g]

Would it be enough to use only 2 iphone camera for filmmaking? I have iphone and ipad

[@Jsfilmz]

kzbin.info/www/bejne/j3ucfH6Qo6mVq9E

[@savage_Creations247]

Thank you Again brother

[@Jsfilmz]

Always welcome

[@suryakamalnd9888]

Amazing video bro

[@Jsfilmz]

oh thanks man!

[@24vencedores11]

Very nice video and good steps 👌 Now I understood clearly. Many thanks.

[@Jsfilmz]

Most welcome 😊

[@24vencedores11]

Hello dear friend. You actually don't say much about go pro. Is the result the same as iPhone?

[@AICineVerseStudios]

O man o man o maaaaan, like wow!!!! this is awesome!! Can we take to next level to apply to metahumans?

[@Jsfilmz]

dude they have like 17 premade rigs and you can upload your own. wait for my next video

[@AICineVerseStudios]

@@Jsfilmz definitely looking forward for this!!!

[@ericjones7300]

9:04 Can't find this anywhere. Is there a link? Trying to import into iClone for use on a CC4 character.

[@marksmanstudios2528]

how do you use it on pc, i cant find a way to install on my pc

[@marksmanstudios2528]

Nevermind, i found out how. Awesome vid by the way

[@supercolor222]

I wish you have the full video how to make it from the ground to finish.. man this is sick.....................!!

[@Jsfilmz]

that would be too long of a video man people dont have the patience lookin at some of my analytics people stop watching after 2-3 minutes lol

[@smepable]

Is it possible to use fewer cameras?

[@Jsfilmz]

kzbin.info/www/bejne/j3ucfH6Qo6mVq9E

[@RemDovans]

If you don't have that much room for set up, is it ok to place a camera slightly higher up on the wall so it can look down at the talent and be able to get the tablet from head to toe?

[@birdonfiremedia]

You can stagger the heights of the cameras, but all cameras need to be able to see the performers from head to toe throughout the entire range of motion

[@Jsfilmz]

dude iphone 13s have such a wide angle you can really mocap in a tight space

[@ramnicka_rk4]

Cool

[@mattmocap6499]

Did you already clean up foot animation with offset rig or only retargeting mocap for the sake of time?

[@Jsfilmz]

not alot of foot slide but i did filter some jitters and fix penetration some the bottom right of the video is raw result

[@TobiasLeanderOfficial]

Great video! also I'm really surprised with unreal engines groom physics, I gotta start diving deeper into unreal engine 😄

[@Jsfilmz]

this isnt groom broski its chaos

[@TobiasLeanderOfficial]

@@Jsfilmz oo I see, its crazy how performant it is while it would take quite a bit to simulate in traditional 3d software.

[@Jsfilmz]

@@TobiasLeanderOfficial oh yea hahaha for sure

[@hyperface2050]

@@Jsfilmz Great video. Amazing really. Still with respect to the groom, I"m not following. How did you get the hair to work the way it does?

[@Jsfilmz]

​@@hyperface2050cloth physx

[@nishadpawar1915]

I need to ask, if the characters are predefined in MoveAI or we can create our own characters?

[@eliteartisan6733]

Any reason why you use iPhone 13 instead of 11 since they both have wide lens? I have a tight space and plan on buying 6 iPhone 11s but definitely need you to tell me why exactly you needed 13 pros. I just dont want to buy the 11s then realize it was for nothing

[@Jsfilmz]

i know some people on discord are using 11s, I dont think phones can change that much tbh im sure you will be okay with 11s, i have the 13pros. Only thing you have to google is overheating problems, move ai as of right now shoots 1080p 60FPS, depending on where you live that might cause some phones to overheat

[@LinusKVisuals]

Excited to see it! What do you think about captury vs move ai ?

[@Jsfilmz]

guess time to compare em right

[@FrisaacFit]

The render from 10:14 onwards blows my mind

[@Jsfilmz]

man u dont like my face? lol jk!

[@FrisaacFit]

@@Jsfilmz it's great but doesn't blow my mind 🤣

[@Jsfilmz]

@@FrisaacFit hahahaha

[@LightWorkerBass]

That’s cool you can use iPhone 8 but what about facegood / iclone facial motion cap. Can you use iPhone 8 too or has to be 12 or up?

[@anthonyganjou2485]

You can use any model from the 8 upwards and loads of people including Jae have tested facial animation integration. It works with most facial tools and also works if you are using a HUD

[@Darksector88]

I already have an iPhone 12, of I pick up 3 iPhone 8's would they be cross compatible so you know? Like do they all have to be the same phone?

[@kennykudla]

Nice video ;)

[@Jsfilmz]

thanks kenny

[@NoorFilms786]

That's pretty accurate bro, is this DLSS render? Looks great

[@Jsfilmz]

nah bro thats that JSFILMZ secret sauce render, gotta have 16 RTX 4090's to pull it off so go tell the wife

[@NoorFilms786]

@@Jsfilmz 🤣 if I said that to her it, it might be the last convo we have lol, you gotta show us how you do it bro

[@Jsfilmz]

@@NoorFilms786 like i told you in our consulting sesh i do deprecated ray tracing. im making course on lighting ill touch up on it a little

[@NoorFilms786]

@@Jsfilmz nice, looking forward to it

[@kuperperdavid2099]

Iphone is device that I can install apps. But what about setup on Gopro...? please help me !

[@gooddimmi]

"I am the great Cornholio"😉

[@jnanashakthidigitals]

How did you used it in iclone?

[@zeroy]

very impressive! What would be the minimum number of phones required, is 6 really what you need?

[@Jsfilmz]

3 two cameras one remote

[@zeroy]

@@Jsfilmz be good to see what results can be achieved with only 2 cameras, thanks for your reply!

[@Jsfilmz]

@@zeroy tons of people on discord sharing their work with 2 cameras :) go join up

[@zeroy]

@@Jsfilmz Will do!

[@KwasiAnimationStudio]

solid and i like it...not sure how long it took for you to acquire that many iphones...[money right] but this is nice....all day cool!

[@Jsfilmz]

99 percent of my family uses iphones so not long hahahaha but for this shot move ai let me borrow

[@chriswatts3697]

Very cool resutls - how long did the whole procedure took? after recording...setting up implementing?

[@Jsfilmz]

week and a half im just one dude so hahaha

[@chriswatts3697]

@@Jsfilmz very cool man, thx for sharing

[@Jsfilmz]

@@chriswatts3697 yea man thanks for checkin it out

[@24vencedores11]

No tracking fingers?

[@Jsfilmz]

it tracks fingers but you need to be close to cameras for good results as you can see here the talents needed alot of space to move

[@rewwhiskas4234]

Awesome! This stuff is moving at such a rate at the moment. @jsfilmz - any idea about combining this with facial capture in the same shoot? Would be hoping to include an iPhone headrig but I'm guessing that will interfere with the tracking...

[@Jsfilmz]

yes ive tried it with facegood it works suprisingly

[@jamesalxl3636]

does this capture face movement too? lip movement etc?

[@VictorTrifan]

As much as i know that this is the way to do it without the suit, it will take a while to buy 6 iphones a get a big enough room. So, for the moment, i will be using the other alternative. It will be less good, it will take a lot to clean it, but it is what it is

[@Jsfilmz]

yea iphone 11 has wide angle lenses too so u wont need bigger room

[@VictorTrifan]

@@Jsfilmz, I'll do this one day

[@birdonfiremedia]

I believe 3 phones was about the tipping point to compete with the quality of an Xsens suit. 6 Will help improve the results further, especially when capturing more than one person at a time, but you can definitely get good results with less!

[@Jsfilmz]

@@birdonfiremedia lighting and outfit super important to

[@VictorTrifan]

@@Jsfilmz i bet you're going to get those boots oneday :))

[@OldKingMaple]

Is there a reason why you use Iphone 13 pros instead of iphone 8's?

[@Jsfilmz]

kzbin.info/www/bejne/j3ucfH6Qo6mVq9E

[@ademolatosin1528]

Hey man, Amazing stuff you are doing, always gets me pumped, I wanted to ask, is it possible to retarget Move Fbx to metahuman?

[@ademolatosin1528]

And how can I go about it?

[@ethanhinkle5369]

Could you do a dedicated video or test focused just on the current state of this technologies finger tracking capabilities? like in a normal conversational situation as opposed to a dancing sequence?

[@Jsfilmz]

like an exaggerated talking with hand movements like a speech?

[@ethanhinkle5369]

@@Jsfilmz Exactly! That would be a great test to see how usable the finger tracking is with this

[@Jsfilmz]

@@ethanhinkle5369 got it

[@SagunManandhar]

Hi, Love it! BTW, could you tell us how much you had to pay for this 6 camera setup ?

[@Jsfilmz]

i think they changed their price idk what it is now

[@spacejourneywaves5420]

Is this possible with live link?

[@funkyguy0]

Good job man, very good job. Results look amazing. Question, what are your thoughts between the results with this compared to Rokoko?

[@Jsfilmz]

someone actually compared it to their rokoko go check it out

[@innanoshe]

They really need a solution for the feet sliding. Isn’t there something you can process the data through?

[@Jsfilmz]

blender, maya, iclone, motionbuilder whatever else takes fbx

[@preetikaur511]

Thank you#jsfilmz can you provide us these fbx files?

[@Jsfilmz]

yea let me ask

[@preetikaur511]

@@Jsfilmz 🙏

[@Javawok]

this is sick! beautiful performance! whats the minimum number of phones you can use if you dont have 6 iphone 13 pros ? XD

[@Jsfilmz]

3

[@24vencedores11]

What's the difference between using iphone 8 and go pro? I just need to know if the result is the same.

[@anthonyganjou2485]

The result is the same

[@Native_Creation]

Very awesome, looks solid and an easy enough setup. How would you say this compares to Rokoko Video? Maybe a comparison video would be useful.

[@soundcoaster3280]

Hi, can i ask for some sport/fight acting with dynamic movement in the future? And is it possible that shining floor causing feet sliding? I'm considiering 6 iphone x rig thats why im asking

[@anthonyganjou2485]

There’s loads of sport and fight clips on our KZbin and Vimeo channels. Shining floor shouldn’t create foot issues

[@soundcoaster3280]

@@anthonyganjou2485 then what is the reason cuz in other vids feets looks almost perfect.

[@anthonyganjou2485]

@@soundcoaster3280 most likely the closeness of the show colour to the floor

[@Jsfilmz]

dude im trying to find talents here in vegas but most are in LA :(

[@vigamortezadventures7972]

If only it was real time … and had live link overall great stuff potential !

[@tahanymansour9931]

Is it possible to design a character for a young child in iclone? I need this because I am a content creator for children on KZbin

[@mgastudio]

Hello, I would like to ask whether the actor's clothes are ordinary clothes or they are dressed like this for better quality in this shooting. Currently, the effect is very good, thanks for sharing！

[@Jsfilmz]

Yes I bought the outfits, you will want your top and bottom to contrast and make sure it doesnt blend with the background check out their docs bit.ly/moveaihome

[@kameleonlight]

Can it be used with android?

[@Jsfilmz]

yes

[@albi-tz4dj]

How can we use android?

[@basvandeneijkhof7230]

NIce. It would have been great if you did another pass and came in closer so you could get a better appreciation of the body movements.

[@Jsfilmz]

i tried but since they move in space alot zooming in and out would be too distracting, i wanted put them in the middle the entire time full body head to toe

[@ekmauka-Inqalab]

The results are awesome . But what if you have a Android 😅

[@Jsfilmz]

super easy, go to your android device, open up web browser, type in amazon.com search for iphone 8 used, buy 3 iphones Wham Bam thank you maam!

[@konraddobson]

Only ios?

[@Phantser]

Is this all for free?

[@ndiagacxsse]

now I just gotta find 6 iPhones 💯

[@Jsfilmz]

invite some friends over

[@unrealdevop]

Nice, it's not quite up to par with the $20k+ optical camera setups from what I am seeing here but it's definitely better than what I've seen from undoctored Inertial Suits....and significantly cheaper too. I don't personally have much experience working with any of those setups though, so I could be wrong...I don't quite have the money to be investing in every form of mocap though so it's hard for me to say for sure. I will say though that I've personally worked with a Mocap studio and their animations were done using an expensive optical camera setup and those animations I can say were a lot cleaner but they were just doing locomotion animations for us.

[@Jsfilmz]

i would like to know a 20+ optical camera setup tbh

[@unrealdevop]

Not 20+ optical cameras I meant as far as price goes....some of them are over $5000 a camera and as you know it takes more then one.

[@MrGTAmodsgerman]

This looks too complicated when there is PlaskAI or Deepmotion or simular

[@Jsfilmz]

ive used both yes those systems are easier to use but the quality compared to this one, you will have to see yourself sign up for the free 2 mins

[@MrGTAmodsgerman]

@@Jsfilmz I sadly don't have any Iphone, so i am out any way

[@music_creator_capable]

Hello ^^

[@NeroForte_]

its pricing is ridiculous. SUCKS

[@Jsfilmz]

its not $30 a month anymore?