Real-time Full Body Webcam Mocap in Unreal Engine - Dollars MONO Tutorial

[@gculley9720]

This is strange. the downloads do not come in files with the file names in your video.

[@duz_gen]

I've checked the updated files. Your downloaded files now look like this: "Dollars", "Dollars_Metahuman", "Dollars_MONO" The only change is the removal of the "DollarsMarkerlessUE" folder, and now this file downloads directly as "Dollars" In the video, I showed how to copy the "Dollars" folder from inside the "DollarsMarkerlessUE" folder into the "Content" folder. But now, things are simpler. The file directly downloads as "Dollars", so all you need to do is copy the "Dollars" and "Dollars_Metahuman" folders into the "Content" folder. Hope this helps!

[@TronikXR]

Alot of companies are about to be put out of business. Most of us have been just trying to find some decent waist up mocap options. This including the face makes it beyond amazing. I purchased a license halfway through your video. Thanks!

[@duz_gen]

Happy you liked it, good luck with your mocap projects!

[@AnikenSkiwalker]

So I am saving up money to get a rokoko suit. Is that a good idea?

[@tongzhouwarrior]

Thank you for your coverage for this app. I really am thinking of starting to mocap soon and these kind of reviews of different products and services gives me a good idea about my options and price range.

[@duz_gen]

awesome to hear it's helping you! you're welcome and best of luck as you dive into mocap 👍

[@pacificostudios]

I love the ability to shoot with a good camera and then doing the mocap in post.

[@duz_gen]

Yes, the winner is video footage... much better results than a webcam and more suitable for mocap.

[@pacificostudios]

@@duz_gen That's good to hear. When you already have good camera gear, it's nice to be able to take advantage of its features.

[@tomimartikainen6689]

sweet, perfect timing as I start building our first public game next week. Perfect software for indies. Definitely going to purchase it. Thanks for bringing this into my attention :)

[@duz_gen]

You're welcome and best of luck with your game. Happy new year! 🎉

[@jac001]

really great bro, got it working by watching the vid a few times!

[@duz_gen]

Glad it helped! if you run into any issues give me a shout

[@CodyBurke3D]

Hi Duzgen, thank you for the tutorial, works perfectly in 5.4! Would you be able to help me use the metahuman skeleton on a custom character? Or use Dollars Mono with another rig, like from Mixamo?

[@Audiobooks-hy7cc]

We can't record animation with Take Recorder? Thank you for the video.

[@ayushkawalgaonkar2318]

Hey your tutorials are amazing and very helpful for begginers like me 😄. I have a question, How can i composite metahuman animation in real life footage ? Like some of the virtual influencers do? I tried to search on whole internet but not able to find any tutorial on it, it will he very helpful if you make one of those 🙌🙌🙌

[@duz_gen]

Thanks! glad you liked it 🙌 so when you say "real life footage" are you talking about those super realistic scenes and virtual influencers like codemiko? drop an example, I'll totally check it out!

[@ayushkawalgaonkar2318]

@@duz_genI meant footage(video) recorded on phone or camera, like filmmakers make CGI and VFX effects and merge it with raw video, one of the example is @lilmiquela

[@ayushkawalgaonkar2318]

@@duz_gen I mean footage (video MP4 format) captured through phone or camera. Like filmmakers add CGI and VFX effects in raw footage. One of the example is @lilmiquela you can check her posts and reels.

[@duz_gen]

My guess is that she uses real people in her pics and puts her own face on them with photoshop. If I were a virtual influencer, I'd do the same thing. Creating everything in 3D and making it look photorealistic? Tough job. And check out her vids closely, those backgrounds aren't real spots, but 3D animations. She might be using Unreal Engine.

[@themachinist1000]

This is a great tutorial, thanks so much! The only bit I can't figure out is how to capture the mocap animations with take recorder and then get them onto my metahuman. How do you do this?

[@duz_gen]

Glad you like it! You can use window > cinematics > take recorder Please take a look at this: kzbin.info/www/bejne/rqK3ooqhZs-Ih5I

[@eiji24g]

Thanks for the video! This is very helpful. Did you do setting IPaddress etc for BP_DollarsReceiver?

[@duz_gen]

You're welcome! No, I didn't. It's already set up, you don't have to manually enter the IP address for anything

[@AnikenSkiwalker]

So I am saving up money to get a rokoko suit. Is that a good idea? Or a waste of money.

[@adithyas4362]

the blueprint inside the dollar metahuman folder is throwing a ton of compile error for me :/

[@Julian-B]

Thank you for this insight! It would be also interesting to see how to integrate a custom made character (for exmaple in Character Creator 4) into this MoCap system. Character Creator 4 offers an Auto Setup for UE which already includes the rig for body and face. I wonder if Dollars MONO MoCap system is able to work with this.

[@duz_gen]

You're welcome! I think what you're looking for is here kzbin.info/www/bejne/hHXWnYJtnr6YqtE

[@bochenkoo4794]

While im first opennig the dollars mono app, the Unreal is OFF in the application, what should i do?

[@itzarcade5141]

same here what should i do?

[@bochenkoo4794]

@@itzarcade5141 found the solution, go to the settings in the app and check the box with unreal ip, hope it helps you

[@bochenkoo4794]

@@itzarcade5141 Found the solution, go to the settings in the app and check the box where it say Unreal, hope it helps

[@bochenkoo4794]

@@itzarcade5141 Check in the settings in the mocap app if you have checked the box where its says ,, Unreal,, hope it helps

[@rec-trick]

good work but u can sync 3 camera in time for scan all pose from back and front and more camera for face reaction ?

[@duz_gen]

It supports only 1 camera.

[@scobelverse]

this is great, but there has to be a better way to set this up with your own metahuman than the process you described. if there's already a template project with it ready to go...no way to just migrate?

[@duz_gen]

I was thinking about this idea while working on the video!😀 Tried changing a few files, thinking it should work but didn't get the result I wanted. Setting up body mocap is easy but when it comes to face mocap it takes a bit more time and seems a bit complicated. Perhaps dollars mocap might figure it out soon.

[@enriquemontero74]

thank for the tutorial , The creator of this plugin should try to place some type of smoothing or some type of control of the speed of the animation in real time to have more control of the nervous movements. I wish he implemented this, it would be even better.

[@duz_gen]

Great suggestion, thank you! Let's pass it on @dollarsmocap

[@DhakaDhamaka]

the thumbnail 🤣🤣🤣face fingers body 🤣🤣🤣

[@ペレアロフニキータ]

Thank you for the explanation!

[@Vlogdelguia]

amazing lord, i love you for you tutorial i need this

[@duz_gen]

thanks buddy, glad you like it!

[@recaia]

i can add 2 camera for frond and back body + i camera fore face reactions al in one record ?

[@diluciousOK]

Thanks for sharing this amazing tool

[@SUBHIHADE]

can we record the capture for a metahuman and then record another one for another character ?

[@Rizwan-Ashraf]

can we use iPhone for Facial and Dollar for Body motions together ?

[@duz_gen]

Yes, you can. Start by setting up a body mocap, then move on to a standard live link setup. If you want to get better performance for the body and head, just turn off the 'head rotation' option in the live link settings.

[@artunduzay]

Can you make a video about it? I think Dollars' face mocap performance is lower than livelink. Body mocap with dollars and face mocap. It will be much healthier to do it with Livelink.

doing face animations and body animations separately has always made me very tired. i should definitely try this thanks

[@duz_gen]

figuring out the best workflow can be a bit of trial and error. if you're using an iphone I recommend trying livelink + dollars mono. It's easy to set up and the results are pretty good

@@duz_gen I will try. thank you for the advice

[@zanderwhiton1235]

@@duz_gen Can you make a video trying livelink + dollars mono?

[@jephbennett]

Was there not an option to move the mouth line onto your mouth position on screen? That could improve the capture and matching of your speaking and mouth expressions, no?

[@duz_gen]

The mouth line is automatically adjusted by software, no tweaking allowed. In the new version, 'facial capture sensitivity' has been added, which improves the effectiveness of facial capture compared to the previous version.

[@pilzburger6905]

wehen i put the folders into my project folder and i open the project they are not visibable... the programm is working but i cant find the folders in the content browser

[@markcool383]

Dollars mono now has pauses every 20 seconds in the free trial, do you use something else now or you just bought the full version? Thanks Btw, great video!

[@duz_gen]

Thanks! I use the full version

[@davidin4052]

hola cuando hago eso del minuto 8:54 poner el esqueleto metahuman luego me sale errores de compilaciones muchos sabes pk sera¿

[@alexeypraprin]

Is it possible to capture movement like playing guitar hanging on the strap? I mean when you're not 'playing' an invisible guitar, but really do precise movenets with your both hands and then add a 3d guitar into the scene?

[@duz_gen]

It's good at tracking finger movements, as long as your webcam can see every finger. I'm not sure how well it would perform for activities like playing a guitar there could be potential problems.

[@himanshupetkar6224]

thanks man

[@gonggonglive]

does this only work with metahumans? can it work with other humanoid assets?

[@duz_gen]

should be work if they have metahuman skeleton

[@ParikshitBhujbal]

​@duz_gen will this work with any ue4 and ue5 skeleton based characters available on the ue marketplace ? Or is it restricted to only metahuman characters?

[@duz_gen]

@@ParikshitBhujbal It’s only for metahumans and I haven’t tested it with other characters. I'd suggest trying the free trial before buying to see if it works for you

[@deluxeluxs7559]

please make a video of using this app with blender i can't use bvh files in blender with my models

[@rohanphadnis6812]

Any idea how to record an animation and finetune it? I got it on Take Recorder, but i cant edit it to perfect it. Any idea how to fix?

[@AlphaLuk]

How to download DollarsMarkerlessUE and metahumans?

[@duz_gen]

"DollarsMarkerlessUE" now downloads directly as "Dollars". For metahumans, download the metahuman plugin from unreal marketplace.

[@cherchalihichem4730]

nice i like it good work

[@matin4595]

Is it possible to tweak the capchered data to enhance the quality ? Can you maybe make a tutorial on this??

[@duz_gen]

Editing metahuman animations in the sequencer is possible but not straightforward. I'll consider your suggestion thanks

[@QuarterWit]

@@duz_gen I would also love to see a video on this if you find the time!

[@TheLoreLabs]

step by step still having issues, how come some of the folders I download (name ones you did) have different names?

[@duz_gen]

I've checked the updated files. Your downloaded files now look like this: "Dollars", "Dollars_Metahuman", "Dollars_MONO" Actually, the only change is the removal of the "DollarsMarkerlessUE" folder, and now this file downloads directly as "Dollars" In the tutorial, I showed how to copy the "Dollars" folder from inside the "DollarsMarkerlessUE" folder into the "Content" folder. But now, things are simpler. The file directly downloads as "Dollars", so all you need to do is copy the "Dollars" and "Dollars_Metahuman" folders into the "Content" folder. Hope this helps and let me know if you need help.

[@TheLoreLabs]

thats amazing! it worked, purchased license through your link idk if youre an affiliate but just in case, definitely helped content creation for me today! @@duz_gen

[@duz_gen]

So glad to hear that! I don’t have any affiliate links. Best of luck with your content creation!

[@mancumbus]

Does this mocap record information on spine? Or spin will be stiff?

[@duz_gen]

Yes it does but the spine mocap data will be different depending on which mocap you choose because each mode captures the spine data differently.

[@SanjeevKumar-be4dd]

Hello sir can we record animation for metahuman in sequencer using Dollars Mono, I'm having issue with finger stretching .....can you help me in this issue....i want to make cinematic stuff.

[@duz_gen]

Hi, yes you can. Window > Cinematics > Take recorder Take a look at this: kzbin.info/www/bejne/rqK3ooqhZs-Ih5I Try wearing gloves so you can create contrast between your fingers and background.

[@nymund9783]

Is there a way to get the facial mocap data into Blender?

[@duz_gen]

I'm not 100% on this, but if you save your facial mocap data in BVH format, I think you can totally bring it into Blender.

[@dalewyatt230]

Great job!

[@pks001]

Bro, which camera are using for motion capture?

[@duz_gen]

I'm currently using the Creative Live 1080p V2 but don't like its narrow view. If you're looking for a wide-angle webcam, google it >> Spedal C920 Pro

[@pks001]

@@duz_gen thanks bro

[@digitalcloud-no]

What are your PC Specs to run UE that smooth ?

[@duz_gen]

Nvidia 3090, ryzen 5950x, 64 gb ram. For setup and system requirements, please check at 14:52

[@HadiMakhsoosi-qd2ej]

Can I save the mocap animation?

[@duz_gen]

Yes you can. Window > Cinematics > Take recorder Take a look at this: kzbin.info/www/bejne/rqK3ooqhZs-Ih5I

[@Celestial0Force]

Which version of the Unreal Engine are you using?

[@duz_gen]

Latest version (5.3.2)

[@tapikoBlends]

Can i use it with blender?

[@duz_gen]

Yes you can but there won't be any real-time integration. The only method for blender is to record the motion capture data as a BVH file and then edit the data in blender to create animations.

[@pavlohyba8159]

God bless you

[@urbnctrl]

How does this work with Kinect? Facecap?

[@duz_gen]

This one is for the webcams, but they have another software for Kinect called "Dollars DEEP"

[@anaelisa3365]

Whats the classical music name please

[@duz_gen]

A Far Cry - Josef Suk, Serenade, Op 6

[@vivektyagi6848]

Please show in iClone if possible

[@duz_gen]

Hi, hope this helps kzbin.info/www/bejne/iXyUYZSpn9KqsJo

[@ammy_46]

how to render this animation after mocap

[@duz_gen]

Window > Cinematics > Take recorder take a look at this: kzbin.info/www/bejne/rqK3ooqhZs-Ih5I

[@conciousnessofsteel6033]

Is it a one time payment system or is it a monthly payment or annual payment system of $99?

[@duz_gen]

It's one time payment

[@conciousnessofsteel6033]

@@duz_gen wow thanks

[@conciousnessofsteel6033]

I also noticed a control rig for Daz 3D. Do you have a video going over it?

[@duz_gen]

@@conciousnessofsteel6033 My channel mainly focuses on Unreal Engine so I don't have any content related to Daz 3D

[@LordoftheLoadingScreens-oo3wp]

Does anybody have an idea how I can record the animation in sequencer? Thank you for your help

[@SanjeevKumar-be4dd]

i'm facing issue with finger streching

[@duz_gen]

Window > Cinematics > Take recorder Take a look: kzbin.info/www/bejne/rqK3ooqhZs-Ih5I

[@manzorid]

I'm ready to kiss you, my friend, there is no limit to happiness, thank you very much, there is nothing in official documents about individual dollars folders, and files are downloaded without these folders. You are a great man, thank you a hundred more times.

[@ER3ADD]

bro you killed rokoko directly

[@duz_gen]

Haha, i'm considering a vid on rokoko's mocap software to see if it's worth the $240/year price tag

[@federicoest]

More than that, I'll skip buying a super expensive Iphone at the moment

[@Tallacus]

Funny Rokoko has a free AI tool that captures the data from video

[@Silentiumfilms007]

Free?

[@zoro.render]

💡🥳

[@Jagaballer]

Hello :) i was trying to bring the motion capture from your last Video: (Real-Time Motion Capture with a Cheap Webcam (or iPhone): TDPT - Unreal Engine 5 Tutorial) to the newes version of UE5 and bevor to UE5.3 it doesnt worked. the newes version just dont show the mop reciver plug in. Thats really sad because i like the new meta humans more and i wanted to use all of it in a lv i had created. I will now try to downgrade everything. All in all i have to say im a bit disapointed (not in you in general) Im a total beginner and i just want to start making movies, but its just so coplicate and it seems there is no good solution that is cheap. I have to say this version you present in this video actually doesnt look good, the metahuman looks strange and unnatural and shifts in the ground. The three D pose tracker from your last video looks promiseing, because i think it is because the cam is limiting the data for processing. To sad it doesnt fit in UE5.4. It is kinda strange that there is no good easy way to go with low effort. I dont get this. thx anyway let get back to work and downgrade everything ^^

[@Jagaballer]

Can you make a video in that you create a sceen with motion capture at a metahuman. Record this, change what you have recorded with a control rig and turn it in an animation that can be changed with a rig? Thank you very much

[@nimodali8703]

its free !

[@Tallacus]

As AI advances, suits are obsolete

[@duz_gen]

Couldn't agree more

[@AnikenSkiwalker]

Of course can doit! It's not free

[@truegamer2819]

why cant companies just use cameras and software's instead of having us spend thousands of dollars on freaking suits that could be a waste of money in the future

[@duz_gen]

MOVE AI has a camera-based motion capture app going for $500/month and that's for the standard dual-camera package. The problem is it's pricey and you'll also need cameras or iPhones, starting with 5 cameras would be a good start. People seem to like it but I haven't tried it yet. I'm curious to know if it's as precise as the traditional mocap suits

[@wikingodelaruta2083]

gracias capo sos un genio!!!

[@duz_gen]

Hey, muchas gracias, me alegra que te haya gustado. Saludos!