VR Mocap for Unreal Engine - Quick Start Video

[@jmfigueiredo]

You have all my respect for the work you did and for your effort in this project, thank you so much for sharing to us.

[@DeadsunPrime]

This is legit the best raw tracking I have seen. So much better than the mocap stuff I used in school.

[@Megasteakman]

Oh thanks! Yeah, I was watching the UE animation week presentation, and I was shocked at how much clean up the optical mocap systems needed. I feel like sometimes this system is cleaner out of the box (as long as the trackers don't start floating away).

[@MrJonathanwolff]

This is such a generous gift to the mocap community. Thank you. Excited to try it soon. Just wondered if at any time it might be possible to configure with rokoko gloves (cheapest and can be used independently from suit) and the iclone custom character skeleton for more stylised avatars. Anyway thank you so much for creating this.

[@Megasteakman]

I would love to, but unfortunately I don't have any gloves. I think it would be pretty easy to modify the anim bp to remove the current hand controls (and would look way better).

[@MEDIARUSS]

Very nice! The facial expressions work very well. You can see how important it is that rigging for the face as done with Megahumans maks a lot of difference in facial expressions. The work you did is outstanding.

[@FARAJSCHOOL]

Great stuff .. thanks for sharing and subscribed already 😊

[@BoristheBlade]

You're a legend for making this Edit: FYI the link to the documentation says 'Page not found'

[@Megasteakman]

Oh thank you so much for the heads up! Just updated it, but here's the link if you don't see it! github.com/Megasteakman/MegaMocapVR/wiki

[@rochipo77]

this is amazing, props to you dude, thank you

[@orbitalprime3329]

Dude......thank you

[@thomasirvins1872]

Hi sorry to bother you, but do you know how to set this up with the vive facial tracker/eye tracker? I am really confused with how to even get the avatar to make any facial movements with it. Thank you for your video, I would be really grateful for any advice you may be able to share.

[@Megasteakman]

Hey, no problem! I might not be that helpful, but I think I saw an SDK for the vive face and eye tracker on their website. I assume it would be a matter of downloading that, getting it into this project and getting the data that it captures into the anim bp of whatever character you are looking into controlling. I should have eye controls visible in the CC3 set up, but for metahumans you might need to set up a remap asset to get the data into the blendshapes on the character. I hope this helps!

[@thesparks007]

Man that is awesome. The way mocap should be. You the man ❤️

[@briannowaye]

I’m gonna be doing this to an exact, and try it with a “James Cameron avatar Na’Vi”

[@AndrewBlaze-t7k]

I wish I can have this I could have this, this is so cool and interesting

[@syntheticorchestra]

Incredible. I always wanted to pick up some of the pucks and try out some mocap, but the entry level so far has been expensive and tricky. This looks like it solves both those issues and the system looks really well made.

[@Megasteakman]

Hey thanks! Also, BTW, love your arrangements!

[@ScientiaFilms]

So cool it's free! considering getting it. Would love to use this for film creation.

[@iBeyond_dev]

OMG this is so cool.

[@JhulowNT]

Absolute legend! That makes me want to jump in and buy all that mocap stuff i've been wanting for so long for my project! thanks a lot sir!

[@wakinguniverse7418]

Waking Universe This is really awesome Kial. You’ve put a tremendous amount of work into this and it seems to work more seamlessly than I have seen any other solution for Vive. I love that it snaps in and out and the footsteps are a great touch. Good job man!

[@Megasteakman]

Oh thanks! I tried to make it smooth to enter acting mode so that you could take override a pre-recorded motion live. I think that will be pretty useful for vtuber/streaming.

[@ziqiangliu6589]

Hi I have a question This plugin Must there be a handle to run

[@diamondx4727]

When try to add Pawn to the scene this showed up(Unreal 5.1): The following member variables in blueprint 'Blueprint /Game/MegaMocapVR-main/MegaMocapVR/MMVR_PlayerPawn_BP.MMVR_PlayerPawn_BP' have invalid type. Would you like to remove them? Actor Profile Bone Names Struct Goal Transforms Struct Goal Transforms Upper Body Mocap Struct Live Link Tracker Set Struct Unknown Bone Name Alpha Struct Unknown Bone Transforms Struct

[@Megasteakman]

is your hierarchy correct? github.com/Megasteakman/MegaMocapVR/wiki#first-time-set-up

[@w00tbassman]

Incredible work. Great presentation dude.

[@Bluescott456]

Hi amazing work and greatly appreciated. Just one question debating whether to buy cheaper trackers instead of vive. Will it work with your codebase? Can you recommend cheaper tracker hardware solution? I have all other setup gear...thanks!

[@Megasteakman]

I haven't heard from anyone uses a slimevr or anything like that, but I think if it shows up as a live link xr device it should work. Unfortunately I have only used trackers (vive 1-3 and tundra)

[@UserUser-fd3gs]

Hello. I am dosn't have "MocapActor_component". Where i can find him?

[@Megasteakman]

This video is pretty old, and I've since rebranded the system, but searching for mocap actor typically brings up the relevant component for me. It's called MMVR_MocapActor_Component

[@KUREHA3D]

real estate jokes XDD your self awareness cracks me up. THANK YOU for putting out this demonstration, you're awesome!! wondering if i can use this to simply record animations to use in a cinematic later?

[@Megasteakman]

Yeah, that's what I designed it for primarily. I'm a filmmaker, and basically put all the tools I want in one spot (there's a really good flycam that uses an xbox controller and a vive tracker). You could also use it for VTubing as well.

[@thatboyrobin1556]

The real estate joke took me out 😂😂

[@AstraVex]

What are you using for the facial capture? Is that an iPhone? Whaaa?!

[@Megasteakman]

Yeah, it's an iphone! As long as you an X and above it should work with Live Link Face.

[@nomadhierarchy2596]

Thanks for the inspiration!!! Can this be done with the psvr headset and motion controller’s ???

[@Megasteakman]

If there is some way to get these as steamvr sources maybe, but I am pretty doubtful unfortunately.

[@bendiba28]

Thank you for sharing this, it's an amazing tool. is it possible to get an exemple projet already setup somewhere? thx

[@Megasteakman]

You can ask me on our discord, but I think learning the process of installing is important as it's good to know how to update your files if there is an update (I typically try to have two a month but it depends on the complexity of what I am building). It's very fast to set up, and if you prefer written instructions they are here: github.com/Megasteakman/MegaMocapVR/wiki#first-time-set-up

[@ashhishbhardwaj]

Can we livestream with this setup ? And do quest controllers work with this setup ?

[@Megasteakman]

Yeah, I built a lot of features with vtubing in mind. I don't believe quest works: people have told me that the quest hardware doesn't appear in live link, so you'd have to code in a special way to drive the goals for that.

[@kanfeng8010]

Great work! can't wait to try this, and where can I buy the head mount stand you used in the video? Thank you.

[@Megasteakman]

That is a standard deviation iphone HMC rig. It's extremely comfortable, and I like it a lot! If you aren't doing crazy motions, a gooseneck style phone holder that rests on your torso will also work.

[@DomainHeretic]

Can I do this with Valve index (without base station) and 3 vive trackers? Or is just buying the full valve index kit better?

[@Megasteakman]

You need base stations for the whole thing to work (its how the hmd and trackers get their position in space), and I definitely would recommend 3-4 trackers. Hope that helps!

[@fiendking3713]

I need your help bro I’ll cash app u for your time. I ain’t been to sleep in days working on this stuff.. pleeeeeze bro

[@Megasteakman]

You can try asking in our discord, but I am very short on time and can't guarantee an answer. discord.gg/mG5eGwdg

[@xXESproductionsXx]

This is awesome! Trying to save up for the equipment. Are there any spec recommendations for this?

[@Megasteakman]

I have been able to run Unreal on a ton of different computers, but having a lot of ram and a good GPU definitely helps. I think the lowest you would want to go is a 1080, an you would have to really scale back some of the graphic options.

[@RamblingGreek]

it's amazing how this level of technology is readily available for almost everyone

[@Megasteakman]

Yeah, I'm impressed I can make video game cutscenes circa 2017 in my bedroom!

[@lamjiajun3579]

Love the Video, how is the facial performance track?

[@Megasteakman]

It's pretty good: there are better facial performance capture methods, but often time I only need the fidelity of AR kit. You can replace those nodes if you have something more advanced.

[@siyacer]

Dumb ways to die

[@PhilipLemon]

I don't have a hmd and so can't perform a room setup in steamVR, thus my camera marker is under the floor and at an odd angle. Do I need a hmd to set this up properly or is there another way to calibrate position? I found a tute on using Aruco tags but not sure if that is a solution or not. I don't really have a need for a HMD other than to do a room setup so hoping to avoid buying one if I can.

[@Megasteakman]

There are apps that allow you to modify your play area on Steam, but I have never done this and would recommend using an hmd, but then again I just love VR so I'm biased.

[@RayTech70]

Do you have a new link for the documentation... the one you list is no longer present.

[@Megasteakman]

github.com/Megasteakman/VRMocap/wiki

[@sv3n546]

Incredible work with so much potential. Short question: what straps are you using to attach the Vive trackers to your body? Especially those flexible arm-straps.

[@Megasteakman]

I am using a combination of the rebuff reality trackstraps and some generic go-pro mount stuff with a 1/4 thread adapter.

[@DomainHeretic]

​@@Megasteakmanhow many Vive trackers are you using?

[@Megasteakman]

@@DomainHeretic The system will scale from no trackers (using a movement actor set up) to 7 trackers + controllers.

[@MrKiraBR]

That's awesome!!!

[@daviddoch4872]

That is amazing. If I flew you into Toronto could you set us up with this? Do you have a company name? This is the future friend, this is exactly what we writers have been looking for!!! WOW WOW

[@sundae6610]

is there any benefit upgrading to base station 2 for mocao

[@Megasteakman]

Not that I have noticed, but it is nice to be able to use 3 or four base stations. 3 Seems to be the sweet spot.

[@ZeroNineFilms]

I only got 3 vive trackers at the moment plus the index headset an index controlers is that enough to start up with till I can order another 3 trackers

[@Megasteakman]

I would say try it out. I wrote some code that allows you to not use a chest, and if you use the movement actor with no feet trackers it should now create footsteps for you. More trackers is better motion, but it's usable with less.

[@ZeroNineFilms]

@@Megasteakman thank you gonna give a try soon

[@diversityunityharmony]

Super great work! Wow!

[@动漫区漫哥]

Hello my dude,how to make animate with this method in blender?

[@Megasteakman]

You would capture in Unreal Engine, export an fbx of what you record and then import that fbx into blender, either for retargeting or for cleanup.

[@ScientiaFilms]

Would this work on SlimeVR?

[@Megasteakman]

Unfortunately I don't have slimes, so I'm not sure. They do look good though. If it were to work, I think using 5.1's version might be better since that is more based in SteamVR. In 5.2 I had to switch to openXR and its caused some problems.

[@FoxoticTV]

just nonchalantly showing off next level technology like it's nothing, and it's crazy to see how accesible/ plug and play this is too

[@lapinouu9489]

hello, can we save only the bones of the body to animate an actor on another software ?

[@Megasteakman]

Yeah, you can export an FBX of the character from Unreal, and you should be able to export the skeletal anim without the geo.

[@prodev4012]

Does this produce a better result than Mocap4All with 3 cameras?

[@vicrules6666]

Holy sheeeit. 🍻🤘

[@RDD87z]

YOU ARE AMAZING! Thank you so much.

[@ashal9213]

can this be used for vtubing?

[@Megasteakman]

Yeah, I use it for Vtubing. It has a lot of features for that, but as with anything you will want to customize it for what you are trying to do, so you may need to be familiar with animation blueprints.

[@李停-p1t]

谢谢！感谢分享！一位来自中国的用户

[@doriondouglas6176]

hey, is there any way to use this without unreal engine?

[@Megasteakman]

It's only usable in Unreal Engine, and that has a ton of benefits to speed and flexibility. I'd highly recommend using the engine: it's my favorite program by far.

[@TheFunDimension]

How do you fix the elbow awkward position!? How do you even download this files from github? Can I use a quest 2? can I put on a headset too? I have so many questions!

[@Megasteakman]

The elbow positions will be procedurally generated if you don't have extra trackers set on those goals. I answered your github question on another thread, but you download a zip file from the '< > Code' button. I don't have a quest 2, but I assume if it shows up as a steamvr device when plugged into the computer you should be able to use it, but I don't think it can be used with trackers so functionality would be really limited. You can definitely capture from within the headset.

[@TheFunDimension]

Holy sh!t, I managed to complete step 1 because you told me there is a green button there. So no. UE tutorials are extremely difficult because everyone who teach it believes you already know the entire alchemy symbolism. That’s why people quit this software. Thanks for the effort, I’ll give it another try, my sanity depends on it.

[@lucalanzi9345]

Incredible work yet such a lack of explanation in both the documentation and here. Spent hours trying to get it to work. I really am in awe of the work, but baffled by how its explained

[@Megasteakman]

What are you having problems with? Maybe you could join our discord and ask there?

[@lucalanzi9345]

Forgot to mention, you didnt explain how to calibrate when the actors (people wearing the trackers) dont have index controllers, and need to calibrate using the vive trackers

[@do_ob1815]

Question, how can you rotate the character to point in a different direction. Seems like my character is locked facing the same direction based off my play space. Any advice?

[@Megasteakman]

There's an exposed float on the player pawn so that you can rotate the vr space when entering calibration mode. I find I have to change the value occasionally when setting up my room scale.

[@do_ob1815]

@@Megasteakman Thanks man, I can see the amount of work this took. Congratulations on achieving this my man

[@zacharyberry4722]

incredible

[@andilontara]

can you make tutorial combination oculus quest 2 hand tracking + vive tracker + iphone for face tracking in unreal engine ?

[@Megasteakman]

Sorry, I don't have a quest 2. Also, this system doesn't use the oculus hand tracking sdk, and no one has told me if it's possible to use the quest 2 with vive trackers. I suspect it's not possible to align the lighthouse space and the quest inside out tracked space, but I am not sure.

[@andilontara]

@@Megasteakman ok..Thank you for the info

[@loregodd]

1. Sir do you have a discord server to share information on this with the community ? 2. Will this also work with quests?

[@Megasteakman]

Really sorry, but I don't have a discord. I will try making one this weekend, and will make a video announcement if I'm successful. I don't have a quest, so I'm not sure. You really need vive trackers for the system because 3 points of data (headset and hands) really isn't enough for full body. It's possible a quest would work with trackers, but I don't know how you would synchronize the quest playspace with the lighthouse playspace.

[@josepmduqueros7122]

Lot of thanks for sharing it, I'll test it soon, it looks superb!

[@aescapes]

Very cool! It's so strange to see the character become so alive.

[@appliedclinicalvr2359]

Any plans on updating this particular video? For those with UE experience, they can likely adapt to the changes to your Mocap system that have taken place over the past 15 months (today is 30 Aug 2022). But there is enough dissimilarity that I can't really follow along. Not your fault. I'm coming from Unity and things are a bit different. :-)

[@Megasteakman]

Oh interesting, there is a new UI but in my experience the steps are the same/things are in pretty much the same place. There is a UE5 quickstart video on the channel that uses early access, so maybe that one would help you out?

[@appliedclinicalvr2359]

@@Megasteakman Thanks for the quick feedback! I don't see a UE5 QuickStart video, but I am working with your UE5 Complete Set-Up guide. I'm only 9 minutes into it, but it's MUCH easier for me to follow thus far . This is likely a case of subtle differences between your product from last year till now combined with my unfamiliarity with UE in general and UE5 in particular getting in the way. If this was a tutorial that featured Unity instead of UE, I'd likely be able to adapt. 🙂

[@Megasteakman]

@@appliedclinicalvr2359 Ah good to hear that one is helping. There is also a wiki for the github page, and we have a discord if you have anymore questions!

[@argyleasia9932]

Very cool. Well done and thanks for sharing

[@augustdds]

This is so cool! Are you doing anything with a headset in VR? Thanks so much for the video!

[@Megasteakman]

You can actually use the system within VR, although most of the time I am capturing my face with an iphone. It's pretty fun to use in VR, although the movement actor doesn't work with that mode from what I remember.

[@AICreate90]

first open the unreal engine what do you choose? film production or game?

[@Megasteakman]

It doesn't really matter too much. I most often chose blank project.

[@AICreate90]

@@Megasteakman ok, thank's for information

[@shaunramkelawon]

wow thats super good actually - great work

[@HumbertoBessoObertoHuerta]

Hey! Thank you for doing this. You have a great way of explaining. Thanks for doing it CopyLeft! That’s the spirit!! Would you be so kind to answer some questions, pls? how many trackers you used? I saw 3. Is that right? And how many base stations? Do you have an affordable solution for moving the fingers? Have a blessed day too!

[@Megasteakman]

You need at least 3 trackers, 2 controllers and a headset if you want to do full body. I would recommend 5 trackers and 2 controllers. You only need two basestations, and a third might help, but you might still face some occlusion or disconnecting.

[@cryptostar1427]

It is my dream to reach this stage ! you made it man !

[@syneydesign]

So many people have this equipment so this is amazing!!

[@MeteorStation]

Really really cool. Incredible stuff - thanks for sharing it!

[@tljstewart]

Wow, this is phenomenal. You just put the unreal in unreal!

[@onethingeverything]

Amazing! Great work! looking forward to jumping in with this!

[@williamrobinson6055]

That's really cool mate, this kind of technology overwhelming benefits smaller developers so it's really cool to see you prioritising easy access. I just hope you get your fair share out of big companies that use this

[@Megasteakman]

Oh thanks! Yeah, I have spent a lot of money buying apps like this, and I just got frustrated with it and decided to make my own. I think it's important to be able to try this stuff out before you pay because everyone's set ups are different!

[@Tenchinu]

omg!!! this is exactly what i needed. thnk u :) any special specs the character has to have? im importing my models from blender, so i don’t know if any need anything besides the shape keys

[@Megasteakman]

It's designed to work with only a few skeleton types: you can read about it here: github.com/Megasteakman/VRMocap/wiki There are other modes that can take in any skeleton, but it's pretty hit and miss. I'm working on a dynamic control rig, but UE5 preview 2 seems to be broken, which has stalled me a bit.

[@bawgdan]

This.is.so.cool. Deep thank you for all the time and effort put into this! ✌️

[@heirapparent4802]

Do you need a headset?

[@Megasteakman]

I would recommend it for sure.

[@voidn833]

You sir, are amazing. Thank you!

[@cenkercanbulut3069]

I want to use this system for my research. Could you provide where you bought these all attachments besides the trackers ? That head band thingy and the chest belt. I have all other belts but that chest belt and head band is a must! Thank you in advance. Great great work! and free for all! You are a legend!

[@Megasteakman]

For the chest, I'm just using a generic go-pro chest mount with a 1/4 inch screw adapter for the tracker. The head band is the same thing, but the iphone helmet is a lot more expensive (but really good). It's the standard deviation iphone HMC.

[@CHNLTV]

Brilliant my good sir! Truly amazing work. You have unlocked so many people to dream up amazing worlds - Thank You!

[@Radkondarkner]

Just saw this, you are the man!

[@DanielWasserott]

I love this. Keep up the amazing work.

[@ChrizCx]

Hi, how can I use the oculus quest controls instead of the vive?

[@Megasteakman]

Sorry, just seeing this now, and not sure if I answered it elsewhere. I don't have a quest so I don't know how it appears in SteamVR, but if it appears as a live link xr source you should be able to track it.

[@SyphonXu]

This is incredible! I really like the calibration method. Still struggling to set it up in Unreal though.

[@Megasteakman]

Oh really, sorry to hear that. What part is failing for you? Are you able to see the trackers moving in the viewport on play?

[@SyphonXu]

@@Megasteakman Yes I see the widgets moving as I move the HMD and knuckles (trackers on the way). I'm seeing two issues right now: 1. getting error "The skeleton asset for this animation Blueprint is missing, so it cannot be compiled!" for the 4 AnimBPs. 2. Cannot seem to get InputAction IndexL_ThumbstickPress to trigger after adding its binding to project settings.

[@Megasteakman]

@@SyphonXu Hmm, I only included the skeleton asset for the iclone character, and you will have to use that skeleton on import for that rig. Are you using those or a metahuman? In my tests, metahuman worked right away in Unreal 5 without me having to relink the skeleton/any other assets. Otherwise I think you can retarget an animation blueprint to another rig, but you will have to change what the player pawn casts to in several places. The input system definitely is finnicky for the index controllers. I think that the joysticks won't work at all unless you set up both X and Y for both controllers as well. Anyways, if this doesn't help, feel free to reach out on twitter if you have more issues. I'm doing a big re-write this weekend for local multiplayer, so once that is done I might do a Unreal 5 demonstration from a blank project just to make sure everything is still working.

[@SyphonXu]

@@Megasteakman Actually just saw many missing references to /Game/MetaHumans. What I used is the metahuman sample from the Launcher "Learn" tab. Apparent not the same thing. Installing bridge and trying.

[@SyphonXu]

Figured it out! Other that all the missing plugins and references, the missing step is change actor "Animation Mode" to "Use Animation Blueprint" and set the anim calss. That's in your doc but not in the video. There are still errors but at least I got sth moving. Thanks!

[@DanielWasserott]

Is it already setup to work with the vive lip sync tracker?

[@Megasteakman]

Unfortunately I don't have one of those, so it's not currently set up for it. I designed the project to be used in VR as well as out, and so it's definitely possible (and I think it would be a really fun way to get data: I love in vr mocap personally).

[@IKnowTomLa]

Good work Buddy, miss seeing your face!

[@Megasteakman]

Miss you too man! We could recreate our Arnold 'sixth day' sketch as Arnold in mocap.

[@ElektronikGirlEpic]

Awesome work!

[@dahnsenwahnsenyes]

is this possible for blender ?

[@Megasteakman]

You can export any animations to an FBX, and it has blendshapes . Unreal is great for import/exporting of animation.

[@dahnsenwahnsenyes]

@@Megasteakman Thank you

[@fumakirikaze7618]

It's exactly that I need for several months. I'll test it and come back. Thanks a lot for that. 😊

[@DomainHeretic]

How did it go?

[@RoryMcMahonAU]

This is awesome! Nice work!

[@Mocha-Latte]

I really wanna do this, how different is unreal to unity

[@Megasteakman]

I would say knowing Unity well you could transition over pretty easily. I originally started building this in Unity, but don't know how to code using C# and built everything using blueprints, which are incredible. The biggest difference and limiting factor is Unreal requires you make a specific animation blueprint for each skeleton, so this project can only work with three types of skeletons at the moment.

[@UnrealEnginecode]

Isn't it necessary to get hmd to do this?

[@Megasteakman]

You can hack UE to not need an HMD, but I wouldn't recommend it. Also, if you get a headset then you have VR and your life will be better (or at least you can sell your whole system down the line to someone who wants VR).

[@UnrealEnginecode]

@@Megasteakman We are working on a game like valorant. For sajor stuffing, mage and warrior animations. so for the fingers and the whole body is 7 vive tracker and earphones and controller and steam base station like yours enough? Will the controller be useful for animations like sajor stuffing or do I need gloves?

[@Megasteakman]

@@UnrealEnginecode I typically just use 5-7 trackers and index controllers: it will give you rudimentary finger controls.

[@VisibleMRJ]

6:20 West World

[@shelltakeyoutoheaven]

ok wOw

[@ClemKlootShoops]

Just went and bought all the harnesses and straps for my uni lab - thanks for making your hard work open access. It's an inspiration to see someone create something like this and gift it to the world. Hope you are paid back a hundred fold.

[@Megasteakman]

Hey, no problem! I hope it helps you out, and make sure you share what you create!

[@123OGNIAN]

@@Megasteakman I was looking to explore this solution and was curently researching the vive trackers.If you have more vive trackers(like 13), how do you connect them to one pc? I doubt anyone has so many free usb ports. Do you use a big usb hub or something? No idea if those can support so many trackers though. Cheers

[@MaNeo01]

Thank you very much for this tutorial! It is very well explained and also the documentation is really useful. Did you use Unreal4? I've been following the tutorial on unreal 5, but I had some issues with VRMocap folder stuff, like index bindings missing and several errors (a lot) shown when importing the folder (Or it is just me, and I'm doing something wrong). I think I will do it on unreal 4 and if it works, move the entire scene and config then to unreal5 since I saw it worked for you :) See you!

[@Megasteakman]

I was able to get the system working on Unreal 5, but I did have to add those input bindings for the controllers and relink my anim bp skeletons. I will try to do another video about that process, but last time I checked it worked with a blank project. That said, I did a massive change for a local multiplayer update last night that I haven't checked on 5, but I'll try to do that tonight.

[@MaNeo01]

@@Megasteakman You are awesome, thank you!

[@Megasteakman]

@@MaNeo01 Sorry for the delay on this: finally got a new video out today for UE5 set up, but it should be the same process for 4.26. kzbin.info/www/bejne/maPZZ3R_l8aXidE

[@Noahyus]

Are you able to wear a vr headset when tracking in unity?

[@Megasteakman]

Yeah, you can use a VR headset for everything except the new movement actor. This project is Unreal Engine only however.

[@Noahyus]

@@Megasteakman Thank You.

[@JacobP81]

That is so cool!!

[@willgriffith4863]

is there any way to record these animations with a moving camera?

[@Megasteakman]

Yeah, the camera can be an entirely different tracker. You would just add both the actor and the camera to take recorder, although I don't think I've found a great workflow for using the spectator camera in sequencer. In the future I hope to cast the transform and values of the spectator camera to a regular cine camera which could be recorded instead.

[@willgriffith4863]

@@Megasteakman thank you! much respect for this mocap solution, recorded cameras will take this to a whole new level, can't wait!

[@PhilipLemon]

Thanks

[@Megasteakman]

Wow, thank you so much! I think you just gave the first donation I've ever received on this channel: I really appreciate it! Let me know if you have any problems with the system!

[@PhilipLemon]

@@Megasteakman Your most welcome. I was just blown away by all the work you've put in and how fantastically useful it looks. Got a bit of work ahead of me setting up :).

[@smfknj6010]

How’s it work in ue5?

[@Megasteakman]

It's great! Not sure if it works in 5.1 one yet, and its possible that it doesn't work because I haven't been able to test it yet.

[@smfknj6010]

@@Megasteakman thank you so much. Also, are you able you clarify, Is the live link you are using free in Unreal Engine, or is it the $1k reallusion plug in?

[@Megasteakman]

@@smfknj6010 It is all using Unreal Engine, and you can bring in CC3 characters if you want and drive those using SteamVR and Unreals Live Link Face. The only costs are the hardware costs of steamvr devices and an iphone.

[@smfknj6010]

@@Megasteakman right on! Thank you so much