This looks great, thank you. I see the head/bust does move around a fair bit from the video. I would like to make some NPCs with a full metahuman body speak using this plugin. Will this jumpiness affect where the head/bust sits on the metahuman body skeleton?
@TheSicklyOne17 сағат бұрын
amazing thank you
@vladimirstanojevic3950Күн бұрын
Thank you!!
@xlipdevКүн бұрын
You are very welcome ^^
@thejetshowlive3 күн бұрын
Well DONE!
@xlipdev3 күн бұрын
Great to hear you like it 🤗
@inteligenciafutura3 күн бұрын
I am very interested in purchasing the product, but is it easy to install?
@xlipdev3 күн бұрын
Thanks happy to hear that you are interested ^^ It is basically copying and pasting the folder😄I can guide you if you need any help 👍
@inteligenciafutura3 күн бұрын
@xlipdev how much does it cost?
@xlipdev3 күн бұрын
@@inteligenciafutura It is set to "pay what you want" with minimum 19,99$
@inteligenciafutura3 күн бұрын
@xlipdev If it is within my budget, when I get paid this month I will buy it.
@xlipdev3 күн бұрын
@@inteligenciafutura No worries ^^ Feel free to message me on Discord or any social media whenever you need. I’ll be happy to guide or help with it
@MotuDaaduBhai3 күн бұрын
Wonderful update! 👏
@xlipdev3 күн бұрын
Great to hear that mate how is your project going with that custom HMC? ^^
@MotuDaaduBhai3 күн бұрын
@@xlipdev It's functional on my part. I'm just making sure the public can use it without any hassle on their system. I'm just worried about the pricing. Your pricing is unbeatable, man! 😜
@xlipdev3 күн бұрын
@@MotuDaaduBhai That's great! ^^ That's what I love about development.. there are always better ways and implementations for the same things to suit different needs. Ahhh, I'm sorry about the pricing 😅but I'm sure you’ll come up with something better👍
@MotuDaaduBhai3 күн бұрын
@ Healthy competition is always better. I get new ideas from your one and maybe, maybe you will find something interesting when I launch. Btw I did purchase your v2 on the release day. It’s really fast!
@xlipdev3 күн бұрын
@@MotuDaaduBhai Great thanks for the support man ❤happy to hear you like it I hate slow apps too ^^ aand thats nicee now I'm excited 😁please let me know when it is ready I will definitely get it and try 👍
@Andriy-e4b4 күн бұрын
It turned out amazing! Good tutorial!
@xlipdev4 күн бұрын
Great to hear that ^^
@Andriy-e4b4 күн бұрын
Have you encountered these errors when retargeting? IK Retargeter trying to retarget source bone chain with IK but it has less than 2 joints. IK Retargeter failed to initialize IK encoder, 'LeftToe', on Skeletal Mesh: 'SKM_Manny' IK Retargeter failed to initialize IK encoder, 'RightToe', on Skeletal Mesh: 'SKM_Manny' IK Retargeter bone chain length is too small to reliably retarget. IK Retargeter failed to initialize FK decoder, 'LeftClavicle', on Skeletal Mesh: 'he_woman_body' IK Retargeter failed to initialize FK decoder, 'LeftClavicle', on Skeletal Mesh: 'he_woman_body' IK Retargeter failed to initialize IK encoder, 'LeftDownArm', on Skeletal Mesh: 'SKM_Manny' IK Retargeter failed to initialize IK encoder, 'RightDownArm', on Skeletal Mesh: 'SKM_Manny'
@xlipdev4 күн бұрын
Hey, yea basically warning means, if you want to create a bone chain there should be more than 2 joints(bones) in that chain, so you need to double check your skeleton hierarchy probably there is something wrong so either you don't need to create a chain for these bones or you need more than 2 bones to create a chain
@Andriy-e4b4 күн бұрын
@@xlipdev I didn't change the metarig and set everything like you did in the video
@xlipdev4 күн бұрын
@@Andriy-e4b which engine version btw?
@Andriy-e4b4 күн бұрын
@@xlipdev tried 5.3 and 5.4
@xlipdev4 күн бұрын
@@Andriy-e4b It has been a while I recorded this video even i don't remember what i did 😆 Lemme double check and get back to you, btw if i remember correctly i had some issues with the animation i created in blender and tried to import into unreal in that way, my suggestion will be not to import rigyfy skeletons to unreal instead try to rig your character to ue5 skeleton from the beginning in that way you can use foot IK, control rigs and everything out of the box which is the best approach i believe which i showed here without using any blender addon kzbin.info/www/bejne/mWOtZ5SgbZmpqJY
@deygus4 күн бұрын
Hey Brother, such a fantastic update!
@xlipdev4 күн бұрын
Happy to hear you like it brother ^^ I'll compare it once again with the iPhone's famous depth camera and show you what the iPhone can't do 😎
@cjytber98574 күн бұрын
I’ve been waiting for the exciting moment you announced on January 7th, but due to the time difference, I only saw it today. And oh my goodness! Bro, you’re really a genius! I’m going to try this out and see if it works on characters other than MetaHuman. In fact, I’ve already switched to using CC4 for character creation. Anyway, thank you so much! The world is a better place because of people like you!
@xlipdev4 күн бұрын
Idk what to say 🥺 Great thanks for the kind words ❤I'm just a guy who loves developing some interesting stuff it is nice to see it helps many people ^^ I see some people were using existing metahuman animations on custom CC4 characters so it means yea this plugin can be used with them as well, please also let me know about how it goes 🤗
@SorenaSepehri4 күн бұрын
Can I buy this plugin with Crypto ?
@xlipdev4 күн бұрын
Good point! Currently ko-fi platform doesn't support crypto transactions so you can't 🥲But I'm planning to distribute from my website later on hopefully next month so you will be able to get it from there as well with crypto
@SorenaSepehri4 күн бұрын
@@xlipdev that's great.👌👍
@FX_AnimationStudios4 күн бұрын
very nice!! do you think this workds with unreal CC4 Based characters directly?
@xlipdev4 күн бұрын
Great thanks! I'm happy to hear you like it ^^ I've never used CC4 personally, but afaik CC4 uses a similar skeleton hierarchy and morph targets as UE MetaHuman. My plugin helps you create accurate depth maps from your video, which can then be turned into depth footage and processed through the UE MetaHuman pipeline. So, if you're able to use any MetaHuman animation with CC4, it means you should be able to use the performance output/result with CC4 as well 👍
@RobertKleinSk5 күн бұрын
perfect video, nice changes. What about 1 hour performance? Will it work? Will it generate 100k files?
@xlipdev5 күн бұрын
Nice to hear you like it ^^ I haven’t tested with such long performances, but technically, it should work to generate depth frames (though I’m not sure how MetaHuman performance processing handles this scenario). The plugin runs the specified parallel process count and completes all the batches within them first, then starts another set of processes, freeing up CPU/RAM resources. This approach should allow for processing an unlimited number of frames, as long as you have enough storage space for the corresponding EXR/depth frame files. But it might be a great idea to add an option for processing a specific part of the video, at least for depth map generation 🤔
@sagerfxstudio82155 күн бұрын
its so amazing ..... But how can adjust the Body Because when face have a movement the body also have a little movement. How can fix it ?
@xlipdev5 күн бұрын
Glad you like it ^^ Good point! This is related to control rig and animation processing more likely, for 5.4 you can check this video to understand how to proceed further kzbin.info/www/bejne/hJzFZXd7pL-ShLs For 5.5, there have been some changes regarding face/body alignment with control rigs that confused me, and I haven’t fully explored it yet. However, I believe there are videos out there, maybe this one: kzbin.info/www/bejne/onqQi4p3fsh_iKc can help
@burtsfilms5 күн бұрын
This is just great! Thanks for that Tutorial!!
@xlipdev5 күн бұрын
Thanks a lot for sharing kind thoughts 🤗 I tried my best to explain ^^
@איתייוסף-נ3מ5 күн бұрын
nice work!
@xlipdev5 күн бұрын
Thanks a lot ^^
@TheDarkestAgeUnreal5 күн бұрын
Genius! This is lowering the barrier of entry for performance capture in UE! This unlocks AAA facial animation with any camera, instead of needing an iPhone 12. Incredible work, and very clever solution!
@xlipdev5 күн бұрын
Great thanks for the kind words ^^ I hope Epic Games integrates that kind of approach and makes it possible for everyone ^^
@Chillopedia5 күн бұрын
amazing tool thanks
@xlipdev5 күн бұрын
Happy to hear you like it ^^
@Chillopedia5 күн бұрын
imagine having this level of detail in real time only using a webcam :o
@xlipdev2 күн бұрын
I will start discovering real time tracking very soon, let's see how it goes ^^
@cettura5 күн бұрын
Best plugin in 2025
@asdfhjsdf45235 күн бұрын
That's true, but it's only been a week
@xlipdev5 күн бұрын
Hey I tried to compile with 5.3 engine version, but unfortunately, seems like there is a big difference between 5.3-5.4 engines, It would require a lot of work😓 Probably I wont be able to support Unreal Engine 5.3
@cettura4 күн бұрын
@@xlipdev dont worry, i ll buy it anyway :) Love your effort, i dont need to buy an iphone now haha💪
@DrLeo-m4i5 күн бұрын
If your pc can run a real engine it’s already enough or does this software require more power?
@xlipdev5 күн бұрын
The plugin generates depth frames locally on the computer, so it does require additional CPU and RAM resources 👍 However, you have full control over the resources allocated by adjusting the Batch Size and Parallel Process Count before processing all frames 👍
@DrLeo-m4i5 күн бұрын
@xlipdev Ok but I also want to know if I pay the $20 is for life or every update I have to pay $20
@xlipdev5 күн бұрын
@@DrLeo-m4i No need to buy it again! Once you get the plugin, you’ll get access to all future updates. When a new version is released, you can use the existing link to download the new versions/content 👍
@DrLeo-m4i5 күн бұрын
@@xlipdev Frankly it’s cool, and I congratulate you for the time you give but if possible try to make it more accessible to the large number, I’m not saying to make it free but at least more accessible, me for example I’m in Togo and 20$ here is a fortune 😅 but I’ll do my best to get it as soon as possible Thank you
@xlipdev5 күн бұрын
@@DrLeo-m4i Great to hear you like it ^^ Lowering the price wouldn’t be fair to the current users at this point, but offering separate pricing for each version at a lower cost could be an option I believe if there’s enough demand for it 🤔
@insodimension9 күн бұрын
i have followed your previous videos about this concept, ever since i searched for how to use android instead of iPhone, and only your solution made sense. i am glad now you have finished the plugin. great work. will surely get it. I have a question though, i wanted to know after creating an animation using your plugin, is it somehow possible to apply on CC4 characters (character creator).
@xlipdev9 күн бұрын
Great thanks! I'm happy to hear you like it ^^ I've never used CC4 personally, but afaik CC4 uses a similar skeleton hierarchy and morph targets as UE MetaHuman. My plugin helps you create accurate depth maps from your video, which can then be turned into depth footage and processed through the UE MetaHuman pipeline. So, if you're able to use any MetaHuman animation with CC4, it means you should be able to use the performance output/result with CC4 as well.
@i_need_a_job10 күн бұрын
와드
@johnnien210 күн бұрын
I have been trying to import a character into UE5 forever now, this will not work , because the head needs to be separate because of the morph targets for expressions. It is still very useful. Thank you!
@xlipdev10 күн бұрын
@@johnnien2 you are right 👍 if you want to rig the character to a metahuman skeleton then yes, you have more things to do 😄
@RobertKleinSk11 күн бұрын
Can you help me please? I imported the video to UE5.5, clicked Extract Video Frames and got this error: "It seems there's an issue with the video. Please ensure the video exists and check the logs for more details." Captured with Samsung Galaxy S24, different resolutions, H264, tried to convert it with ffmpeg, still the same error
@xlipdev11 күн бұрын
@@RobertKleinSk Can you jump into our discord server let's check, it would be nice if you can share error details from Output Log
@RobertKleinSk11 күн бұрын
@@xlipdev LogScript: Error: Script Msg: Traceback (most recent call last): File "<string>", line 1, in <module> File "C:\Program Files/Epic Games/UE_5.5/Engine/Plugins/Marketplace/FDFMancer/Content/Python\video_info.py", line 2, in <module> import imageio_ffmpeg as ffmpeg ModuleNotFoundError: No module named 'imageio_ffmpeg' LogScript: Error: Script call stack: /FDFMancer/ActionUtilities/EUB-FileMediaSourceUtilityAction.EUB-FileMediaSourceUtilityAction_C.ExtractVideoFramesWithManager <--- /FDFMancer/ActionUtilities/EUB-FileMediaSourceUtilityAction.EUB-FileMediaSourceUtilityAction_C.Extract Video Frames
@RobertKleinSk11 күн бұрын
yes I will join to discord
@xlipdev11 күн бұрын
I'm happy we fixed that ^^ Let me know if you encounter any other issue
@RobertKleinSk11 күн бұрын
@@xlipdev this was absolutely instant support 😀I appreciate it! Thank you!!
@vectorwang963212 күн бұрын
This is awesome! i have question, can the plugin work using the video like kzbin.info/www/bejne/rKW3aGuKm6mZjrc as input?
@xlipdev12 күн бұрын
Very good point! And yes! I actually shared a quick example on our Discord server that you can check out. I'll share a tutorial on it later! The results look pretty nice, but keep in mind that during MH Identity creation, you need natural poses of the actor (preferably front-facing and slightly to the left and right, without any facial expression). If your video provides these frames, you can achieve decent performance outputs!
@vectorwang963212 күн бұрын
@@xlipdev thanks, looking forward to your tutorials
@chelseapinxit13 күн бұрын
This is so awesome! i can't wait! Very cool!!!
@xlipdev13 күн бұрын
Great thanks! Happy to hear you like it ^^
@NoishiXzenTM13 күн бұрын
worst tutorial ever watch in my entire life, all modules has problems, nothing worked at all, the new plugin you made 20 dollars thats too much, only professional can afford student like cant even experiment, I have wasted my one day on this and did not have a single outcome, so bad.
@xlipdev13 күн бұрын
This repository requires coding experience if you are not sure what you are doing with your python env and your system of course expecting a magical outcome doesn't make much sense, here so many people have achieved very good results with this, you could ask questions in our Discord channel I’d be happy to help, as I have for many others, even maybe checking channel messages would help. Instead, you chose to express your frustration with this comment 😅
@NoishiXzenTM13 күн бұрын
@@xlipdev I made this possible free and without your repo, I cant share with you, but got something way better and easier, costs around 5 minuets
@xlipdev13 күн бұрын
@@NoishiXzenTM That's great I'm happy for you ^^
@mystpike13 күн бұрын
Thank you so much! This "zen" error mad me crazy! Do you know if there is a way to fix it permanently? The zen error is still there after restarting my PC...
@xlipdev13 күн бұрын
🤔 what is that "zen" error? you can try deleting Zen/Install folder (In AppData/Local i showed here in the vid) unreal engine will try to create these exe files again and maybe resolves your issue
@mystpike13 күн бұрын
@@xlipdev I meant to say that in my case, the crash report diagnostic is only about the zen folder. If I delete it, it works, and I can launch Unreal without crashing. But when I reboot my computer, UE crashes again and I have to delete the zen data folder again. I'm still investigating because I noticed no crash when executing UE with admin-rights, but doing that, I can't drag'n'drop files into my content browser or import animations into my project.
@nazariobiscotti801113 күн бұрын
the problem is that I'm still totally unable to create animation with that rig. It's a bit messy. I can't find any tutorial about creating animation by myself with that thing rigified
@xlipdev13 күн бұрын
You should rely on Unreal Engine's animation pipeline to create animations with the Unreal mannequin skeleton, as it provides access to control rigs, blend shapes, and more, making the process much easier. However, some tutorials still use Rigify and import Blender-created animations into Unreal. Keep in mind, though, that the bone/joint systems in these two software are different, which makes the process quite challenging 🥲
@nazariobiscotti801113 күн бұрын
@@xlipdev thanks, I already tried that, unfortunatly i cannot mirrorize animations in that way, can I?
@xlipdev13 күн бұрын
@@nazariobiscotti8011 Nope, animation keyframes cannot be mirrored as I did for the skeleton in this video I believe. However, if you have a character rigged to the UE5 skeleton, you can use animation retargeting and various Unreal animation features, which might be more helpful than trying to import animations created in Blender
@ivonmorales265413 күн бұрын
I am very happy that you continue in this field of animation, it is the Achilles heel of 3D production... On the other hand, I don't know if you dare to develop the same thing but in full-body animation. And like the betamax, the VHS and the DVD player, the motion capture equipment goes to the landfills😁 Thank you very much friend for sharing and also for selling your product so cheap.
@xlipdev13 күн бұрын
Thanks to you for your kind words ^^ I actually started developing the plugin after your comment and didn’t expect this much attention tbh 😆There are many apps and AIs out there for creating body animations, and I’ve seen some great results! Currently, I’m not planning to dive into it, but let’s see how it goes. Thanks again for the appreciation it means a lot!
@forgiven8816 күн бұрын
thank you
@xlipdev16 күн бұрын
You are very welcome ^^
@halekurtoglu758416 күн бұрын
That's too impressive!
@bluedott_vfx17 күн бұрын
Saw my comment too 🎉🎉❤❤
@xlipdev17 күн бұрын
You were the first one who comments ^^ ❤
@bluedott_vfx16 күн бұрын
@xlipdev Love your work 😊
@oblivion150118 күн бұрын
Thank you very much. I always wanted to make cinematics with human characters but even if i animate the body it would be useless without facial animation. This might make my dream come true. Btw will it work with samsung mobile cameras? Ik thats under the goal of this project but just making sure! Thanks again!
@xlipdev18 күн бұрын
You’re very welcome! ^^ Yeah, facial animation is key to bringing a character to life, and that’s exactly the idea! Any camera will work with any resolution!
@hoseynheydari290118 күн бұрын
AFTER 3 MONTHS YOU ONLY SOLD 75 CAUSE ITS GOOD BUT NOT 20$ GOOD IT WORTHS MORE LIKE 2$ LOWER YOUR PRICE OR REALESE IT FOR FREE THATS WHY GITHUB WAS MADE TO MAKE THINGS FREE AND EASY FOR DEVS NOT TO MILK THEM IF PPL HAD 20$ TO SPEND IN THIS THEY MIGHT ASWELL BUY AN IPHONE AND FLIP YOU OFF CAUSE THOSE WHO WANT THIS METHOD ARE HERE CAUSE THEY HAVE NO IPHONE
@xlipdev18 күн бұрын
Have you ever checked other facial capture related software or equipment prices...
@hoseynheydari290118 күн бұрын
0:10 WELL LOOKS LIKE IT NEEDS TO BE FREE FOR EVERYONE NOT FOR MAKING 20 FREAKING $ PER PURCHASE ITS MORE LIKE 2 THAN 20
@xlipdev18 күн бұрын
Bro no one forces you to buy it, why are you so triggered with this
@hoseynheydari290118 күн бұрын
I SUGESST TO YOU MAKE IT 2 $ ONLY OR FREE AT ALL
@hoseynheydari290118 күн бұрын
TURKS ARE SELFISH JEW WORSHIPERS
@nyomanbandarayani683018 күн бұрын
Great plugin man. But I'm looking for something like Quickmagic but for facial animation. Your plugin has a potential for someone that didn't buy Rokoko Facial head rig
@xlipdev18 күн бұрын
Thank you so much! From what I’ve seen, the Rokoko Facial Head Rig doesn’t quite match the performance capabilities of Unreal’s MetaHuman system. However, I’ve heard great feedback from users who utilize a head rig with this plugin and are satisfied with the results. Just to clarify, the plugin generates depth frames that can be used with the MetaHuman Animator in Unreal, so even raw video from an iPhone can be utilized effectively. That said, using an HMC (Head-Mounted Camera) makes the process much smoother and more efficient ^^
@cjytber985718 күн бұрын
Yeah! I saw my comment in the video! This trailer got me so excited. I’ve been debating whether to get an iPhone during the Christmas sale for motion and facial capture, but after watching this video, I’ve completely given up on the idea. I absolutely don’t want to use an iPhone anymore!
@xlipdev18 күн бұрын
Yea it was there ^^ I use my mcbook to make sure the window in my room isn’t opened all the way. So, there are definitely some good use cases for Apple products 😅
@Nevetsieg18 күн бұрын
Dude you BEAT APPLE !!
@xlipdev18 күн бұрын
I will make another comparison video for sure ^^
@zhongxiahousong192218 күн бұрын
that's phenomenal!!!!
@xlipdev18 күн бұрын
Thanks a lot!
@efebaranyaman464318 күн бұрын
good boi
@xlipdev18 күн бұрын
It is learning ^^
@TrailRunnerCroatia18 күн бұрын
So excited! 😍
@xlipdev18 күн бұрын
Me too 😆
@bunyaminkartal202618 күн бұрын
Dude, you continue to amaze me:D
@xlipdev18 күн бұрын
Thanks for the kind words ^^ I'll keep going 😆
@stilfuchs803118 күн бұрын
Haha amazing vid 😂😂
@xlipdev18 күн бұрын
Great thanks ^^
@inteligenciafutura19 күн бұрын
is it free or does it have a cost?
@xlipdev19 күн бұрын
@@inteligenciafutura The editor plugin I showed in this video is a paid version, but I will update the repository I shared earlier once the release is out 👍