Currently plugin is in review, I will publish soon in fab hopefully ☺

@@smash9778 which engine version do you use?

@xlipdev 5.1.1

Thanks ^^ You need to enable Epic Games - MetaHuman plugin to import it.

@@xlipdev Thank you very much for the super quick and correct answer. I was apparently too tired yesterday to realize it, as I thought I had already turned it on.

@@satyaa999 you must enable metahuman plugin

Rica ederim ise yaradiysa ne mutlu ama en mantiklisi gosterdigimi uygulamak yerine "layered control" rig kullanmak

@@Ateruber I believe there is no restriction for GPUs overall for metahuman performances, it should work

I'm not certain yet 🤔but for the initial release, I’ll likely set the price between $15 and $25 (personal usage)

@xlipdev nice, cant wait for the release and the full tutorial 🫶🔥

This seems like an easy one, probably you didn't set a correct image path for the script please double check "input_image_path" (if you are trying to display) or "input_folder" (if you are trying to convert all images in that folder) and make sure you have'.png', '.jpg', '.jpeg' files inside that folder

Hello, I tried using a different computer twice as well, but the problem persisted.

could you create an issue in the repo with the scripts you try to run and the details, lemme check and help

btw can you try the path like ex: input_image_path = r".\images\some_frame.jpg" and adjust your path for the file or folder

@@xlipdev NameError: name 'image' is not defined PS C:\Users\Mukesh Babu\Documents\GitHub\New One\faceDepthAI-master> & "c:/Users/Mukesh Babu/Documents/GitHub/New One/faceDepthAI-master/.venv/Scripts/python.exe" "c:/Users/Mukesh Babu/Documents/GitHub/New One/faceDepthAI-master/face_mesh/create_single_sample_and_display.py" [ WARN:[email protected]] global loadsave.cpp:241 cv::findDecoder imread_('images/0001.jpg'): can't open/read file: check file path/integrity Traceback (most recent call last): File "c:\Users\Mukesh Babu\Documents\GitHub\New One\faceDepthAI-master\face_mesh\create_single_sample_and_display.py", line 37, in <module> image_rgb = cv2.cvtColor(image, cv2.COLOR_BGR2RGB) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ cv2.error: OpenCV(4.10.0) D:\a\opencv-python\opencv-python\opencv\modules\imgproc\src\color.cpp:196: error: (-215:Assertion failed) !_src.empty() in function 'cv::cvtColor'

Yes

😅 What's your wish?

@@xlipdev hmm would love to win the plugin or at least get it to try it out 😃, iv been following ur work for abit and got intregued, iv tryed ur approach through ur tutorial earlier but is abit finniky for mass use i feel, but this pluing solves that:) good job man!

​@@animian Done! Thanks for the kind words man ^^ It’d be awesome if you could try it out and share any feedback before I wrap it up, so I can ensure the quality ^^ Can you add me on discord

@@xlipdev nice nice, added u, tryed sending a msg :)

@@bsasikff4464 working on it ^^ but seems like it will take some time 🥲

@@manraytrace yea head/neck bones/controllers don't have correct backwards solve methods in the modules so they are not baked into modular rig correctly, the best solution actually is using "layered control rig" please try that you don't even need to apply what I did in this video

If you make a plugin for 5 buck i would drive to mark zuckerberg and proof he is an alien

You are welcome 😅 Seems like plugin thing will take time 🥲 I'm still discovering how to make it work with Unreal's integrated python and i didn't write many plugins for Unreal 😆

@@CG-yf4qi I didn't put it in the marketplace since I shared the full tutorial/process ^^ but yea good idea I will try to put it there

@@xlipdev ​ yeah there are only 2 handholding assets in marketplace as of now. based on what i see here, yours would prob be the best

I published it with some improvements as well ^^ www.fab.com/listings/abc24af2-7e72-4ae2-98f9-4c4464835929

@@황호준-c6u have you installed the requirements in README?

I use python scripts ^^ I shared the source code in description you can take a look

Yea, Unreal is getting stronger ^^

Yea the process is a bit manual for now, I will take time to convert into a plugin later on, basically you need python to run these scripts and that shouldn't be that hard you can follow the instructions in the repo README, if you have issues I can help

@@ivonmorales2654 Many thanks for the info and kind words ^^ I will definitely check those, there are many apps and AIs for body motion capture even for free, I think Nvidia is also doing something about it, if you have an iPhone, life is easier for facial capture for now, so yea capturing full body simultaneously is not a big deal, here is an example which is shared by @paperino0 here in comments and looks nice kzbin.info/www/bejne/fKGWgWOqiNOMY7s , but no ihpone no problem still you can use this video's pipeline for facial capture ^^

@@ivonmorales2654 I will try then ^^

@@josiahgil You are welcome ^^ Yes, head movement is also tracked by default during performance. Here is an official tutorial about how to adjust neck/head movement into body if you are looking for it kzbin.info/www/bejne/hJzFZXd7pL-ShLssi=d8KGYS_x5-vRq1g_&t=1731

@@xlipdev thanks, I should've been more clear about what i meant, i meant neck flexing, like when speaking the neck stretch, neck flex, throat inhale, etc

@@josiahgil oh I see, in metahuman skeleton there are not many bones in neck area (I think 2 or 3), during facial performance I believe only head bone is tracked, so capturing precise neck movements seems not possible initially, but you can have additional bones in that area and animate them correspondingly with your facial animation by yourself ^^

@@xlipdev thank you🙏

@@garryock2530 Thanks for the comment ^^ In the end of series I touched a bit how to support multiple players and make different improvements depending on what you want but initially yea it is a cool mechanic for 2 players, also preparing a bonus video about an ai companion which follow you to hold current player's hand ^^

@@ShinjiKeiVR10BetaUSA-s2t Very cool! I hope my video helps ^^ You can always reach me out from repo social media etc. I can help ^^

@@HongPong 😆

@@DavidGFalzarano 🤣

@@789alizaidi Thanks a lot for sharing kind thoughts ^^ I'm happy you liked it

There is a playlist covers almost everything about AI logic in Unreal engine here kzbin.info/aero/PLNwKK6OwH7eW1n49TW6-FmiZhqRn97cRy and you can apply ragdoll in the same way triggering events basically

😆 development is fun

@@crazyguy7585 Thank you so much I'm happy you liked it ^^

@@ThunderMan805 Thank youu for the support ❤️

@@incrediblesarath You are welcome, I hope I helped ^^

@@ThunderMan805 Thank youu ❤️ actually you will see "how to send a character to a place in level" example in this series but that's a good point I will try to add a bonus video to show how to make character follow you ^^

Good idea! There are many apps/AIs that you can capture body animation even for free, so yea that is also possible ^^

Check out "The Darkest Age"'s mocap tutorial. he uses 2 cameras with a iphone head mount for facial mocap and regular video with moveAI's video2mocap app and records simultanously. you could combine both tutorials to get full mocap with android (or any video source)

Thank you sooo much for kind words ❤ I really liked the request, thought it was a nice challenge and tried my best I hope it helps ❤I'm always open for requests if you think you have a cool idea, lets do it ^^

Very good question! Technically yes but I didn't care about optimization initially in the scripts, probably it will require adjustments to create depth maps faster. And i also have never tried to create performance from camera feed before, it can be achieved but also need to check how the current pipeline works for camera feed

Hi, after I drag and drop the calibration file this error pops out. Warning: Failed to import 'D:\Projects\YQ\ABCD\B_CHAOMO\faceDepthAI-master\faceDepthAI-master\iphone_lens_calibration\Calibration.mhaical'. Unknown extension 'mhaical'. i also run the python pip install -r requirements.txt and got this : Successfully installed CFFI-1.17.1 absl-py-2.1.0 attrs-24.2.0 contourpy-1.3.0 cycler-0.12.1 flatbuffers-24.3.25 fonttools-4.54.1 jax-0.4.34 jaxlib-0.4.34 kiwisolver-1.4.7 matplotlib-3.9.2 mediapipe-0.10.14 ml-dtypes-0.5.0 numpy-2.1.2 opencv-contrib-python-4.10.0.84 opencv-python-4.10.0.84 openexr-3.3.1 opt-einsum-3.4.0 packaging-24.1 pillow-10.4.0 protobuf-4.25.5 pycparser-2.22 pyparsing-3.1.4 python-dateutil-2.9.0.post0 scipy-1.14.1 six-1.16.0 sounddevice-0.5.0 trimesh-4.4.9

@@caiyinke3404 Thanks ^^ Head is also tracked during performance by default but you can disable i believe, there are many vidoes around how to adjust the body with the head you can check, Just drag one metahuman to your level first and Unreal Engine will enable required plugins initially, probably some metahuman related plugins are not enabled in engine so thats why you cant import 'mhacial'

@@madzorojuro thank youu ^^ you are the 100th one 🥳

@MarchantFilms-ef1dq for Unreal editor, depth data should be in .exr format and depth data should be written in "Y" channel and also depth values have to be between some ranges depending on the device class you choose in calibration.(iPhone 14 or later expects somewhere between 15 and 40 for the face area) also you need to double check 0 and infinite values and arrange them, So unfortunately getting directly from an app is not going to work most likely. But still you can edit/modify your depth map to match these things and it should work. I initially started with midas depth generator AI model to create some depth maps but it didn't go well so I decided to create them myself 😅

😂 Probably it will be a video series like step by step which will be better and easy to cover different parts of development Muhtemelen video serisi şeklinde koyucam adım adım anlatmak ve farklı bölümlerin geliştirilmesini açıklamak daha kolay olcak gibi bugün yarın koyarım 😅

You're very welcome!

I'm glad if i helped ^^ you can check CameraDepthFade node as well maybe gives different ideas ^^

@@xlipdev thank you for the idea! I’ll let you know how it goes :)

Çok teşekkürler, evet önemli bir nokta "FInterpTo" metodu da kullanılabilir eğer curve objeleri ile uğraşmak istemiyorsak belirttiğin için çok sağ ol ^^ Ayrıca doğru C++ ile yazmak tabii ki daha efektif ve geniş bir kontrol sağlamak açısından daha iyi Thank you so much, yes, an important point is that the 'FInterpTo' method can also be used if we don't want to deal with curve objects, thanks a lot for mentioning it ^^ Also, writing it in C++ is, of course, more effective and provides broader control

@@PaulGriswold1 for Unreal editor, depth data should be .exr format and depth data should be written in "Y" channel and also depth values have to be between some ranges depending on the device class you choose in calibration.(iPhone 14 or later expects somewhere between 15 and 40 for the face area) So unfortunately getting directly from an app is not going to work most likely. But still you can edit your depth map to match these things and it should work.

Yes, I will check holding hands in real time topic and try to create a tutorial for it ♥

Seems like you have issues with cmake, make sure that CMake is installed and available in your system's PATH maybe you need to update it, or maybe issues is related to one of below You don't have a compatible C++ compiler (such as gcc for Linux or MinGW for Windows) openexr may not be compatible with the version of Python you're using, update python