Face Mocap using ANY Camera

  Рет қаралды 66,212

CGDive (Blender Rigging Tuts)

CGDive (Blender Rigging Tuts)

Күн бұрын

Пікірлер: 157
@JamieDunbar
@JamieDunbar Жыл бұрын
Boo-yah! I've been following the facial mocap scene for the past two years and it's so exciting there's finally a truly free workflow from beginning to end. This is going to open the door for so many people 🥳
@RG_77
@RG_77 Жыл бұрын
DUDE!!!! I love that strike through the word IPHONE.. Makes me so happy
@pranjalrathor
@pranjalrathor Ай бұрын
poor fak
@earthlingarlene
@earthlingarlene Жыл бұрын
This is so excellent! I have been searching for months for a way to get mo-cap from pre-recorded video. The Audio2Face workflow was too complicated for me and I definitely prefer something integrated into blender. This was perfect!! I already have FaceIt and had the model pretty much set-up. I followed this tutorial tonight and within no time I had a result. I was surprised how well it captured the head tilts. In the video, the person was wearing glasses and had a lot of glare on the lenses, and surprisingly the software caught most of that movement. I have a lot of clean-up to do but this works great as a starting point. Thank you so much for making this tutorial!
@matt_the.creator
@matt_the.creator Жыл бұрын
😭😭😭you have no idea how much I've needed this, especially when the reallusion guys have just dropp their ai facial mocap stuff
@binyaminbass
@binyaminbass Жыл бұрын
The reallusion thing looks much more advanced than this. But hey, it’s free!
@activemotionpictures
@activemotionpictures Жыл бұрын
13:41- OMG, "COMBINE" finally works in local SRT with offser! Gosh! It took forever to see it fixed. Thank you for another amazing video!
@CGDive
@CGDive Жыл бұрын
Yeah, not sure when it was fixed. It must have been a couple of versions back.
@LFA_GM
@LFA_GM Жыл бұрын
This video should be part of YT recommendations for any artist or developer. Great work you're doing with animation and mocap. And a big thank you to all devs who made these two addons available for free.
@CGDive
@CGDive Жыл бұрын
Nice, glad you found it useful! ❤
@LFA_GM
@LFA_GM Жыл бұрын
@@CGDive Indeed. Would you show the proper way to bake and export the facial blend shape animation to FBX? I wanted to import the csv in Blender and send it to other DCCs. Thanks. Keep it up.
@CGDive
@CGDive Жыл бұрын
@@LFA_GM shape keys should export out though FBX without any special preparation!
@LFA_GM
@LFA_GM Жыл бұрын
Thanks@@CGDive . I'll give it a try.
@МаксЖуравков-ш1е
@МаксЖуравков-ш1е Жыл бұрын
Thanks for your video! I've been following the channel for a long time and this is one of my favorites. IMHO This is the best channel about creating animations. You do a great work!
@CGDive
@CGDive Жыл бұрын
Wow, thanks! Appreciate the nice words :)
@Livingbyygrace
@Livingbyygrace Ай бұрын
@@CGDivesir please share the link to the application
@CGDive
@CGDive Ай бұрын
​@@Livingbyygrace Do you mean the application from the video? All links are in the video description.
@carlosavelar5974
@carlosavelar5974 Жыл бұрын
I've been waiting for this video for a long time! You are the best!
@CGDive
@CGDive Жыл бұрын
Hope you enjoy it!
@roopatandel6590
@roopatandel6590 8 ай бұрын
Thank you so much for this video ,You have solved my biggest problem as well as doubt or issue ,from past two years i was wondering about the facial expressions in animation. Thank you once again god bless you
@carlosavelar5974
@carlosavelar5974 Жыл бұрын
dude I love you! Thank you for sharing your knowledge. Your videos are perfect! You are incredible! Thanks!
@CGDive
@CGDive Жыл бұрын
haha, I am getting a lot more "I love yous" on this video than I am used to. Seems like it is addressing a real problem. Nice!
@randomdudr
@randomdudr Жыл бұрын
This is perfect! I actually don't need the head rotations
@manshah7
@manshah7 Жыл бұрын
big time thanks for this! just what i needed!
@CGDive
@CGDive Жыл бұрын
Nice!
@shettimayakubu1573
@shettimayakubu1573 2 ай бұрын
Very first professional experience
@thepokekid01
@thepokekid01 Жыл бұрын
This is so really good! Both as info and tech... but it's still seems like it could use some manual tweaking after because it didn't seem to capture all your acting as well as it could have
@CGDive
@CGDive Жыл бұрын
Yep, that's why I included the parts in tweaking the mocap 🙂
@Qaanaaq0
@Qaanaaq0 Жыл бұрын
Yeah, its not great. Google mediapipe released a lightweight face and landmark recognition model. That is what I used in the app. They have better heavy models not accessible to the public. Some commercial products possibly train their own models or purchase usage of the better google models. But hey its free (the app creator here)
@cowbless
@cowbless 9 ай бұрын
The dead eyes tho. But still pretty impressive, probably useful with a bit of tweaking.
@TaygunGencosmanoglu
@TaygunGencosmanoglu Жыл бұрын
I love you so much man! What would we do without you? I'll try it next as soon as I finish my job. Thank you so much!
@legendboyAni
@legendboyAni Жыл бұрын
I love doing by hand 😊
@shivangipriya4153
@shivangipriya4153 Жыл бұрын
Thank you so much >> you still the best and you save the world , I am looking now for hand capture with finger movement .. I could not find it.. I hope you can help us (all the world) in this matter after you solve the problem by a nice video ( the above).
@llYuki0okami
@llYuki0okami Жыл бұрын
a dream come true
@JordyShortRibs
@JordyShortRibs Жыл бұрын
Omg finally!
@qadirqureshi7805
@qadirqureshi7805 8 ай бұрын
Hi, thank you. I am facing a problem. When I try FaceIT, it reacts in the opposite way when I turn my head. When I turn the head left/right in the video, the character's head turns up/down in Blender. So it reacts in the opposite way - in the video I shoot the head up/down - in Blender it turns left/right. I am using auto rig pro with faceit.
@chiddin2895
@chiddin2895 6 ай бұрын
Did you figure out a solution by any chance? :')
@qadirqureshi7805
@qadirqureshi7805 6 ай бұрын
@@chiddin2895 still not
@alanblackzy3395
@alanblackzy3395 Жыл бұрын
thanks so much
@TheOneAndOnlyThumper
@TheOneAndOnlyThumper Жыл бұрын
This is great! I think a great addition to the suite of tools would be a way to scale up the responsiveness of the captured rig points, i.e. selecting the brows, lips, jaw and setting a multiplier for scale for more intense/detailed performance capture. Is the capture framerate based on the set framerate within blender or does it capture at the camera framerate and interpolate frames? Either way, I'll definitely be grabbing the add-ons to play with! I'm working on a character in unreal engine and so far I've had to just keep the face static.
@gemdzqzdqgemdzqzdq6791
@gemdzqzdqgemdzqzdq6791 6 ай бұрын
Nice🎉👍🏻
@CGDive
@CGDive 6 ай бұрын
🎉
@insertanynameyouwant5311
@insertanynameyouwant5311 Жыл бұрын
so cool, is there something for UE5 and any phone? I just use Metahuman
@CGDive
@CGDive Жыл бұрын
not sure about that sorry. I am planning to focus on UE soon!
@patnor7354
@patnor7354 5 ай бұрын
very useful
@everything2god
@everything2god 9 ай бұрын
Hi! When I transfer a model with a faceit rig, the faceit addon stops seeing the rig. The ability to animate with LiveLinkFace is lost. How can I connect the addon to the ring if it has lost it.
@AirmanCS
@AirmanCS 5 ай бұрын
Is there a way to do live capturing on the app without an iphone tho? bc I have only seen video do cvs and then you import but live capture only has 4 apps and all of them are iphone exclusives
@cybercat1991
@cybercat1991 Жыл бұрын
Hi, this is amazing but I am wondering if this also works without faceit? It's quit expensive for starters. I'm using daz3d models that comes with a face rig as well or I can manully ad a face rig with the metarig from blender. Will that also works?
@CGDive
@CGDive Жыл бұрын
It does works without faceit. Did you watch the video? :D I am not familiar with DAZ or its face rig so I can't help there, sorry.
@cybercat1991
@cybercat1991 Жыл бұрын
thanks for your quick response! I'm sorry if i missed the answer within the tutorial. I did watched it and the full tutorial is applied on a faceit-rig but yes I skipped some parts so again sorry if the answer is in there@@CGDive
@SANTOUIMAGESERVICE
@SANTOUIMAGESERVICE Жыл бұрын
Thank you very much !
@PixelForgeLab
@PixelForgeLab Жыл бұрын
Hi there, first try I did it, was successful, then tried again, faceit and live link face and I got this error multiple times ! Python: Traceback (most recent call last): File "C:\Users\myname\AppData\Roaming\Blender Foundation\Blender\3.6\scripts\addons\faceit\mocap\mocap_base.py", line 842, in execute for x in futils.get_action_frame_range( File "C:\Users\myname\AppData\Roaming\Blender Foundation\Blender\3.6\scripts\addons\faceit\core\faceit_utils.py", line 12, in get_action_frame_range frame_range = action.curve_frame_range AttributeError: 'NoneType' object has no attribute 'curve_frame_range'
@IsabelleIze
@IsabelleIze 11 ай бұрын
Same problem , can someone give me an advise on why this problem , ? after yes twice , it open and close it I don't know why
@yosrh8294
@yosrh8294 2 ай бұрын
Hi there, did you find a solution?
@PixelForgeLab
@PixelForgeLab 2 ай бұрын
@@yosrh8294 no
@VisualistAyush07
@VisualistAyush07 Жыл бұрын
Thank you man Thank you so much thank you ×100×♾️🥹
@CGDive
@CGDive Жыл бұрын
No problem 👍
@jmtm00
@jmtm00 Жыл бұрын
Thank you❤
@CGDive
@CGDive Жыл бұрын
Welcome!
@Sen3D
@Sen3D Жыл бұрын
Would be nice to know how well it tracks the eyes. Because the eyes are the biggest issue here. Not just the eyelids.
@CGDive
@CGDive Жыл бұрын
It's hard to quantify how well it does it. I think it tracks it as well as the other features. So not perfect but somewhat accurate.
@Japleen_Couture
@Japleen_Couture Жыл бұрын
Hi, thanks for his vid I wanna askdoes this work with Linux?
@CGDive
@CGDive Жыл бұрын
The app that processes the video is built for windows. I think the code is available and it can be built for Linux by someone who knows how to do it.
@mikelx3d
@mikelx3d 11 ай бұрын
Thank you.
@JOEFRAUST
@JOEFRAUST Жыл бұрын
Once you do the mocap in blender, can you bring that information into Unreal Engine 5?
@CGDive
@CGDive Жыл бұрын
It should be possible
@SemyonKushnarenko
@SemyonKushnarenko 2 ай бұрын
Hello. When I launch the Face_Landmark_Link program, I select a video to track and the program simply closes and creates an empty csv file. What could be wrong? Has anyone encountered such a problem?
@CGDive
@CGDive 2 ай бұрын
I am not sure, sorry. Your best with technical issues bet is to ask the developer .
@zigyhouseofficial7751
@zigyhouseofficial7751 Жыл бұрын
For my part, face landmark only worked once and since then, there is a bug when opening just with the promt command
@CGDive
@CGDive Жыл бұрын
report to the developer!
@leonpijudo6875
@leonpijudo6875 6 ай бұрын
LiveLinkFace wont work with CSV file. My character face stays idle
@sarjilarafat3698
@sarjilarafat3698 9 ай бұрын
There's an error showing up while importing the CSV file. It says, ValueError: could not convert string to float: 'V'. I put a mov file on the load audio section and a csv file on the csv import section. Kept the frame similar to the mov file. Then it showed error when I clicked import csv.
@CGDive
@CGDive 9 ай бұрын
I cannot help with app errors. Please get in touch with the tool developer.
@animbenard9747
@animbenard9747 Жыл бұрын
Thanks so much for the tutorial. I used the free addon. The csv file loads with the keyframes inserted but has no effect on the character. What could be the possible solution
@CGDive
@CGDive Жыл бұрын
I can't say for sure. Does the character has ARKit shape keys?
@animbenard9747
@animbenard9747 Жыл бұрын
I used a character from character creater 3. Is their shape keys different from Arkit shape keys. How can I make the Arkit shape keys. Thanks bro
@CGDive
@CGDive Жыл бұрын
@@animbenard9747 I don't use CC so I can't say for sure, sorry. I believe CC character do have ARKit shapes or at least something similar so you have to make sure that you are bringing them into Blender. And also that the shape names are correct. Good luck!
@animbenard9747
@animbenard9747 Жыл бұрын
@@CGDive Thank you so much bro.
@animbenard9747
@animbenard9747 Жыл бұрын
Renaming the shapekeys to ARKit worked fine. Thanks boss. U did great
@mentawaisurftrips
@mentawaisurftrips 11 ай бұрын
hey guys just curious how does this quality compare to iphone mocaps? if i use a webcam or android phone (without depth sensor), is it still comparable quality to iphone mocaps? or slightly worse?
@bravonotutorials3291
@bravonotutorials3291 10 ай бұрын
It didn't ask me to import a video file. It just launches my webcam and starts to track live footage. I don't know where to find the csv file when I stop the tracking.
@CGDive
@CGDive 10 ай бұрын
I can't say for sure. Please ask the app developer!
@bravonotutorials3291
@bravonotutorials3291 10 ай бұрын
I realised I downloaded the wrong version. Thank you for your swift reply!
@garimamandli9779
@garimamandli9779 6 ай бұрын
Can same thing done in unreal with metahuman without iphone
@CGDive
@CGDive 6 ай бұрын
Not sure.
@yahbin77
@yahbin77 7 ай бұрын
Master Class
@CGDive
@CGDive 7 ай бұрын
Thanks!
@mosesNsibande-wg7hg
@mosesNsibande-wg7hg 7 ай бұрын
Good day guys , am a new subscriber ..i howsoever downlaoded face landmark but it shows two options saying (mild filtering ....) and the second which says (aggressive filtering ) when i try to install it , and neither of this options seems to work out ....please assist .
@CGDive
@CGDive 7 ай бұрын
Try asking the tool developer, that's your best bet.
@Qaanaaq0
@Qaanaaq0 7 ай бұрын
Hi, you downloaded the live streaming version. Try the normal version.
@stevecypert
@stevecypert Жыл бұрын
I keep getting Github pages that don't match your description. Can you post the exact link? Thank you.
@CGDive
@CGDive Жыл бұрын
I can't say why. The links in the description box seem to be correct. The mocap extraction app github.com/Qaanaaq/Face_Landmark_Link/ The blender addon: nickfisher.gumroad.com/l/tvzndw?layout=profile
@haraldthi
@haraldthi Жыл бұрын
Thanks! I have looked at it, and do not see why it can't run on Linux or most other systems as it made in Python with numpy and Tk, but I'm not much of a programmer either and can't get the libraries to work together. Anyone here up for the task?
@CGDive
@CGDive Жыл бұрын
According to the developer, it can be built for Linux or Mac. It's just that they only provide a pre built version for Windows.
@shahmaarbaba
@shahmaarbaba Жыл бұрын
this method work with auto rig pro?
@CGDive
@CGDive Жыл бұрын
For Auto-Rig Pro face rig? No, it only works for a specific set of shapekeys, the so called "ARKit" shapes. Some info here kzbin.info/www/bejne/gYKWY36IjtZpiKM
@shahmaarbaba
@shahmaarbaba Жыл бұрын
@@CGDive any another way to make 52 arkit blendshape key easily in blender?
@Shredder39
@Shredder39 9 ай бұрын
how to do it in cinema 4d?
@CGDive
@CGDive 9 ай бұрын
ask cinema 4d :)
@ZubairNaeem-b8i
@ZubairNaeem-b8i 2 ай бұрын
hey face land mark is not installing, why????
@CGDive
@CGDive 2 ай бұрын
I don't mean to be rude but do you really expect that someone can answer this? Hey, my car doesn't start. Why? Hey, my fridge doesn't cool. Why? I hope you see what I mean. :)
@EbisBikechannel-rc7ri
@EbisBikechannel-rc7ri 11 ай бұрын
Facelandmarker is only for windows!?
@CGDive
@CGDive 11 ай бұрын
I think so unless you build it for your OS.
@mentawaisurftrips
@mentawaisurftrips 11 ай бұрын
i'm having trouble running face landmarker on my Mac OS (running windows virtually)...how can I build it for my macOS? thanks in advance!@@CGDive
@CGDive
@CGDive 11 ай бұрын
@@mentawaisurftrips I hope you are not expecting help from me personally because I have no idea, sorry.
@gauravkumar-x08
@gauravkumar-x08 Жыл бұрын
It's work with unreal engine?
@CGDive
@CGDive Жыл бұрын
Shake keys work with unreal.
@raulcengher7735
@raulcengher7735 Жыл бұрын
You can make mocap with wrinkles animation ?
@CGDive
@CGDive Жыл бұрын
If you set up the wrinkles, sure!
@raulcengher7735
@raulcengher7735 Жыл бұрын
@@CGDive what I want to say is to suggest you to make a tutorial like what I mentioned up
@hotsauce7124
@hotsauce7124 Жыл бұрын
Does this work for Rigify 3.22?
@CGDive
@CGDive Жыл бұрын
Not sure. Test it. :)
@jaim2
@jaim2 11 ай бұрын
i'm pretty sure rigify doesn't have ARKit Shapes soo...
@CGDive
@CGDive 11 ай бұрын
@@jaim2 Oh, it says Rigify. I assumed they meant Blender 3.2
@jaim2
@jaim2 11 ай бұрын
@@CGDive yeah i know, but still, rigify (face rig) doesn't have ARKit Shape Keys. oh wait nvm, i realized that it is possible in a paid addon, Faceit.
@nimitverma3460
@nimitverma3460 7 ай бұрын
Plz make same for unreal engine
@Dude_Slick
@Dude_Slick Жыл бұрын
LiveLinkFace not working. Console flashes for a split second and disappears.
@CGDive
@CGDive Жыл бұрын
Contact the developer!
@CGDive
@CGDive Жыл бұрын
Also this tutorial is not about LiveLinkFace lol
@Dude_Slick
@Dude_Slick Жыл бұрын
@@CGDive I was just being stupid. I figured it out.Thanks.
@raymondwood5496
@raymondwood5496 Жыл бұрын
"The specified file is not valid." why i get this error when import csv into faceit
@CGDive
@CGDive Жыл бұрын
I can't say. It could be too many things from literally using an invalid file, to blender versions, addon versions, using the wrong feature, etc. etc. Try again. If the problem persists, you can try to share a bug report with the related tool developers.
@raymondwood5496
@raymondwood5496 Жыл бұрын
@@CGDive thank you for the reply.. I emailed the faceit developer.. and together with the csv file.. for now I use hallway cubes osc stream function, just worry the load on my pc will be too greats since I use brekel body with 3 kinects for body motion capture and hallway cube for facial motion capture together.. by the way thank you so much for providing such detailed great quality tutorial
@unknownproductions9879
@unknownproductions9879 Жыл бұрын
I have the same error. Latest version of faceit.
@raymondwood5496
@raymondwood5496 Жыл бұрын
@@unknownproductions9879 later I will try the older stable version, currently i am using the beta version, not sure is this the causes
@Bhuttaanimation
@Bhuttaanimation Жыл бұрын
Dear i am also facing the same issue, please guide if you got the solution@@raymondwood5496
@377omkar
@377omkar Жыл бұрын
Reallilluison crying in corrner
@Sakurazoku
@Sakurazoku Жыл бұрын
Still nothing exist to make the life easier for the blendshape ?
@nickfisherau
@nickfisherau 11 ай бұрын
I really want to work on that, and I think I can solve it, but I would need someone to fund me to do it :\
@crummymudd8625
@crummymudd8625 11 ай бұрын
there's a video about using Nvidia Omnverse Audio2Face that will generate the ARKit blendshapes. But I'll say -- it's not easy. I got the blendshapes out to Blender, now trying LiveLinkFace -- 1st time, animations do not play
@Bhuttaanimation
@Bhuttaanimation Жыл бұрын
Dear Sir/mam, I am facing ' The specified file is not valid' error while importing Mocap. Please guide me as the addon without this features is worthless for me and i just purchased it after watching this video. Thanks
@CGDive
@CGDive Жыл бұрын
Hello. You didn't specify which addon you mean. But even if you did, these are not my add-ons. I am just make tutorials about them. Please contact the developer from whom you purchased the product that you are having trouble with. Thank you!
@Bhuttaanimation
@Bhuttaanimation Жыл бұрын
I was talking about Faceit, But now my issue is resolved after switching to simple files of addon (previous version)@@CGDive
@CGDive
@CGDive Жыл бұрын
@@Bhuttaanimation great to hear!
@shettimayakubu1573
@shettimayakubu1573 2 ай бұрын
I need capturint
@CGDive
@CGDive 2 ай бұрын
What is "capturint"?
@PCMTTOPPER
@PCMTTOPPER Жыл бұрын
For knowledge it is ok But rhubarb is best for short videos
@sebastianosewolf2367
@sebastianosewolf2367 8 ай бұрын
and so not useable when its windows only
@maryadafilms6929
@maryadafilms6929 Жыл бұрын
exe file not in this
@CGDive
@CGDive Жыл бұрын
Not sure what that means. All links work!
@nuriman432
@nuriman432 Жыл бұрын
THIS IS FREE?
@CGDive
@CGDive Жыл бұрын
Yep 👍 (except for FaceIt)
@haraldthi
@haraldthi Жыл бұрын
Apache license. 🙂
@jonassandstedt
@jonassandstedt Жыл бұрын
Wasn't really impressed with the result unfortunately. 90% of your expression was lost in the conversion it looks like. Especially with the eyes.
@CGDive
@CGDive Жыл бұрын
If you expect to get Gollum out of the box without any tweaks, being disappointed is to be expected.
@danielfirmino3486
@danielfirmino3486 7 ай бұрын
​. As pessoas querem excelentes resultados sem o devido esforço. É o mundo de hoje, triste de ver!
@Livingbyygrace
@Livingbyygrace Ай бұрын
@@CGDiveplease how can I get the application
@CGDive
@CGDive Ай бұрын
@@Livingbyygrace Do you mean the application from the video? All links are in the video description.
Blender 4.2 Facial Motion Capture
19:18
Default Cube
Рет қаралды 91 М.
Mixamo + FaceIt: EASY Full Character Rigging & Mocap
37:12
CGDive (Blender Rigging Tuts)
Рет қаралды 43 М.
My scorpion was taken away from me 😢
00:55
TyphoonFast 5
Рет қаралды 2,7 МЛН
Chain Game Strong ⛓️
00:21
Anwar Jibawi
Рет қаралды 41 МЛН
When you have a very capricious child 😂😘👍
00:16
Like Asiya
Рет қаралды 18 МЛН
Free Face Mocap NO IPHONE on your Metahuman
2:47
Space Orca Studio
Рет қаралды 29 М.
THIS IS HUGE! Everyone can do High Quality Face Mocap now!
9:04
Cinecom.net
Рет қаралды 348 М.
How to do Facial Motion Capture in 6 Minutes | Blender 4.0
6:10
Jasper Pagan
Рет қаралды 35 М.
AI Powered Facial & Lip Sync 3D Animation Is Here!
8:02
How Ian Hubert Hacked VFX (and you can too!)
22:26
InLightVFX
Рет қаралды 366 М.
Reshape Face in Video - FaceTracker for Blender Tutorial
9:07
My scorpion was taken away from me 😢
00:55
TyphoonFast 5
Рет қаралды 2,7 МЛН