Comfy UI Webcam Noodling...like Mocap

#comfyui #controlnet #stablediffusion #stablediffusionprompts #animatediff
Here I go over how to use a workflow I made to generate animations from actions/motions recorded through a webcam using the custom node webcam noodle. Features include prompt scheduling anim diff, with free u, and the control nets models soft edge, open pose, and tile for upscaling.
I've included the workflows for the 3 animations on my kofi page.
ko-fi.com/s/e4...
Webcam noodle custom node:
github.com/Niu...

[@MajorStudioArt]

Absolutely checking this out :)

[@calvinherbst304]

Thanks for sharing workflows :)

[@sludgebucket3042]

Very cool, subscribed :D

[@boricuapabaiartist]

Thanks, you should also check out some of my other comfy videos, you might find some other little nuggets of information and inspiration as well

[@sxrjs2010]

so good

[@boricuapabaiartist]

Thanks, hope it helps you get some interesting animated image generations of your acting.

[@calvinherbst304]

I'd love to use this workflow but instead of having the webcam as an input, using a preloaded video file. Any ideas?

[@bruceaquina1799]

Thank you for the upload and showing your workflow. Very fun and appreciate you sharing helpful insights. However, I am curious how your experience on generating videos where one is speaking dialogue for an overdub later? Cheers boricuapab and excited for the weekend to try this out!

[@boricuapabaiartist]

You could use my workflow and test it enabling the detect_face option in the open pose node and it’ll record your mouth motion but some frames may need a bit of cleanup around the mouth, but in theory you should be able to then dub the final result

[@ReinventAnimeWithAI]

Very cool

[@boricuapabaiartist]

Thanks, glad you enjoyed the video

[@alexwchvui]

how to solve ? when loading the graph, the following node types were not found "NNLatentUpscale"

[@boricuapabaiartist]

In comfy manager search for: neural it'll show a few options, the one in my workflow is by the user named Ttl, here's the repo for it as well github.com/Ttl/ComfyUi_NNLatentUpscale

[@smithyommite284]

how do i select the webcam??

[@boricuapabaiartist]

The custom node should automatically detect it. Also try using firefox browser instead of chrome

[@PeterLunk]

Deleting comments ? Nice !

[@boricuapabaiartist]

I didn’t, YT automatically does that on some comments

[@PeterLunk]

LMAO @@boricuapabaiartist