AI Animation: Make Anything Dance | AnimateDiff + ComfyUI

[@MDMZ]

Let me know if you guys have any questions, need a little extra help? head over to discord: bit.ly/3WvMFBN

[@milesorourke6781]

I got stuck at trying to load my video I chose in comfyUI

[@jonrich9675]

crashes at 77% or just stops

[@fabiotgarcia2]

Do we need to crop the video Sangwon PARK to vertical size? If yes, how can we crop it?

[@Happiness_spread_]

Any coaching tuition for this

[@_whatifs.ai_]

It took me three weeks to understand ipadapter, controlnet, animatediff, animatediffloader, motions, checkpoints and how this dance videos work. Amazing work by you 🎉

[@MDMZ]

gotta respect the grind, good luck and thank you

[@_whatifs.ai_]

@@MDMZ thank you 🤩

[@justinkk]

Didn’t this video come out 3 days ago?

[@T3_JAMS]

Thank you for this but it is very hard it took one month for a beginners

[@FM-zp2hl]

amazing content, you are the best. I have reached before to many creators of videos like this for guidance on how they did, I even offered to pay them but none was willing to help, I have a feeling they did not want to share their knowledge. Now I have it here free and well made. Thanks

[@MDMZ]

that's sad! sorry to hear that. I'm happy to help

[@beatrizbrito5813]

I am eternally grateful for this video! I am so happy to be able to create more interesting content. Thank you!😁🙏

[@MDMZ]

Glad it was helpful!

[@kidozoo]

U got new sub..was looking for this for weeks. Finally found it. Will be following it.

[@MDMZ]

Awesome, thank you!

[@fortunato1957]

Simply great! Thank you for sharing such a good content. I've downloaded all neccessary files and will start to test it immediately.

[@MDMZ]

Have fun!

[@fortunato1957]

@@MDMZ I REALLY DO HAVE FUN! It works!! 🤩 (AMD Ryzen 9 3900X 12-Core Processor, 32 GB RAM, GeForce RTX 3060 12 GB VRAM)

[@ankitpatel7620]

Good Work

[@len6416]

That's so great! Thank you very much for this tutorial!

[@MDMZ]

You're very welcome!

[@MotivationalMinute-123]

Thank you for a good tutorial, I am grateful for your teaching

[@MDMZ]

You are very welcome

[@iTrendMedia24]

So wonderful !

[@AlexanderOvdiy]

Thanks for the tutorial. How long did it take you to animate this video? What kind of video card and processor do you have?

[@ahmedbahrouni5707]

wow that was really amazing,bro you are the best ❤‍🔥❤‍🔥

[@MDMZ]

🙏😎

[@Injaznito1]

THANK YOU!!! I've been wondering (and trying) to configure my Comfy to do this with limited to awful affect :) lol

[@MDMZ]

Happy to help!

[@mohamedha578]

Many many thanks, is not enough 🎉 Amazing

[@MDMZ]

Thank you too!

[@CoreyMcKinneyJr_CMJR]

Subscribed because you actually teach! but the "LayerMask: RemBgUltra" wont load and stays red after updating everything and installing custom nodes. all the other nodes are normal. what should i do?

[@roshaananwar3565]

did you get a solution?

[@CoreyMcKinneyJr_CMJR]

@@roshaananwar3565 No :( i moved on to a different topic

[@MDMZ]

make sure you follow the models list instructions, there's a solution for that in the same thread

[@INTELIGENCIAARTIFICIAL-eb7zq]

AMAZING BRO!!! Thank you so much!!! PEACE!!!

[@CosmicHealerPain-369]

its really amazing sir,..i almost done my video

[@tanyasubaBg]

You are really THE BEST, as always!!!!

[@MDMZ]

You are!

[@maximumblackness]

Awesome tutorial!!

[@MDMZ]

Thank you!

[@AIEnthusiasm]

amazing tutorial

[@norabereczki]

great video, thanks for sharing

[@MDMZ]

Thanks for watching!

[@GiancarloBombardieri]

incredible!! thanks for sharing!!

[@MDMZ]

Glad you liked it!

[@trishul1979]

Awesome. Thank you

[@br11bronc34]

amazing

[@abhinavaserkar1055]

Great! Killing it! :)

[@MDMZ]

I appreciate it 🙏

[@Aitoolstation805]

Well this is amzing but sad :( my laptop would not support comfyUI as i have no 16 GB vRAM. What should be good specs to download this comfyUI ?

[@MDMZ]

how much VRAM do u have ?

[@Aitoolstation805]

@@MDMZ 32 Mb

[@carsoncarr-busyframes619]

there are websites where you can run comfy UI on machines on the cloud which have super fast GPUS. it costs some money but cheap compared to buying a faster computer

[@chezdiogenes]

@@MDMZ WIll 8gb be enough?

[@FM-zp2hl]

Amazing stuff

[@midprompt]

amazing from south korea!!!

[@WapooVideo]

Big question! Why have to add a qrcode monster controlnet? How can it help?

[@pxrposewithnopurpose5801]

got this video just after i did the old 6 month tutorial by you TwT

[@MDMZ]

things are moving fast 😅

[@manishk168]

you are a great person ,best friends

[@MDMZ]

🙏🙏

[@aidigitalmediaagency]

Noooodles!! ♥

[@MDMZ]

🍝

[@yogurtsegar]

Can i run the above in thinkdiffusion. I am a newbie

[@tomaszgosciminski5026]

Superb!

[@rawnclark]

it is possible to render multiple people at once? say i want to turn a music video into something similar?

[@MDMZ]

I believe you can, I suggest you experiment with a simple clip before doing the music video

[@alexandradekimpe1930]

Thank you so much for this amazing worflow and ressources ! When I try tu use the upscale denoise group, I have this error : Error occurred when executing ADE_ApplyAnimateDiffModelSimple: ApplyAnimateDiffModelBasicNode.apply_motion_model() missing 1 required positional argument: 'motion_model'. Would you have a suggestion ? Thanks. You rock ! 😉

[@MDMZ]

just gave you a reply on discord

[@alexandradekimpe1930]

@@MDMZ Thank you so much !

[@samu7015]

Is it possible to add a node to remove the background and just keep the character? I want a pure black background, and prompting doesn't work

[@MDMZ]

yes it's possible, RemBgULTRA is a good option

[@samu7015]

@@MDMZ I get an error, even after replacing the model like you said in Discord. I couldn't get the workflow to work

[@MDMZ]

@@samu7015 feel free to share more details over there

[@ComfyuiResearch-x2p]

could you explain the prompting for this workflow, especially if we're not using spaghetti etc. what should it include ?

[@MDMZ]

there's no formula really, I've shared the spaghetti prompt in the video, you can definitely use that as a reference

[@CGzzzzzzzzzzz]

Thank you. Do u know how much vram is needed for that

[@MDMZ]

it's not so demanding, depends on your settings, give it a try

[@SaeedBwp]

how to increase output video length ?

[@MDMZ]

the output will match the length of the input video

[@SaeedBwp]

@@MDMZ in my case only 2 seconds video

[@EASY_SHOP880]

I have a problem withe Models/files discord not open for me , help me please

[@pt7318]

hi, where can i find the models which i need ? you said in the description box. i clicked on it and go to discourd, but I can not find the list of models I need to install. thanks for your answer and help

[@MDMZ]

check the pinned msg on the discord channel

[@Patricia_Liu]

Could you tell me the basic specifications to run your tutorial videos, like Vram, Ram, etc?

[@MDMZ]

I haven't tested the minimum requirements, but I believe this should work with 8 GB of VRAM, it really depends on so many factors

[@Patricia_Liu]

@@MDMZ Thank you.

[@vm6445]

cooking spaghetti is much simpler 🤣🤣

[@MDMZ]

😂😂

[@titangaming2316]

Sir please make the tutorial to install comfyui in amd gpu on windows

[@大卫-e5k]

谢谢

[@itsallaboutyou4968]

Disclaimer: It won't work on Old GPU's and less ram, even if you try it give a cuda error

[@shaancent191]

❤❤❤❤

[@i.k-s6w]

where are the files of Lora Stacker?

[@adedamolajustina1311]

Can i use my mobile phone

[@MDMZ]

if you use a cloud based comfyui solution, u might be able to access it from your phone

[@Harry-Haller]

It works very nice on my 3060 12 gb. the only problem is with the first upscale process, it makes the video very blurry reducing the quality. What can cause this issue?

[@MDMZ]

it's really hard to guess, try playing with the settings, if you post on our discord u might be able to get some help

[@Harry-Haller]

@@MDMZ tried changing every setting in that part, still the upscaled results are worse and blurry. nothing bad though, considering I lack the memory to process long videos. I was just hoping it was a known problem and easily fixed! Ty again for the great tutorial

[@alenavelkina]

Have the same problem. 😢

[@jagag7716]

Bro how to do this in lightning ai , lightning ai providing comfyui and high speed system

[@yogurtsegar]

Can i run the above in thinkdiffusionI? Sorry i am a newbie

[@MDMZ]

yes

[@CosmicHealerPain-369]

how if layermask area missing? where to download it???

[@MDMZ]

check the pinned comment

[@Decrypt_Symbol]

❤

[@maximumblackness]

Can you integrate flux into this workflow? I'm new to ComfyUI

[@MDMZ]

i wouldn't even bother, FLUX is just way too slow (for now)

[@BlissfulRelaxation_eco]

What are the computer specifications for this animation?

[@MDMZ]

it should work on less powerful computers

[@irynapietrova]

does someone know why I followed the collection of flowers by I see there a lot less than it is shown on in this video

[@MDMZ]

strange! perhaps the author removed some pics

[@everythingofgames4658]

Is there any way to this online for free...or paid ?

[@MDMZ]

ThinkDiffusion

[@ninajjipinda]

comfyui midas-depthmappreprocessor no such file or directory What is this error as i queue the video

[@SavvyStaks]

After importing the workflow file you provided, your workflow does not appear like this

[@MDMZ]

there are 2 workflows in the description, I've explained the difference in the video

[@jindongzhu8459]

Hello! I have a layermask:rembgultra error, what is the reason? thank you

[@MDMZ]

this was solved on discord, check the model list thread

[@jindongzhu8459]

@@MDMZ Thank you! Have already solved

[@MuzamilMuzamil-v6v]

I can find workflow file kindle send me the link of that file

[@MDMZ]

it's in the description

[@sohelnadaf3887]

Please make video on animation anyone by using video and image to animation video

[@hasa-we9gk]

while clicking on que prompt it shows pending for long time any solution?

[@MDMZ]

try restarting comfyui

[@tonywhite4476]

Can you name any use cases to justify this tremendously tedious workflow for an overlay?

[@abhinavaserkar1055]

This can be used in ads for example an ad of a noodles, milk, nature related videos, any organic element related videos.

[@manishk168]

problem error clip vision loader not fount,how to solve,clip vision loader node missing in your workflow

[@MDMZ]

update comfyui before importing the workflow, you can visit our discord for more help

[@ManojParnapalli]

why my video is not generating background i followed all your steps and video is blur even after upscaling

[@MDMZ]

you can use the newer version of the workflow from the civitai page, it lets u choose the background

[@timwu1981]

@@MDMZ Hi Could you share the new version of the workflow here, I got same background problem, thank.

[@milesorourke6781]

I hope I can figure this out I hit 35 k since I started my instagram but I want to do plants dancing so bad. I tries in runway, Kling and Dream Machine but there is nothing as smooth as using this.

[@MDMZ]

you can do it !

[@milesorourke6781]

@@MDMZ I got stuck . It will not allow me to upload videos in the comfy ui build I got from this😑

[@jittthooce]

Is 4090 24 GB + 30 GB RAM not enough to run this workflow? Im running this on runpod and the process is getting killed at the beginning itself. If I sample 50 frames it works, but if I just set it to 0, it crashes. I mean WTF? what am I missing?

[@MDMZ]

maybe your video is too long

[@jittthooce]

@@MDMZ its just 14 seconds. Is that too long? What's the recommended length then?

[@fajoush]

i get error running it on "Rundifusion". is there anyway?

[@MDMZ]

what's the error

[@sohelnadaf3887]

How we can do without a json file?

[@MDMZ]

you can recreate all the nodes manually if you wish

[@CerebricTech]

Would this work with 4gb vram???

[@MDMZ]

most likely no

[@CoqueTornado]

how much VRAM is needed? is not for me is for a friend

[@MDMZ]

I recommend atleast 12GB, but it depends on many factors

[@CoqueTornado]

@@MDMZ thank you!

[@hasa-we9gk]

it shows missing custom nodes failed to load

[@MDMZ]

go to manager and install missing custom nodes

[@quangnguyentop1]

How can i Transform that video online like Huggingface?

[@binucartoonama1173]

show that when i queue prompt"LayerMask: RemBgUltra [Errno 2] No such file or directory: 'E:\\Software\\ComfyUI_windows_portable_nvidia\\ComfyUI_windows_portable\\ComfyUI\\custom_nodes\\ComfyUI_LayerStyle\\RMBG-1.4\\model.pth'"

[@MDMZ]

hi, double check all the instructions when installing the files, the list on discord has directions for this particular scenario

[@HemantkumarSharma-n1s]

Specs of your system?

[@MDMZ]

4090RTX 24GB VRAM - 64GB RAM

[@luaywam]

I get the following error msg and I trid everything I could to solve it but it didn't work, can someone help? LayerMask: RemBgUltra [Errno 2] No such file or directory: 'C:\\ComfyUI_windows_portable\\ComfyUI\\custom_nodes\\ComfyUI_LayerStyle\\RMBG-1.4\\model.pth'

[@MDMZ]

hi, check the pinned comment

[@luaywam]

Thank you, I solved all problem

[@shreejipaliwal1215]

How much Space will it require to install all of these in my pc

[@MDMZ]

the space you need equals the total size of models that you need to download, plus a couple of gigs for comfyui itslef

[@shreejipaliwal1215]

@@MDMZ I am asking it in numbers like MB and GB

[@satviksingh3184]

Is it free?

[@MDMZ]

yes!

[@joseph1308]

Comfyui won't run on my windows 8 😢

[@MDMZ]

why is that

[@joseph1308]

@@MDMZ there is a problem with cuda or some of its dependencies. I couldn't resolve it😩

[@charafguettai5965]

i cant find the the manager

[@MDMZ]

you need to install it first, I've explained that in my comfyui installation video

[@daphneembella5037]

Give us prompts please

[@MDMZ]

it's shared in the video

[@hasa-we9gk]

give the model file list ⁠📄Models list

[@MDMZ]

check the description

[@Iggystanko]

wtf crahses program 🙈🙈🙈

[@MDMZ]

hi, you can head over to discord for help

[@gamingareanx1460]

just unsubscribe, when you are earning from youtube ads then why every one should be your patron? and pay for work flow? bye

[@eeducation3419]

MDMZ, I got this error in comfyUI. how to solve? Error occurred when executing IPAdapterUnifiedLoader: ClipVision model not found.

[@MDMZ]

make sure you download the clipvision model

[@AaliDGr8]

that,s really ridiculous of you we dont wanna buy ur petreon why u stpdly polishing ur shop instead of giving quality tutorials huhh when we cant convert video into black and white for this process then wth u skip that how to in this video just specific to ur petreon supporter wow greedy man , whom who don't buy ur petreon will never know how to and stuck in start so did we dislike this video huhhh... you should teach us how to do it briefly and online when most ppl are poor and don't have PC so they love including me to make that type effect plz make it online tutorial of it without comfyui horrific interface???

[@EASY_SHOP880]

invite invalid discord

[@MDMZ]

can u check again ?

[@MDMZ]

i tried and it seems to be working