AI Animation: Make Anything Dance | AnimateDiff + ComfyUI

[@MDMZ]

Let me know if you guys have any questions, need a little extra help? head over to discord: bit.ly/3WvMFBN

[@milesofmotions4u]

I got stuck at trying to load my video I chose in comfyUI

[@jonrich9675]

crashes at 77% or just stops

[@fabiotgarcia2]

Do we need to crop the video Sangwon PARK to vertical size? If yes, how can we crop it?

[@Happiness_spread_]

Any coaching tuition for this

[@FM-zp2hl]

amazing content, you are the best. I have reached before to many creators of videos like this for guidance on how they did, I even offered to pay them but none was willing to help, I have a feeling they did not want to share their knowledge. Now I have it here free and well made. Thanks

[@MDMZ]

that's sad! sorry to hear that. I'm happy to help

[@Marvelgirl_1682]

Thanks a lot 🙏 I’ve made a small contribution to support you. Your videos are so user friendly and easy to understand ❤

[@MDMZ]

Appreciate that! 🙏

[@Marvelgirl_1682]

@ It gets stuck at 44% at step 'Load advanced controlnet model' even after 4 hours no error thrown. Could you please help me

[@_whatifs.ai_]

It took me three weeks to understand ipadapter, controlnet, animatediff, animatediffloader, motions, checkpoints and how this dance videos work. Amazing work by you 🎉

[@MDMZ]

gotta respect the grind, good luck and thank you

[@_whatifs.ai_]

@@MDMZ thank you 🤩

[@justinkk]

Didn’t this video come out 3 days ago?

[@T3_JAMS]

Thank you for this but it is very hard it took one month for a beginners

[@Marvelgirl_1682]

Thanks

[@MDMZ]

some clay animations look very realistic, just saying 😅

[@pettryai29]

amazing content, you are the best. I have reached before to many creators of videos like this for guidance on how they did, I even offered to pay them but none was willing to help, I have a feeling they did not want to share their knowledge. Now I have it here free and well made. Thanks

[@MDMZ]

happy to help

[@beatrizbrito5813]

I am eternally grateful for this video! I am so happy to be able to create more interesting content. Thank you!😁🙏

[@MDMZ]

Glad it was helpful!

[@dmitrykonovalov9366]

thank you sooo much for the videos and the explanations

[@MDMZ]

You're very welcome!

[@kidozoo]

U got new sub..was looking for this for weeks. Finally found it. Will be following it.

[@MDMZ]

Awesome, thank you!

[@KukuNimi-jk1wu]

Have u been able to do it?

[@fortunato1957]

Simply great! Thank you for sharing such a good content. I've downloaded all neccessary files and will start to test it immediately.

[@MDMZ]

Have fun!

[@fortunato1957]

@@MDMZ I REALLY DO HAVE FUN! It works!! 🤩 (AMD Ryzen 9 3900X 12-Core Processor, 32 GB RAM, GeForce RTX 3060 12 GB VRAM)

[@len6416]

That's so great! Thank you very much for this tutorial!

[@MDMZ]

You're very welcome!

[@Brainstorming1237]

👍👍👍，you are fabulous!

[@ahmedbahrouni5707]

wow that was really amazing,bro you are the best ❤‍🔥❤‍🔥

[@MDMZ]

🙏😎

[@iTrendMedia24]

So wonderful !

[@MotivationalMinute-123]

Thank you for a good tutorial, I am grateful for your teaching

[@MDMZ]

You are very welcome

[@resfft7803]

Respect and thanks the first day of comfyUI i hope i will get good result :p

[@MDMZ]

Best of luck!

[@KukuNimi-jk1wu]

have you gotten results already? this looks complex

[@AndresViret]

Hello Mohamed, thanks for your videos, amazing job ! Even when I install and refresh missing nodes some are missing. Do you know why ? Andrès

[@MDMZ]

if that persists, try reinstalling comfyUI

[@dentaorp2451]

You is my master bro!!! thanks

[@MDMZ]

Happy to help

[@ankitpatel7620]

Good Work

[@AIEnthusiasm]

amazing tutorial

[@mohamedha578]

Many many thanks, is not enough 🎉 Amazing

[@MDMZ]

Thank you too!

[@SaeedBwp]

how to increase output video length ?

[@MDMZ]

the output will match the length of the input video

[@SaeedBwp]

@@MDMZ in my case only 2 seconds video

[@CoreyMcKinneyJr]

Subscribed because you actually teach! but the "LayerMask: RemBgUltra" wont load and stays red after updating everything and installing custom nodes. all the other nodes are normal. what should i do?

[@roshaananwar3565]

did you get a solution?

[@CoreyMcKinneyJr]

@@roshaananwar3565 No :( i moved on to a different topic

[@MDMZ]

make sure you follow the models list instructions, there's a solution for that in the same thread

[@veselinminev3642]

My Lora Stacker and Efficent Loaders have a red cage and i cant generate. I followed all the instructions. What is the problem?

[@MDMZ]

We do have a proper fix for this on discord, i would share it here if i remember the exact steps

[@trishul1979]

Awesome. Thank you

[@tanyasubaBg]

You are really THE BEST, as always!!!!

[@MDMZ]

You are!

[@EASY_SHOP880]

I have a problem withe Models/files discord not open for me , help me please

[@CosmicHealerPain-369]

its really amazing sir,..i almost done my video

[@Injaznito1]

THANK YOU!!! I've been wondering (and trying) to configure my Comfy to do this with limited to awful affect :) lol

[@MDMZ]

Happy to help!

[@WapooVideo]

Big question! Why have to add a qrcode monster controlnet? How can it help?

[@INTELIGENCIAARTIFICIAL-eb7zq]

AMAZING BRO!!! Thank you so much!!! PEACE!!!

[@yogurtsegar]

Can i run the above in thinkdiffusion. I am a newbie

[@maximumblackness]

Awesome tutorial!!

[@MDMZ]

Thank you!

[@GiancarloBombardieri]

incredible!! thanks for sharing!!

[@MDMZ]

Glad you liked it!

[@FM-zp2hl]

Amazing stuff

[@norabereczki]

great video, thanks for sharing

[@MDMZ]

Thanks for watching!

[@abhinavaserkar1055]

Great! Killing it! :)

[@MDMZ]

I appreciate it 🙏

[@Brainstorming1237]

Where am I going to find the " Models/files"? After logged in MDMZ sever, I could not find where the Models file located. 😇😭

[@MDMZ]

check the pinned message on the discord channel

[@davidwang6541]

thanks for sharing, i really need this workflow, but it's somewhat complicated for me, is there any AnimateDiff web site to operate? or any cloud server can run these, my computer can't bear this AI computing spec

[@MDMZ]

check thinkdiffusion

[@br11bronc34]

amazing

[@JohnTWilliamsFilms]

Can you recommend any other AI programs where I can recreate my dance footage (real dancers) into new sequences other than ComfyUI? Perhaps something not as complicated. I've tried several, but the quality and movement is not great. My goal is to take my existing green screen footage of dancers from several of my dance films and recreate into something more interesting, yet keeping the same choreography and movement from the original footage. Thanks!

[@MDMZ]

did you ret Gen3 by Runwayml? there's a video to video feature

[@JohnTWilliamsFilms]

@@MDMZ Yes, I have. Thanks. I'll keep working on it.

[@Aitoolstation805]

Well this is amzing but sad :( my laptop would not support comfyUI as i have no 16 GB vRAM. What should be good specs to download this comfyUI ?

[@MDMZ]

how much VRAM do u have ?

[@Aitoolstation805]

@@MDMZ 32 Mb

[@carsoncarr-busyframes619]

there are websites where you can run comfy UI on machines on the cloud which have super fast GPUS. it costs some money but cheap compared to buying a faster computer

[@chezdiogenes]

@@MDMZ WIll 8gb be enough?

[@midprompt]

amazing from south korea!!!

[@aidigitalmediaagency]

Noooodles!! ♥

[@MDMZ]

🍝

[@Marvelgirl_1682]

It gets stuck at 44% at step ‘Load advanced controlnet model’ even after 4 hours no error thrown. Could you please help.

[@MDMZ]

could be a memory issue, u might need to restart, or try with a shorter video first

[@Marvelgirl_1682]

@ thanks yes I’m facing memory issues . Restart doesn’t work will check smaller video. Does a latent garbage collector help in such case and which do we connect it to?

[@pxrposewithnopurpose5801]

got this video just after i did the old 6 month tutorial by you TwT

[@MDMZ]

things are moving fast 😅

[@CoqueTornado]

how much VRAM is needed? is not for me is for a friend

[@MDMZ]

I recommend atleast 12GB, but it depends on many factors

[@CoqueTornado]

@@MDMZ thank you!

[@irynapietrova]

does someone know why I followed the collection of flowers by I see there a lot less than it is shown on in this video

[@MDMZ]

strange! perhaps the author removed some pics

[@tomaszgosciminski5026]

Superb!

[@sayehjalali8819]

After I install missing custom nodes and I restart, it gives an error. And when I close the file and open it again it doesn't opent and it gets stuck in cmd section. What's the problem? How can I fix it?

[@MDMZ]

what does the error say

[@titangaming2316]

Sir please make the tutorial to install comfyui in amd gpu on windows

[@rawnclark]

it is possible to render multiple people at once? say i want to turn a music video into something similar?

[@MDMZ]

I believe you can, I suggest you experiment with a simple clip before doing the music video

[@reinohvp]

I love you

[@itsallaboutyou4968]

Disclaimer: It won't work on Old GPU's and less ram, even if you try it give a cuda error

[@Patricia_Liu]

Could you tell me the basic specifications to run your tutorial videos, like Vram, Ram, etc?

[@MDMZ]

I haven't tested the minimum requirements, but I believe this should work with 8 GB of VRAM, it really depends on so many factors

[@Patricia_Liu]

@@MDMZ Thank you.

[@samu7015]

Is it possible to add a node to remove the background and just keep the character? I want a pure black background, and prompting doesn't work

[@MDMZ]

yes it's possible, RemBgULTRA is a good option

[@samu7015]

@@MDMZ I get an error, even after replacing the model like you said in Discord. I couldn't get the workflow to work

[@MDMZ]

@@samu7015 feel free to share more details over there

[@ComfyuiResearch-x2p]

could you explain the prompting for this workflow, especially if we're not using spaghetti etc. what should it include ?

[@MDMZ]

there's no formula really, I've shared the spaghetti prompt in the video, you can definitely use that as a reference

[@AshishGawale-j6n]

how much time does it take to generate a 1 minute video on rtx 3060 6 gb laptop gpu, 32 gb ram, ryzen 9 5900HX. or will it even work?. i tried your flux tutorial, dev model took 3-5minuts. i assume videos will take like 10 hrs.

[@MDMZ]

I'm impressed to hear that FLUX worked on 6GB VRAM, I assume videos will take much longer for sure, it really depends on the settings

[@AshishGawale-j6n]

@@MDMZ i followed the AnimateDIf tutorial, it wont work for full >30 sec video. gives error that memory is full or something after 1 hour from starting it. for 50 frames it worked. i guess i will have to buy a pc with 4090 or wait for upcoming gpu s.

[@pt7318]

hi, where can i find the models which i need ? you said in the description box. i clicked on it and go to discourd, but I can not find the list of models I need to install. thanks for your answer and help

[@MDMZ]

check the pinned msg on the discord channel

[@AlexanderOvdiy]

Thanks for the tutorial. How long did it take you to animate this video? What kind of video card and processor do you have?

[@revivehealthylife]

Do you need a good pc with good graphics card? What are specs for pc

[@MDMZ]

it's one of the requirements, the more GPU VRAM the better

[@jagag7716]

Bro how to do this in lightning ai , lightning ai providing comfyui and high speed system

[@ScraggyDogg]

Hi, many thanks for the video, im having problems with the dzNodes RemBGUltra - It all installed fine but theres no file inside Layer Style of model for it according to fault and me looking, But if I type dzNodes in Comfui manager I find nothing ? (was going to try reinstall) this is the fault [Errno 2] No such file or directory: 'C:\\ComfyUI_windows_portable\\ComfyUI\\custom_nodes\\ComfyUI_LayerStyle\\RMBG-1.4\\model.pth' and its correct there isn't but no idea how to fix it unfortunately. Any ideas?

[@ScraggyDogg]

is fault ^^^^^^^^^^^^^^^^ FileNotFoundError: [Errno 2] No such file or directory: 'C:\\ComfyUI_windows_portable\\ComfyUI\\custom_nodes\\ComfyUI_LayerStyle\\RMBG-1.4\\model.pth'

[@MDMZ]

make sure you follow all the installation instructions and download all the needed files

[@ScraggyDogg]

@MDMZ yes it's strange there is no folder or file, ( that the fault points to) yet I've reinstalled, removed the "layer style" folder completely and tried again, just to get same result, thanks I'll give it another try today.

[@ScraggyDogg]

I.e. no Rembg-1.4 folder or model.pth

[@CGzzzzzzzzzzz]

Thank you. Do u know how much vram is needed for that

[@MDMZ]

it's not so demanding, depends on your settings, give it a try

[@Harry-Haller]

It works very nice on my 3060 12 gb. the only problem is with the first upscale process, it makes the video very blurry reducing the quality. What can cause this issue?

[@MDMZ]

it's really hard to guess, try playing with the settings, if you post on our discord u might be able to get some help

[@Harry-Haller]

@@MDMZ tried changing every setting in that part, still the upscaled results are worse and blurry. nothing bad though, considering I lack the memory to process long videos. I was just hoping it was a known problem and easily fixed! Ty again for the great tutorial

[@alenavelkina]

Have the same problem. 😢

[@CosmicHealerPain-369]

how if layermask area missing? where to download it???

[@MDMZ]

check the pinned comment

[@i.k-s6w]

where are the files of Lora Stacker?

[@jindongzhu8459]

Hello! I have a layermask:rembgultra error, what is the reason? thank you

[@MDMZ]

this was solved on discord, check the model list thread

[@jindongzhu8459]

@@MDMZ Thank you! Have already solved

[@alexandradekimpe1930]

Thank you so much for this amazing worflow and ressources ! When I try tu use the upscale denoise group, I have this error : Error occurred when executing ADE_ApplyAnimateDiffModelSimple: ApplyAnimateDiffModelBasicNode.apply_motion_model() missing 1 required positional argument: 'motion_model'. Would you have a suggestion ? Thanks. You rock ! 😉

[@MDMZ]

just gave you a reply on discord

[@alexandradekimpe1930]

@@MDMZ Thank you so much !

[@yogurtsegar]

Can i run the above in thinkdiffusionI? Sorry i am a newbie

[@MDMZ]

yes

[@ninajjipinda]

comfyui midas-depthmappreprocessor no such file or directory What is this error as i queue the video

[@hasa-we9gk]

while clicking on que prompt it shows pending for long time any solution?

[@MDMZ]

try restarting comfyui

[@Raredocumentary16]

out of memory how to use latent garbage collector solve this problem?

[@MDMZ]

how much VRAM do u have ?

[@Raredocumentary16]

@@MDMZ 6GB vram . can you optimic like forge webui can run in low vram?

[@MDMZ]

@Raredocumentary16 that's too low for this, but you can use an online solution like thinkdiffusion

[@BlissfulRelaxation_eco]

What are the computer specifications for this animation?

[@MDMZ]

it should work on less powerful computers

[@ManojParnapalli]

why my video is not generating background i followed all your steps and video is blur even after upscaling

[@MDMZ]

you can use the newer version of the workflow from the civitai page, it lets u choose the background

[@timwu1981]

@@MDMZ Hi Could you share the new version of the workflow here, I got same background problem, thank.

[@MuzamilMuzamil-v6v]

I can find workflow file kindle send me the link of that file

[@MDMZ]

it's in the description

[@AniGalaxy-YG]

Hw much memory should i have to make this work

[@MDMZ]

What u really need more of is GPU VRAM, i tried it with less than 16gb and it's a struggle

[@Metaroids]

Does this work for humans dancing? not food?

[@MDMZ]

I haven't tried that, now am curious too

[@fajoush]

i get error running it on "Rundifusion". is there anyway?

[@MDMZ]

what's the error

[@maximumblackness]

Can you integrate flux into this workflow? I'm new to ComfyUI

[@MDMZ]

i wouldn't even bother, FLUX is just way too slow (for now)

[@hasa-we9gk]

it shows missing custom nodes failed to load

[@MDMZ]

go to manager and install missing custom nodes

[@adedamolajustina1311]

Can i use my mobile phone

[@MDMZ]

if you use a cloud based comfyui solution, u might be able to access it from your phone

[@SavvyStaks]

After importing the workflow file you provided, your workflow does not appear like this

[@MDMZ]

there are 2 workflows in the description, I've explained the difference in the video

[@jittthooce]

Is 4090 24 GB + 30 GB RAM not enough to run this workflow? Im running this on runpod and the process is getting killed at the beginning itself. If I sample 50 frames it works, but if I just set it to 0, it crashes. I mean WTF? what am I missing?

[@MDMZ]

maybe your video is too long

[@jittthooce]

@@MDMZ its just 14 seconds. Is that too long? What's the recommended length then?

[@joseph1308]

Comfyui won't run on my windows 8 😢

[@MDMZ]

why is that

[@joseph1308]

@@MDMZ there is a problem with cuda or some of its dependencies. I couldn't resolve it😩

[@binucartoonama1173]

show that when i queue prompt"LayerMask: RemBgUltra [Errno 2] No such file or directory: 'E:\\Software\\ComfyUI_windows_portable_nvidia\\ComfyUI_windows_portable\\ComfyUI\\custom_nodes\\ComfyUI_LayerStyle\\RMBG-1.4\\model.pth'"

[@MDMZ]

hi, double check all the instructions when installing the files, the list on discord has directions for this particular scenario

[@sohelnadaf3887]

How we can do without a json file?

[@MDMZ]

you can recreate all the nodes manually if you wish

[@milesofmotions4u]

I hope I can figure this out I hit 35 k since I started my instagram but I want to do plants dancing so bad. I tries in runway, Kling and Dream Machine but there is nothing as smooth as using this.

[@MDMZ]

you can do it !

[@milesofmotions4u]

@@MDMZ I got stuck . It will not allow me to upload videos in the comfy ui build I got from this😑

[@gintokigojo]

Anyone tried this on 4 GB vram? Possibile? Amazing tutorial btw 🙌

[@MDMZ]

unfortunately that might be too low

[@gintokigojo]

@@MDMZ 🙌 appreciate your time, thanks

[@everythingofgames4658]

Is there any way to this online for free...or paid ?

[@MDMZ]

ThinkDiffusion

[@vm6445]

cooking spaghetti is much simpler 🤣🤣

[@MDMZ]

😂😂

[@luaywam]

I get the following error msg and I trid everything I could to solve it but it didn't work, can someone help? LayerMask: RemBgUltra [Errno 2] No such file or directory: 'C:\\ComfyUI_windows_portable\\ComfyUI\\custom_nodes\\ComfyUI_LayerStyle\\RMBG-1.4\\model.pth'

[@MDMZ]

hi, check the pinned comment

[@luaywam]

Thank you, I solved all problem

[@CerebricTech]

Would this work with 4gb vram???

[@MDMZ]

most likely no

[@Raredocumentary16]

load upscale model is null what is wrong

[@MDMZ]

Make sure you download the right model and place it in the correct folder

[@tonywhite4476]

Can you name any use cases to justify this tremendously tedious workflow for an overlay?

[@abhinavaserkar1055]

This can be used in ads for example an ad of a noodles, milk, nature related videos, any organic element related videos.

[@HemantkumarSharma-n1s]

Specs of your system?

[@MDMZ]

4090RTX 24GB VRAM - 64GB RAM

[@charafguettai5965]

i cant find the the manager

[@MDMZ]

you need to install it first, I've explained that in my comfyui installation video

[@hasa-we9gk]

give the model file list ⁠📄Models list

[@MDMZ]

check the description

[@sohelnadaf3887]

Please make video on animation anyone by using video and image to animation video

[@大卫-e5k]

谢谢