Generate AI Videos With AnimateDiff & ComfyUI | Text to Animation Tutorial

[@MDMZ]

So...what other tutorials on AnimateDiff or ComfyUI would you like to see on the channel ? Common fixes: - for VHS_VideoCombine errors, install the custom node ComfyUI-VideoHelperSuite - if you can't see the manager after installing, make sure you have the latest version of GIT and re-install, if it persists, retry the installation methods here: civitai.com/models/71980/comfyui-manager - visit the AnimateDiff Discord for more technical support: bit.ly/48Vnpdu

[@starhaven]

Thank you so much for this. Imma use this tonight. I would love a tutorial using ControlNet and IPadapter, more specifically I would love to learn the best workflow for integrating images into the process. I'm currently working on an AI production and using a still from one of the video scenes would be an amazing way of blending the live footage with the AnimateDiff visuals.

[@SportsMarvels121]

I'm using google colab but the GPU disconnects after 2-3 generations. Please help me with this? also I'm using free google colab, I haven't bought any computing units. I can't run it on my laptop cz it's Core i3, 8 Gen, 8gb Ram, 2gb Vram hahaha

[@filipenazario3370]

the lora stuff

[@papricamayahuel7263]

Hey, what if I got a mac? It won't do winrar.

[@MDMZ]

@@starhaven that sounds fun, I'll be making more tutorials on AnimateDiff for sure

[@AI_ArtDreamer]

Seriously, you've convinced me! I'm making the switch to comfyui. The ease of dropping workflows is a game-changer. Thanks for the insight!

[@MDMZ]

Have fun!

[@VairalKE]

Most tutorials on ComfyUI and AI in general are self aggrandization sessions. Yours are clear, concise and super helpful. Thank you. Greets from Kenya!

[@MDMZ]

Glad to help!

[@mickmumpitz]

Love your tutorials! And thanks for promoting ComfyUI it's so much fun to work with. I'll probably switch to it in my tutorials soon, even though I feel like a lot of people are still a bit scared of the node structure.

[@MDMZ]

glad u like the video, have fun :)

[@thill6482]

@mickmumpitz I’m excited to see what you do! Been following your Channel as well ever since your first video 😊

[@levi_melon369]

Very useful guides on ComfyUI for beginners, thx Legends! If anyone facing missing VHS, just back to manager and checking missing nodes and install it

[@MDMZ]

Glad to help!

[@Avalon1951]

Thank you for this tutorial, yours is by far the easies tutorial of animatediff to follow along with this workflow and I got it to work finally:)

[@MDMZ]

Glad it helped!

[@ai.manipulator]

our savior has posted again!

[@MDMZ]

🙏😁

[@justingrimm6642]

You're a legend! This is one of the best ai tutorials I've seen! Thank you! 💯

[@MDMZ]

glad you think so :)

[@thill6482]

I can’t wait to see your progress with this new tool. I learn so much when I watch your channel 🤓❤

[@MDMZ]

More to come!

[@ZirkoMirko]

thanks @MDMZ this was by far the easiest ComfyUI tutorial personally for me. I tried to get into ComfyUI more but this video really helped me. Now I would love to do all the work in ComfyUI.

[@MDMZ]

glad it was helpful

[@arjuntrehan48]

Bro I can't thank you enough for helping me out you solved my 2 problems , first is the animated diff and the second one was topaz ai which I was looking for !! Awesome tutorial ! 😍😍

[@MDMZ]

you are most welcome!

[@Pandakaniya]

Great tutorial brother! I just subbed you

[@MDMZ]

Thanks for the sub!

[@hughhou]

wow this is amazing!!

[@MDMZ]

Thanks man

[@Pauluz_The_Web_Gnome]

Girl is doing her hair with her hand while wearing a helmet! Great Art! Lol 😂

[@MDMZ]

Right?!

[@kiko_mhh]

Hey, i have a problem. Generation proces is too slow for me (much slower than in automatic1111). Time for generating one animation was too long, look at it: "[2:28:46

[@MDMZ]

hey, most likely it's because you have 6GB of VRAM, this works best with 12GB or higher

[@SportsMarvels121]

You really deserve millions of subscribers and views.

[@MDMZ]

Thanks 🙏

[@rubb3rmind]

THANK YOU BROTHER! IT WORKED BEAUTIFULLY!!!!!!!!!!!!!!!!!!

[@MDMZ]

Glad it helped

[@lightndreamsmachine]

Woooow! I really love this tutorial! Thank u very muuuuch

[@MDMZ]

Glad it was helpful!

[@gumvue.studio]

how do you getting the moviments?

[@MDMZ]

hi, the entire process is explained in the video

[@allago11]

in the config manager i dont have "manage" cant install nothing. tried many versions of it but it's the same

[@MDMZ]

hi, check the pinned comment, there's a fix for that

[@allago11]

@@MDMZ installing git i fixed

[@MDMZ]

@@allago11 nice

[@SklepHADRON]

why windows detects virus when I trying to download comfyUI ?

[@MDMZ]

it's normal, it should be safe

[@RelaxLittleSouls]

o meu deu esse erro [WinError 126] Não foi possível encontrar o módulo especificado. Error loading "C:\Users\Freitas\Desktop\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\lib\c10.dll" or one of its dependencies.

[@kingstaromega5799]

hii , can you please provide the workflow it not there anymore and also not working .

[@MDMZ]

Hi, just checked the animatediff page and the workflows are still there, maybe u can try a different browser

[@MyWhyAI]

Great tutorial! Thanks a bunch for making this!

[@MDMZ]

You're very welcome!

[@aidarffb2861]

"When loading the graph, the following node types were not found: VHS_VideoCombine Nodes that have failed to load will show as red on the graph. ComfyUI" Wanted to manually install it, moved to the right folder but the same error comes out, can anyone advise how to solve it? (EDITED) everything worked when I redid everything as shown in the video, try again, it worked for me!

[@kanohane]

Same issue.I tried the animateDiff Combone (depreciated) node and deleted that other one...now the error message is huge I dunno how to add tbe ''Combine'' node. Help... 😭

[@aidarffb2861]

everything worked when I redid everything as shown in the video, try again, it worked for me!@@kanohane

[@MDMZ]

I will be adding fixes in the pinned comment

[@AmithJimmy]

hiya, my AnimateDiff_loader folder (orange one in top ) is in red colour saying its missing somethig so what should i do?

[@lenny_Videos]

Awesome video ❤

[@MDMZ]

Thank u so much

[@horsequestofficial]

i saved it to watch later i hope this will help me alot

[@MDMZ]

have fun!

[@kargulo]

that is sooooo cooool, thanks

[@MDMZ]

glad you liked it

[@GamingDaveUK]

Do you have a guide on how to do this with SDXL models?1.5 feels like such a downgrade now (and theres the whole forgetting how to prompt for 1.5 lol)

[@oredzera]

My ComfyUI dont have the "manager" button, why ?

[@MDMZ]

hi, check the pinned comment

[@jvtosiartist]

thanks for the tutorial!

[@MDMZ]

Happy to help!

[@AlertaCreadores]

It tells me that I'm missing ADE_AnimateDiffLoaderGen1, but neither in the manager nor in Google does it say what it is and where to install it, so it doesn't let me do anything, not even the most basic thing.

[@MDMZ]

that's weird, try to re-install everything from scratch, and if you haven't yet, open the manager and install missing custom nodes

[@StringedYak]

Is there a way to use controlnet or images to get animatediff to generate a video?

[@Phezox]

Very cool guide! How did you add the AnimateDiff combine node? Edit: nevermind had to restart comfy for it to appear.

[@Liqweed1337]

how can i use comfyui (or Automatic1111's Web UI) to implement a transcription lipsync feature so the model reads your text?

[@Nickel-W]

Thank you!

[@MDMZ]

You're welcome!

[@OpenUniversityMBA-nu8ud]

Please tell me system requirements to install this software? Please 🙏

[@andrestamashiro]

Hi, friend! Can this be run from Google Colab? or only from local with GPU?

[@MDMZ]

Yes! I believe it's possible, Olivio Sarikas has a tutorial on it

[@PK-gu1wp]

Wow, that's a good video.

[@MDMZ]

Glad you think so!

[@HYPERGIRLAI]

This is amazing! But for some reason my image of my subject keeps changing on every frame? How do I keep just one consistent image throughout 1 render?

[@MDMZ]

try guiding it more with prompts, and I have a video on how to generate consistent characters in Midjourney, it might help

[@digital_magic]

Awesome video Mate 🙂 I am definitely gonna try this. Comfyui still looks overwhelming to me, but i just have to dive into it i guess 🙂 Why is it so much better then A1111? Because of the output quality? Or the workflow and speed of rendering?

[@MDMZ]

Thanks Lenny! glad you like the video, ComfyUI is certainly much easier to setup, it still has its own limitations but I like how easy it is to load/import workflows, customize them, and having visibility over the generation queue, I did hear from other users that it runs faster on lower end GPUs as well, but not sure as I didn't do any speed comparison tests

[@digital_magic]

@@MDMZ He Mohammed, Thanx for the great explanation, i am definitely going to dive into it. I like that the loading and importing of workflows is easy 🙂 But i heard it can't run Deforum yet. Wish you a nice weekend 🙂

[@MDMZ]

@@digital_magic yeah I would still use A1111 for things like deforum, have fun!

[@digital_magic]

@@MDMZ Thanx and i am glad you share the same opinion about deforum 🙂

[@I_am_hikari_blade]

Thanks a lot for your videos . Is there any model that you can recommend to generate video from a midjourney image ? Basic camera movement would be good ( pan tilt zoom ) I haven't tried deforum yet . maybe is the one to try

[@MDMZ]

you can generate images in midjourney and then use an image to video tool such as stable video diffusion, kling ai, etc.. I do have videos on those

[@tonytitani410]

Hi thanks for the video! I'm getting this error whenI drag in the setup image into the UI: When loading the graph, the following node types were not found: ADE_AnimateDiffLoaderWithContext Nodes that have failed to load will show as red on the graph. HELP! I've tried reinstalling and restarting.

[@MDMZ]

hi, can you try to follow the steps from @lihuelalejandro7786's comment ?

[@tonytitani410]

Yes thanks - that got me the VHS node but the actual AnimateDiff Loader is installed but showing up as missing. I'm thinking it has something to do with being on a Mac unfortunately. Thanks @@MDMZ

[@imrsvhk]

To anyone else having this error : "ADE_AnimatedDiffLoaderwithContext" and trying EVERYTHING with no luck - in manager do an Update All - Finally worked. Thought I was going crazy doing several clean installs and restarts.. The only thing that worked was doing this as the last step.

[@tonytitani410]

@@imrsvhk are you on a Mac and using ComfyUI through Pinokio?

[@imrsvhk]

@@tonytitani410 Sorry No, windows.

[@barisvkabalak]

Hii. Thank you for this tutorial. 🙏🧡 How can I add zoom in camera?

[@MDMZ]

I believe there are new models for that which I havent covered on the channel yet, but you can try specifying the movement in the prompt, sometimes it works

[@Parzival047]

Could not find ComfyUI manager button in the Comfy UI manager website

[@MDMZ]

Hey there, the only button you need on that page is the download button, it's a big blue button 😁

[@MDMZ]

if you dont see the manager on your ComfyUI, make sure you place the manager file in the comfyUI directory before running it, and restart comfyUI

[@muntcrispa]

I have the same issue! After I extract Comfy ui, I download the Manager, extract it like instructions, and still no Manager in the GUI. Any advice please ? Thank you in advance@@MDMZ

[@PowerHouseWealth]

Thank you so much for this! ComfyUI is so much more powerful. You're a Top G! You earned new subscriber as well, thanks again! Please do more video's like this on ComfyUI.

[@MDMZ]

Thanks for the sub!

[@denimatthewvr]

Fantastic tutorial! Thanks a lot, right now Im watching your second video on AnimateDiff. Then I will watch what you have on Automatic 1111. Can you please help us to use the LoRAs?

[@MDMZ]

Have fun!

[@capstoned]

Getting error- node types not found when load workflow- I see it in the Custom note folder animate diff loader w context and vhs video combine... CUI is not seeing custom node ...did restarts

[@MDMZ]

hi, check the pinned comment

[@Archalternative]

How many resources are needed? How much minimum Vram do I need?

[@Pauluz_The_Web_Gnome]

How to control the movement so we can make real short movies? Instead of random weird movements?

[@MDMZ]

This is a super new tool, cant ask much from it yet, but i like yoir ambition 😉

[@fintech1378]

comfyui is the way of the future

[@MDMZ]

I agree

[@arjuntrehan48]

4:57 hey bro can u please send me the link for this workflow becoz its removed by the github host

[@MDMZ]

can you try again, the workflows are still there, u just need to scroll down

[@spencerking857]

Hey I get the following error code: "When loading the graph, the following node types were not found: ADE_AnimateDiffLoaderWithContext Nodes that have failed to load will show as red on the graph." Any ideas?

[@spencerking857]

ComfyUImanager and Animate diff are properly installed but no luck. I cant get the error to go away

[@MDMZ]

update ComfyUI

[@Media7Malayalam]

updated. but the same error showing @@MDMZ

[@thatoneflyinghat]

I'm running into an issue that says "Error occurred when executing KSampler: cannot access local variable 'orig_memory_required' where it is not associated with a value" Any help?

[@MDMZ]

hi, check the pinned comment

[@ONEB3AST]

Does img2img works in comfyui?

[@MDMZ]

yes

[@Solacecrafting]

FYI, going through this (thanks by the way) I had to also install ComfyUI-VideoHelperSuite custom node set due to the AnimateDiff pages workflow examples now requiring it.

[@MDMZ]

Thanks for sharing!

[@YumHead]

I am getting the VHS_VideoCombine errors, where do I put ComfyUI-VideoHelperSuite ?

[@MDMZ]

what does the error say ?

[@ludvigInLegendaryLands]

Hi! I can't see the cutsom node called "AnimateDiff (Kosinkadink version)". I only have "Animate Diff Evolved" which is published by Kosinkadink. I've isntalled it, but cant find any nodes called "Animate Diff Loader". Anyone had the same issue?

[@MDMZ]

does it work after installing that ? you can try to import the Wokflow first, and use the manager to install missing nodes, it should be able to detect the nodes

[@lordzmusic8461]

What is the specs required for installation of COMFY UI ?

[@MDMZ]

I haven't found an official list of requirements from the developers, but it's important to have a decent GPU, with atleast 12GB of VRAM to get it run properly

[@PlayerGamesOtaku]

Hi, nothing happens to me at all when I insert the photo on the ComfyUi page. Help

[@MDMZ]

which photo are you using ? try loading the PNG file instead of the GIF file

[@kakashi99908]

Hi sweetie the image workflow we drop n now has a video module instead of animatediff combine I think it is depricated.

[@MDMZ]

can you be more specific, there are a few in the video

[@LLCinema22]

This is an awesome video. Is there any way we can make a bit longer duration vid???

[@MDMZ]

I think it's possible now

[@gumvue.studio]

do you know if thsi works on google colab?

[@MDMZ]

yes it does

[@TidyBridie89]

Hey great vid - I want to use my own images to create an animation - do I have to add an image to the animated nodes?

[@MDMZ]

not yet possible

[@beatmekkerz]

Could I for example create say Naruto running and then fighting nothing. Then make a video of me in animatediff of me fighting back nothing l, then edit it together. Or do I need t go down the 2D animation path?

[@MDMZ]

you will definitely need to do some compositing in software like After Effects, have fun!

[@beatmekkerz]

@@MDMZ that what I was afraid of 😂 #herewego

[@maxeduai]

Can you use stable warp fusion with ComfyUI?

[@MDMZ]

warpfusion works on google colab

[@maxeduai]

Another question my man, how can I import settings on stablewarp easily like deforum? I Couldnt find in the colab@@MDMZ

[@sagarchogale2809]

Hi, I was following a tutorial, but comfyUi manager was not installing...

[@MDMZ]

check the pinned comment

[@platypussrex]

For some reason all of my outputs have the same semi-transparent watermark across the video in the bottom third of the frame. Added watermark to the negative prompt but it persists. Any idea? Is it something embedded in one of the animatediff models?

[@MDMZ]

watermark? that's weird, try using a different model

[@platypussrex]

@@MDMZ Read somewhere that the animateDiff models were trained with shutterstock images and are prone to watermarking

[@ItsStewys]

Hi, Topaz Video AI is error 404'ing. So I'm trying to work out the upscaling via comfyUI and wondering if I have to re prompt everything again after dropping the upscaling workflow in, or can i just add the node into my current workflow (and how/where to connect it) and then running the prompt again to upscale? I from A1111 where upscaling is so much more simpler lol.

[@MDMZ]

I'm looking into that as well, it would be much more efficient, currently you have to do it manually if you move from the normal workflow to upscaling workflow. just fixed the topaz link, thanks for pointing it out

[@aidarffb2861]

can you tell me how to get a lot of results at once? For some reason it doesn't work to get more than one, thanks for the video!

[@MDMZ]

not sure what you mean, are you referring to the prompt travel method? I'm working on a separate video for that

[@AM7AM012]

I still have an error after I installed the custom node ComfyUI-VideoHelperSuite, could you please advise how I can fix this issue?

[@MDMZ]

hi, what's the error?

[@AM7AM012]

Hi @@MDMZ, the error says: "When loading the graph, the followingnode types were not found: VHS_VideoCombine" The output node for the image shows red in the graph. Thanks!

[@MDMZ]

@@AM7AM012 open manager, and install missing custom nodes

[@TidyBridie89]

The install manager doesn't appear to load - any ideas as to why this isn't working? Great video by the way!

[@MDMZ]

hi, can u try downloading the latest version of "Git for windows", and reinstall comfyui+manager

[@sebasketball]

Is it possible to start with a ready (single) image instead of a text2img prompt? I have an image I wish to animate - can I start with it and then do img2img with a prompt what I want to achieve?

[@MDMZ]

not yet

[@MementoVoxDei]

cant figure out why but this crashes on the ksampler every time. cant figure out why.

[@MDMZ]

Do you see an error ?

[@TominhoD]

The manager not working.. did same like you in the video.. what i am doing wrong?

[@MDMZ]

check the pinned comment 😉

[@gary9412]

Hello Is it working on mac Intel ?

[@MDMZ]

I believe some people managed to make it work, check the ComfyUI installation guide

[@Bart-n9p]

someone have problems like mine?? Missing Node Types When loading the graph, the following node types were not found VHS_VideoCombine i did instrall it from custom node but (IMPORT FAILED) ComfyUI-VideoHelperSuite

[@MDMZ]

if it persists try reinstalling

[@thanhtrungnguyen1488]

thanks

[@MDMZ]

You're welcome!

[@thanhtrungnguyen1488]

@@MDMZ i need workflow: img2img of animatediff-comfyui. Can u help me? Thanks.

[@aswadi01]

hello sir.. why my config manager missing

[@MDMZ]

Hi,check the pinned comment

[@darrenelkins5923]

how to install ffmpeg? thanks

[@STDDB]

Im gwtting this error Error occurred when executing CheckpointLoaderSimple: 'NoneType' object has no attribute 'lower' File "D:\Comfyui\ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ How can i solve it?

[@MDMZ]

make sure you place the correct model in the right folder

[@TopsyPlay]

ещё бы сиды каждого кадра были идентичными как Runway Gen-1...

[@billyanimation9757]

For some reason I can't install ComfyUI Manager

[@MDMZ]

hi, check the pinned comment

[@gracjankania]

Thank you

[@MDMZ]

You're welcome!

[@focusedstudent464]

​​@@MDMZis this free or we need to pay for this ai

[@XuanGOD]

Awesome video. Can you try to make it work on gg collab for some one with weak computer like myself

[@MDMZ]

hi, that's possible, you can check the tutorial by olivio sarikas

[@EranMahalu]

Hi and thanks for the tutorial. I get this error: Error occurred when executing ADE_AnimateDiffLoaderWithContext: invalid load key, '

[@MDMZ]

hi, it looks like you have a typo somewhere, double check your prompts, I might be wrong tho, so check the pinned comment for more support

[@fredrikbostad8585]

@@MDMZ Hi there! I'm getting the same error as Eran, any more suggestions on how to fix thisd? Many tnx!

[@dougsbir]

you lost me after saving the file to the vae folder! i am a chef and artists so i managed to get that far then lost the plot please help....... brain fog now!

[@MDMZ]

hi, are u unable to find the VAE folder ?

[@Bhavenjain2479]

❤❤

[@filipenazario3370]

make a video for the loras please :D

[@MDMZ]

👌

[@maverickpictures6895]

something is wrong, i do all the steps, use the workflows provided, and they do not produce the same result, it is superbad colors, low quality, weird rgb artefacts

[@MDMZ]

strange, feel free to drop your workflow on discord, I'll have a look

[@maverickpictures6895]

@@MDMZ thank you, doing now :)

[@ojasvisingh786]

🥳👏👏

[@Bhavenjain2479]

Make A Video On how to make wonderful anime series/short movie using AI tools, editing Software also unreal engine 5 or blender. Step by step process Sound effects Characters Storyline Amazing looking scene or environment Intro song Theme ❤❤ 😊😊 It is possible Plz make a Video

[@MDMZ]

Thanks for the idea!

[@SmokinFoolz]

Here in 2024. Late to party.

[@MDMZ]

you can catch up

[@amritpaul3944]

I want to learn from u

[@MDMZ]

well, u came to the right channel

[@ThinkLife999]

Is it free

[@MDMZ]

yes

[@CaptainKokomoGaming]

Comfy just isn't as popular unfortunately. The intimidating workspace just scares too many people off.

[@MDMZ]

True, but I think the interest will grow over time

[@deadbushlover3511]

For example me, I’m leaving automatic1111, it’s too damn buggy, everywhereeeee bugs bugs bugs…….. errors errors errors……..

[@CaptainKokomoGaming]

@@deadbushlover3511 I haven't had that yet with A1111. I guess I get overwhelmed by comfy with everything in my face at once. That and I could never get it to work like I wanted it to.

[@skudcode1739]

same workflow, not woking 😐

[@MDMZ]

how so ? getting an error ?

[@TheSus0ne]

my stupid ahh thinking ui means user interface

[@MDMZ]

what is it then ?

[@fatihalioglu9964]

VHS_Video Combine errror

[@MDMZ]

hi, can you try to follow the steps from @lihuelalejandro7786's comment ?

[@fatihalioglu9964]

thank you Bro@@MDMZ