AnimateDiff Legacy Animation v5.0 [ComfyUI]

AI Abstract Animation in Comfy UI and Animatediff
This Tutorial Explains the Making of : • Yad (Sped up) - Loopin...
Links:
1) Workflows: drive.google.c...
2) Mistoon Model : civitai.com/mo...
3) Pyromancer Lora : civitai.com/mo...
4) My Other Free Workflows and Tutorials on my Patreon: / jerrydavos
5) My Discord Server : / discord
6) If you need Cloud GPU : www.runcomfy.c...
Other Resources:
Temporaldiff-v1-animatediff
huggingface.co...
Put in : ComfyUI\custom_nodes\ComfyUI-AnimateDiff-Evolved\models
-------------------------------------------------------------------------------------------------
Song Credits:
NIVIRO - I'll Be There [NCS Release]
Rameses B - Keep You [NCS Release]
Its All Right [CreatorMix]
-------------------------------------------------------------------------------------------------
SEO:
Animatediff control net
Animatediff animation
Stable Diffusion animation
comfyui animation
animatediff webui abstract art ai art video
animatediff controlnet
animatediff github ai art animation
animatediff stable diffusion
Controlnet animation jdcn
how to use animatediff
animation with animate diff comfyui
how to animate in comfy ui
animatediff prompt travel
animate diff prompt travel cli
prompt travel stable diffusion
animatediff comfyui video to video
animatediff comfyui google colab
animatediff comfyui tutorial
animatediff comfyui install
animatediff comfyui img2img
animatediff vid2vid comfyui
comfyui-animatediff-evolved
animatediff controlnet animation in comfyui
ai animation
ai video animation
ai animation in comfyui
ai animatediff video
abstract ai animation
-------------------------------------------------------------------------------------------------

[@david_ce]

This guy and latent vision are a God send for the community

[@grafik_elefant]

true 👍

[@SahiShah-ru3ib]

Agree 💯

[@bigconmeo]

true bro

[@Mr.WangLittleHand]

Bring us such cool stuff like always,加油 J

[@MisterCozyMelodies]

can`t believe this tutorial is out, thanks a lot!!

[@jerrydavos]

You're welcome!

[@MisterCozyMelodies]

@@jerrydavos thanks, today i tested and worked!! do you know where i can find OpenPose Library?

[@grafik_elefant]

Looks very interesting as always. Curious about your face fix workflow which looks a bit different then previous versions? Version 3 made some problems with slightly blury results and faces went a bit too dark. Dunno what i did wrong. Have you ever tried text to video with controlnet combined? I really like what i get out but i struggle to get a stable background :(

[@jerrydavos]

Hey, previous face fixer worked on LCM, which can cause blurry faces, I'll be working on tutorial for background changer next.

[@YSakhAlex65]

Thanks for the lesson, I did it! Just one question: in the "OpenPose_Directory" group, you have the value 170 in the OpenPose column in the star_index parameter, what does this mean?

[@jerrydavos]

Ummm... I must have missed to change it. The value should be back to 0. Btw I skipped 170 frames so It would also skip some dialogues of the reference video so only face motion is capture... not lips.

[@soinov_yar]

Hey, thanks for sharing. Do you use your own computer or cloud solution? I am using Runpod and this nodes are not installing :( Crystools and Allor

[@jerrydavos]

I am using both, My PC and Runcomfy.com for cloud. You can contact the support of runpod, they will help you out if there are some permissions errors during install

[@HooIsit]

Thank you!

[@limatt1511]

This is a life saving tutorial, thanks man!!! May I know is it possible to change openpose to lineart controlnet? and how can i do it? thanks a lot

[@jerrydavos]

You can Ignore the "OpenPose Groups" and 1) Connect the line art pre-processor with the images (with a load image node or so..) you want as inputs to the controlnet node Input "image" 2) Change the load controlnet model to lineArt as well Just play around with strength and end percent till you get your results.

[@MisterCozyMelodies]

i`m getting rough transitions moves, do you know how to get smooth consistency, steady like yours ? in the group Saving, already put frame_rate 8, another think my Sequence OpenPose has 170 images, is it means my batch size is gonna be 170? if i want to use the whole OpenPose Sequence

[@jerrydavos]

1) I had render like 20-30 small videos first then pick one of the best video. It's a trial and error game. 2) you can play with animatediff's motion scale settings, for getting less motion. 3) Yes, You are correct, put 170 in the batch size same as number of openpose image.

[@provi1085]

@@jerrydavos Hey thanks for the vid! 1) you mean test generating like first 10 frames, and note down the best performing seeds?

[@jerrydavos]

@@provi1085 Yes, I change seeds, motion models, motion loras, it's weights and see which variables has the best result then I render that in longer video then upscale.

[@忧郁王子-v3u]

Error occurred when executing ACN_AdvancedControlNetApply: 'NoneType' object is not iterable

[@jerrydavos]

Check that prompt travel is not enabled...

[@johnyoung4409]

Thanks for the tutorial! Can we animate real image? Using real image as input.

[@jerrydavos]

For openpose you can input real images... but can't animate like this with real image..... surely face can be swapped later

[@Lucas-uk6fj]

Can you provide pictures of openpose? Thanks

[@jerrydavos]

Here you go: drive.google.com/drive/folders/17qs6fVPk6HgxJDEhH-dmF3YxXvkWik_U?usp=sharing

[@Lucas-uk6fj]

@@jerrydavos thank,Bro! I have succeeded，

[@arcanumopus1712]

Hai, wanna ask, when i activated the open pose, i get this kind of error , any advice ? Thanks Error occurred when executing ACN_AdvancedControlNetApply: AdvancedControlNetApply.apply_controlnet() missing 1 required positional argument: 'image' File "D:\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) File "D:\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) File "D:\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))

[@jerrydavos]

Make sure you are connected to the proper reroute nodes.... Single or Directory, The Reroute nodes should be linked appropriately.

[@arcanumopus1712]

​@@jerrydavos Oh nooo thanks for the clue! wrong connected image to controlnet . it works now Thanks :D

[@imbodo1549]

Is it possible to use this workflow to animate a video? I mean the animation moves according to the original video, not a moving photo? If so, what do I need to do?

[@jerrydavos]

Nice Idea but I don't think it can be done yet....