Turn yourself into ANY STYLE with ComfyUI [PS1, 3D Animation, Anime…]

  Рет қаралды 25,658

Mickmumpitz

Mickmumpitz

Күн бұрын

I'll show you how you can turn your videos into any style you want (Disney Pixar 3D animation, anime or retro games) for free using ComfyUI!
If you like my work, please consider supporting me on Patreon: / mickmumpitz
Follow me on Twitter: / mickmumpitz
👉 Download the FREE workflow here: www.patreon.com/posts/9881896...
INSTALLATION
1. Download ComfyUI: github.com/comfyanonymous/Com...
2. Download ComfyUI Manager: civitai.com/models/71980/comf...
- if it is not showing up try this version: github.com/ltdrdata/ComfyUI-M...
3. Download the MODELS: docs.google.com/document/d/10...
4. Import the & have fun creating amazing AI Animation!
Models shown in the Video:
Pixar: civitai.com/models/65203/disn...
Flat2d Animerge: civitai.com/models/35960/flat...
Find other Models: Civitai.com
CHAPTERS
00:00 Intro
00:46 ComfyUI Installation
02:25 First Example
03:02 Workflow Walk-through
06:42 No talking / No People
07:24 Changing the Style

Пікірлер: 199
@mickmumpitz
@mickmumpitz 4 ай бұрын
Important BUG FIXES: I have updated the model list for all those who have received error messages (the new models are green). Download these models and add them to the folders. Let me know in the comments to this post if you still have any issues! For those who don't see the manager I have added another download link. Try to downloading / installing the manager from this link. Thanks for all your feedback and help with troubleshooting!
@MIKH41L
@MIKH41L 4 ай бұрын
Error occurred when executing ACN_AdvancedControlNetApply: 'NoneType' object has no attribute 'copy' File "C:\Users\misha\Downloads\ComfyUI_windows_portable\ComfyUI\execution.py", line 152, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\misha\Downloads\ComfyUI_windows_portable\ComfyUI\execution.py", line 82, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\misha\Downloads\ComfyUI_windows_portable\ComfyUI\execution.py", line 75, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\misha\Downloads\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Advanced-ControlNet\adv_control odes.py", line 173, in apply_controlnet c_net = convert_to_advanced(control_net.copy()).set_cond_hint(control_hint, strength, (start_percent, end_percent)) ^^^^^^^^^^^^^^^^ i still get the error
@tompilot4574
@tompilot4574 4 ай бұрын
Hey there, followed your advice, but i still get this error Error occurred when executing ControlNetLoaderAdvanced: Weights only load failed. Re-running `torch.load` with `weights_only` set to `False` will likely succeed, but it can result in arbitrary code execution.Do it only if you get the file from a trusted source. WeightsUnpickler error: Unsupported operand 118 File "C:\Users\tompi\Documents\ComfyUI\ComfyUI_windows_portable\ComfyUI\execution.py", line 152, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\tompi\Documents\ComfyUI\ComfyUI_windows_portable\ComfyUI\execution.py", line 82, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\tompi\Documents\ComfyUI\ComfyUI_windows_portable\ComfyUI\execution.py", line 75, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\tompi\Documents\ComfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Advanced-ControlNet\adv_control odes.py", line 90, in load_controlnet controlnet = load_controlnet(controlnet_path, timestep_keyframe) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\tompi\Documents\ComfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Advanced-ControlNet\adv_control\control.py", line 512, in load_controlnet controlnet_data = comfy.utils.load_torch_file(ckpt_path, safe_load=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\tompi\Documents\ComfyUI\ComfyUI_windows_portable\ComfyUI\comfy\utils.py", line 20, in load_torch_file pl_sd = torch.load(ckpt, map_location=device, weights_only=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\tompi\Documents\ComfyUI\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\serialization.py", line 1039, in load raise pickle.UnpicklingError(UNSAFE_MESSAGE + str(e)) from None
@mickmumpitz
@mickmumpitz 4 ай бұрын
@@tompilot4574 Can you go into the ComfyUI manager, install custom nodes and check if "ComfyUI's ControlNet Auxiliary Preprocessors" is installed? Then go to manager "Update All", restart and try again.
@tompilot4574
@tompilot4574 4 ай бұрын
@@mickmumpitz hey there, thanks for the support , i updated the node you said, because it was already installed using the manager, but now i still get this error Requested to load SD1ClipModel Loading 1 new model ERROR:root:!!! Exception during processing !!! ERROR:root:Traceback (most recent call last): File "C:\Users\tompi\Documents\ComfyUI\ComfyUI_windows_portable\ComfyUI\execution.py", line 152, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\tompi\Documents\ComfyUI\ComfyUI_windows_portable\ComfyUI\execution.py", line 82, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\tompi\Documents\ComfyUI\ComfyUI_windows_portable\ComfyUI\execution.py", line 75, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\tompi\Documents\ComfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Advanced-ControlNet\adv_control odes.py", line 90, in load_controlnet controlnet = load_controlnet(controlnet_path, timestep_keyframe) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\tompi\Documents\ComfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Advanced-ControlNet\adv_control\control.py", line 512, in load_controlnet controlnet_data = comfy.utils.load_torch_file(ckpt_path, safe_load=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\tompi\Documents\ComfyUI\ComfyUI_windows_portable\ComfyUI\comfy\utils.py", line 20, in load_torch_file pl_sd = torch.load(ckpt, map_location=device, weights_only=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "C:\Users\tompi\Documents\ComfyUI\ComfyUI_windows_portable\python_embeded\Lib\site-packages\torch\serialization.py", line 1039, in load raise pickle.UnpicklingError(UNSAFE_MESSAGE + str(e)) from None _pickle.UnpicklingError: Weights only load failed. Re-running `torch.load` with `weights_only` set to `False` will likely succeed, but it can result in arbitrary code execution.Do it only if you get the file from a trusted source. WeightsUnpickler error: Unsupported operand 118 Prompt executed in 43.01 seconds
@tompilot4574
@tompilot4574 4 ай бұрын
@@mickmumpitz Hey there ! i found a fix maybe? so Instead of having the "control_v11p_sd15_canny" in the box that sais "Load Advanced Control Net Model" i instead put the "control_v11f1p_sd15_depth" one inside this box and now its working... But you had the canny one in the box. I hope me choosing the depth one will not affect my output differntly than yours? is this the right thing to have here? because its the only thing that works in the box the canny one you had there doesnt work for me
@MisterCozyMelodies
@MisterCozyMelodies 3 ай бұрын
bro, you give every possible detail, you`re amazing!!
@psiga
@psiga 4 ай бұрын
I love how you've implemented these things, explained these things, and that you're willing to share them with us in the first place! ^‿^
@m3nafsy
@m3nafsy 4 ай бұрын
Man you really have the best channel for this type of content everyone here just marketing a ai tools costing a lot of money and not usable things too you are the best ♥️
@fernandooliveira1991
@fernandooliveira1991 4 ай бұрын
ty, one of the few that is not selling web ai services, subscribed to see what more you can do
@MariusBLid
@MariusBLid 4 ай бұрын
Yet again amazing work from you!❤
@SemorezX
@SemorezX 4 ай бұрын
thank u so much for Workflow sharing as free 😍
@fabianmosele2321
@fabianmosele2321 4 ай бұрын
wow, this is an AMAZING tutorial. Very well explained, with workflow and list of models to download (plus their path position in the folder which more often than not isn't included, yet so important!). THANKS SO MUCH
@oberdoofus
@oberdoofus 4 ай бұрын
it is a great tut to be sure - one of the most concise out there - but some of those linked models appear to be pickle tensors which are not as safe as safetensors?
@MattMosquito
@MattMosquito 4 ай бұрын
A brilliant guide as always! Clear, concise... perfect. Thanks for pushing things forward as you always do, keep up the great work.
@stickmanland
@stickmanland 4 ай бұрын
Would love a comfy UI course for begginers
@ogamaniuk
@ogamaniuk 2 ай бұрын
Are there any?
@maureenbenner7588
@maureenbenner7588 2 ай бұрын
What are you looking to do with ComfyUI as a beginner?
@drucshlook
@drucshlook Ай бұрын
That's what this is tbh ^^ But maybe start with image generation rather than videos
@kurtlindner
@kurtlindner 4 ай бұрын
Without any doubt, you are my favorite AI KZbinr.
@Strawberry_ZA
@Strawberry_ZA 4 ай бұрын
absolutely phenomenal guide - the best!
@SanAndreas-Akiyama
@SanAndreas-Akiyama 4 ай бұрын
you are my favorite AI KZbinr
@dwbrgames
@dwbrgames 3 ай бұрын
You are so good at making videos. And teaching us how to do it. Thank you for always sharing nice stuff with your audience.
@johnyoung4409
@johnyoung4409 4 ай бұрын
Thanks so much for sharing this!
@igorsachadeluigi
@igorsachadeluigi 4 ай бұрын
This is great! 🙌🏻
@sunlightlove1
@sunlightlove1 4 ай бұрын
very crisp and on point . thanks for video really great explanation
@jeromeneareo4730
@jeromeneareo4730 25 күн бұрын
Stunning content !
@drucshlook
@drucshlook Ай бұрын
awesome, second times I stumble upon your video. great content.
@Inner-Reflections-AI
@Inner-Reflections-AI 4 ай бұрын
Thanks for the shout out! This is a brilliant approach to lip sync!!
@mickmumpitz
@mickmumpitz 4 ай бұрын
Thank you! This would not have been possible without your fantastic work!
@highlandsdweller
@highlandsdweller 4 ай бұрын
Thank you very much for the video!
@hamzaagens
@hamzaagens 4 ай бұрын
You're amazing! Been looking for days now for something that's coherent without being completely overwhelming and this seems like a great guide! Thanks so much for the workflow...can't wait to try it out. Would you happen to a workflow version or have advice for how one might use a lora stack as well as facedetailer with your workflow? Thanks again!
@k9habidu
@k9habidu 4 ай бұрын
First (from playlist) 🙋‍♂ Great channel, keep it up!
@TitiNorimaki-tb8cr
@TitiNorimaki-tb8cr 4 ай бұрын
Thank you so much, this is insane 🔥🔥🔥
@MarjanNik
@MarjanNik 4 ай бұрын
You are a king 🙌
@spraygospel5539
@spraygospel5539 4 ай бұрын
This is the smoothest AI animation I've ever seen. You're amazing man. I have suggestion for the next video: 1. how to make animation based on your face, but the output is a different face (an anime girl face with horns for example) 2. How to capture the AI animation of just the actor (without background) by using green screen. thnks again btw.
@3dccnz352
@3dccnz352 4 ай бұрын
Great video explaining all the steps involved. Keep up the great work.
@multiverse-republic
@multiverse-republic 4 ай бұрын
hey bro good work. thank you!! 👍👌
@mrhmakes
@mrhmakes 4 ай бұрын
fantastic stuff. you're doing some great work. Thank you for your tut! one question some of your models used are pickletensors? I assume that using the safetensor versions / alternatives should be fine?
@ANTONFIXER
@ANTONFIXER 4 ай бұрын
Looks swesome!
@user-df5cm2sy8i
@user-df5cm2sy8i 4 ай бұрын
thanks for share!
@yvann.mp4
@yvann.mp4 4 ай бұрын
Amazing thanks a lot
4 ай бұрын
🔥 thanks
@Hubb990
@Hubb990 3 ай бұрын
Yo this cool!
@timbacodes8021
@timbacodes8021 4 ай бұрын
Wow!
@HuemanInstrumentality
@HuemanInstrumentality 4 ай бұрын
Wow, what a wonderful tutorial! Do you know of some way to do prompt schedualing with this workflow? I've never been able to find a way to do so with SD1.5 animatediff.
@clampet15
@clampet15 4 ай бұрын
This workflow is very nice! Do you have any recommendations on extra tactics to help the eyes be more consistent? I feel like I'm getting a lot of eye drift throughout my animations, and turning on the eye and pupil settings in the face mesh setup you have really just messes up the output. Maybe another set of control nets or is there a way to run multiple masks -- one for the mouth, and one for the eyes?
@automation-nv4ww
@automation-nv4ww 4 ай бұрын
This is so good..subscribed..by the way what GPU are you using? and how long it took ?
@mickmumpitz
@mickmumpitz 4 ай бұрын
Thank you! I have a pretty old GPU (for this kind of stuff) with only 8 GB of VRAM (NVIDIA GeForce RTX 2070 SUPER). Video generation for the examples took between 2 and 15 minutes.
@michalgonda7301
@michalgonda7301 3 ай бұрын
Thank you, love your work :), btw Could you please tell me which model checkpoint or lora did you used for Zelda BoTW look? :)
@moritzryser
@moritzryser 4 ай бұрын
thank you boss
@AI-nsanity
@AI-nsanity 3 ай бұрын
Hello thank you so much for the workflow it's working great i'm wondering if you can add an upscale step to fix some problems like eyes not showing correctly ?
@KadyongAnimeTv
@KadyongAnimeTv 3 ай бұрын
Thank you..❤❤❤❤❤
@tamtamX-cq8or
@tamtamX-cq8or 4 ай бұрын
Great tutorial thanks for sharing. Did you try using multiple ip adapters with attention masks? I figured the ip adapter plus model is great for anything else than the plus face or full face just for the face itself.
@ratside9485
@ratside9485 4 ай бұрын
Nice
@haukeh3803
@haukeh3803 4 ай бұрын
Great workflow. Is it possible to disconnect the character's look from the video, like using a video of you but prompt "Disney Princess" or is it always connected to the look of the person in the video?
@omarbromar
@omarbromar 25 күн бұрын
THIS IS WHAT I'VE BEEN LOOKING FOR! THANKS A LOT!!!!!
@JunaidAmjadPhotography
@JunaidAmjadPhotography 4 ай бұрын
Great tutorial man, subbed as well. Just a question, can this convert longer length videos too like 3 4 min?
@mickmumpitz
@mickmumpitz 4 ай бұрын
Thank you! It is possible, but of course it takes quite a long time if you don't have a good graphics card.
@bryangalisa4337
@bryangalisa4337 28 күн бұрын
Hey man, thanks for this incredible content, I'd love that so much, with my computer I can't handle with this much, my GPU is a GTX 1660Ti, 16GB ram, and I5 7th gen, but I bought a new PC with a RTX 4070 Super, how is the configuration of you PC? and, this workflow still work?
@NimbusAbi
@NimbusAbi 3 ай бұрын
the animatediff models got renamed. So if you load them you have to either rename them in the workflow or in the folders
@budygang9918
@budygang9918 4 ай бұрын
Awesome! Thanks a lot to share your knowledge with the community
@mickmumpitz
@mickmumpitz 4 ай бұрын
Haha yeah me too! Just go to settings (gear symbol next to the queue symbol) and set "Link Render Mode to "straight"
@user-nd7hk6vp6q
@user-nd7hk6vp6q 4 ай бұрын
Hi new sub here, your tutorial is very good, one question pls, what if i want the person in the video generated to have a different clothing, image style and background from another reference image but still has the same movement as the person in the video uploaded, like if i want to Animate a person from an image to move like the person in the uploaded video and also in a different background, pls do you understand 😢
@stiffcore
@stiffcore 4 ай бұрын
Would this work on something not filmed in real life? I mean using comfyUi on top of an animated film or game cutscene etc?
@europaneli807
@europaneli807 4 ай бұрын
NIce tutorial, How can I get video by frames in output?
@moritzryser
@moritzryser 4 ай бұрын
would it make sense to add a loras or hypernetworks to this workflow as well? if so at what point would I add them?
@JorgeLuisAR
@JorgeLuisAR 2 ай бұрын
quick question, in the load ip adapter, there is a "model name" where do i have to put the models to be shown and where do i download them? im using the version 3 of your WorkFlow
@benjamindeblanzy
@benjamindeblanzy 4 ай бұрын
Thank you so much for this grat workflow; unfortu ately I have the same syntax error each time I try to run this workflow:(( SyntaxError: Unexpected non-whitespace character after JSON at position 4 (line 1 column 5) Do you have a solution for this ? Thanks
@yannoid8642
@yannoid8642 4 ай бұрын
An additionnal step to correct the eyes would be neat. I wonder if there's any tip out there
@zrakonthekrakon494
@zrakonthekrakon494 4 ай бұрын
Try different words for the prompting, try using some more detailed descriptions
@smoothhunter3482
@smoothhunter3482 2 ай бұрын
Hey Mick I am able to run the whole thing but I am going through problems 1) sometimes it gives an error memory ran out so can you tell me what config I need to run this workflow 2)the results I am getting are not the same as the video you shared secondly I am getting only 1 second of the video I don't know why 3) I think you didn't update the adapter models and directory after the update (not confirmed about this) any help would be appreciated hoping for a reply 😀 I think you should make a second part of video since many things are changed
@Fontgod
@Fontgod 4 ай бұрын
I suspect it wont be too long before we start to see Ai able to completely change a game's graphics on the fly, similar to how we can currently use a shader in Reshade for simple effects. We'll be able to completely change the look of a game in realtime, bring an old game up to modern graphical standards (or surpass), or retheme etc. Anyone want to take a guess at when we'll have consumer grade dedicated Ai chips that will perform at the level required for very low latency processing on a local machine? Perhaps it will initially be a cloud based service.
@brentbartholomew1773
@brentbartholomew1773 3 ай бұрын
Hi. I don't know a lot about computers but after i clicked to run the comfyui managers, it says it can't find an NVidia graphics card...i think i have one on my other computer and will try that one. Question- is there anything else I would need to run this? Either computer hardware related or software related. I heard you mention stable diffusion. Do I need to have a subscription to that? Thanks.
@iKartoonTo
@iKartoonTo 2 ай бұрын
Hi! it's working! Thanks.. But i want to ask about what if i have 1min up to 2min video? i understand i need to set the skip_first_frame.. but you said the frame_load_cap need's to be set in 15? how can i do batch by batch? can you enlighten me please?
@ProjectMindbot
@ProjectMindbot 4 ай бұрын
this is super powerful was able to get fixed yeah wrong control net it looks really good all 3 on to doing stuff for my sons birthday but I notice lip sync is off I will review the video see if you mention but anyone know what is good to like possible get lips put them on it in realtime also was thinking be fun me walk around and attempt to talk script then AI voice change on it for a series start getting experimental with it
@AlexanderKitchenko
@AlexanderKitchenko 4 ай бұрын
Unfortunately, it doesn't work. I always get Error occurred when executing IPAdapterApply: Error(s) in loading state_dict for Resampler: size mismatch for proj_in.weight: copying a param with shape torch.Size([768, 1280]) from checkpoint, the shape in current model is torch.Size([768, 1024]). Doesn't really matter what kind of resolution my video has, it always halts on this step.
@mickmumpitz
@mickmumpitz 4 ай бұрын
Can you download the new ClipVision (I updated the link in the drive document) Model and try it out again? It should work now! Make sure the new one is selected in the "Load CLIP Vision" node in the IPAdapter setup.
@AlexanderKitchenko
@AlexanderKitchenko 4 ай бұрын
@@mickmumpitzThanks, man! Now it works like a charm!
@ProjectMindbot
@ProjectMindbot 4 ай бұрын
Error occurred when executing InsightFaceLoader: No module named 'insightface' could this be issue this is with just the IP adapter going to try a runpod to see If it solve the issue
@filippobartoccioni1693
@filippobartoccioni1693 4 ай бұрын
Great video but i tried to download the tools and install it but the manager button left of the screen does not appear.. I do not have invidia card. so I click on run_cpu.bat but it opens but the manager do not appear. i tried several times. I tried also the new link you gave us but it does not make the manager appear. can you help me? thank you
@storiesdosfamosos8979
@storiesdosfamosos8979 10 күн бұрын
Hi, I like your workflow and your video but I need help understanding how to generate longer videos of 30 seconds or 1 minute, 5 minutes help me please
@legshots3124
@legshots3124 2 ай бұрын
hey mick i am able convert this perfectly can but i can only get 14 frames and if i increase the frames it gives me memory error i have ryzen 5 1500x 16gb ram rtx 2060 6gb if you dont mind can you tell me how i can convert atleast 30sec to 1 min clip in single shot it will be really helpful
@MisterCozyMelodies
@MisterCozyMelodies 3 ай бұрын
control_v2p_sd15_mediapipe_face, there is 4 files with the same name but different extensions, which extension should i download and put ComfyUI_windows_portable\ComfyUI\models\controlnet ???
@eliko799
@eliko799 23 күн бұрын
Hey, I get this error: "No faces detected in controlnet image for Mediapipe face annotator." I made sure I installed the latest models on your word document. please advise!
@PapayaPositive
@PapayaPositive 4 ай бұрын
Son of a gun! Pew, pew! 💥🔫
@futurediffusion
@futurediffusion Ай бұрын
amazing video, can you tell me the ps1 style model name please ' ?
@mickmumpitz
@mickmumpitz Ай бұрын
I combined the two Lora’s ICBIN64 and ps1graphicsRW to get this look
@hakimmhaidrat
@hakimmhaidrat 4 ай бұрын
For tgose who hasn't a gpu pc, can we use this in google colab?
@the_sigma_guy
@the_sigma_guy 2 ай бұрын
Hi, I've got "Error occurred when executing KSamplerAdvanced: mixed dtype (CPU): expect parameter to have scalar type of Float" How can I fix this? Thank you!
@izabotin
@izabotin 4 ай бұрын
Not working( What resolution for uploaded video? Error occurred when executing IPAdapterApply: Error(s) in loading state_dict for Resampler: size mismatch for proj_in.weight: copying a param with shape torch.Size([768, 1280]) from checkpoint, the shape in current model is torch.Size([768, 1024]).
@SimonePixel
@SimonePixel 4 ай бұрын
Sorry if you are seeing multiple replies from me here. Its a checkpoint and clip vision model training size mismatch. Not to do with the video size you are using. I think my last posts were rejected or something. Use this Clip Vision model instead. You can find it on hugging face: IPAdapter_image_encoder_sd15
@izabotin
@izabotin 4 ай бұрын
​@@SimonePixel Thank you for your reply! I change it and get this message Error occurred when executing ADE_LoadAnimateDiffModel: 'control_sd15_canny.pth' is not a valid SD1.5 nor SDXL motion module - contained 0 downblocks.
@mohitarora7032
@mohitarora7032 Ай бұрын
How much time it will take to render 1 min long clip
@KushagraSharma-qh2zi
@KushagraSharma-qh2zi 2 ай бұрын
Can we apply 1.5 model?
@mohamadrezaboragh3358
@mohamadrezaboragh3358 Ай бұрын
Hello, I had a problem with a part and it gives me this error When loading the graph, the following node types were not found: Integer IPAdapterApply Nodes that have failed to load will show as red on the graph.
@LucasBahamondesToro
@LucasBahamondesToro Ай бұрын
When loading the graph, the following node types were not found: Integer IPAdapterApply Nodes that have failed to load will show as red on the graph. I have this issue, i didn't find them in the manager...any help please?
@spraygospel5539
@spraygospel5539 4 ай бұрын
it shows an error when I press queue prompt. How can I fix it? My VRAM is 8GB, everything has been put to the folder including the IPadapter. Error occurred when executing IPAdapterApply: Error(s) in loading state_dict for Resampler: size mismatch for proj_in.weight: copying a param with shape torch.Size([768, 1280]) from checkpoint, the shape in current model is torch.Size([768, 1024]).
@AlexanderKitchenko
@AlexanderKitchenko 4 ай бұрын
Got the same error
@AI-nsanity
@AI-nsanity 3 ай бұрын
Can you tell me wich model did you use for the PS1 graphics please ?
@futurediffusion
@futurediffusion Ай бұрын
oh i want that model too
@Djin-Lin
@Djin-Lin 3 ай бұрын
Hi. Thanks for the video. When I connect any other models, I always get an error. Why is this happening? Do I have to choose some special models?
@mickmumpitz
@mickmumpitz 3 ай бұрын
Strange, any 1.5 checkpoint model should work.
@Djin-Lin
@Djin-Lin 3 ай бұрын
@@mickmumpitz Thank you for your reply. And in doing so, I don't need to change the LORA, VAE or anything else?
@m3nafsy
@m3nafsy 4 ай бұрын
Hmm can i run that in google colab?
@m3nafsy
@m3nafsy 3 ай бұрын
Can we use something like this in Google colab?
@ClownfishPhotograph
@ClownfishPhotograph 4 ай бұрын
Can it be used for images not a video?
@magneticgrid7998
@magneticgrid7998 4 ай бұрын
Tried it but keep on getting this error: Error occurred when executing IPAdapterApply: Error(s) in loading state_dict for Resampler: size mismatch for proj_in.weight: copying a param with shape torch.Size([768, 1280]) from checkpoint, the shape in current model is torch.Size([768, 1024]). Any help please.
@mickmumpitz
@mickmumpitz 4 ай бұрын
Can you try downloading the new Clip Vision model (I updated it in the drive document), switch it out in the folder and try running it again?
@magneticgrid7998
@magneticgrid7998 4 ай бұрын
@@mickmumpitz I tried the new Clip Vision model and now I get this error: Error occurred when executing ACN_AdvancedControlNetApply: 'NoneType' object has no attribute 'copy'
@mickmumpitz
@mickmumpitz 4 ай бұрын
@@magneticgrid7998 I updated the list again. Can you try it with the new ControlNet models that you'll find there? Thank you so much for helping me fix this!
@PixelSubstream
@PixelSubstream 9 күн бұрын
is there no way yet to fix the goofy cross eyed look the ai does with the eyes?
@Chief
@Chief 4 ай бұрын
does this work on mac?
@copterview4339
@copterview4339 4 ай бұрын
I've got IPAdapter error, workflow not usable. Checked the comments, they are mostly very vague. I think the reason is the wrong VAE model or one of the controlnets, I noticed that list of nodes is different, not the same as in your worlflow. Even comparing it to video, some names mismatch.
@mickmumpitz
@mickmumpitz 4 ай бұрын
Could you please try to download the CLIP VISION model again (there is now a new link in the document!) and replace it?
@MotionDesigner-VfxArtist
@MotionDesigner-VfxArtist Ай бұрын
@@mickmumpitz Hi, thanks and great tutorial :))) but it gives me error, ("ClipVision model not found.") , maybe it should be renamed to some other name?
@AnasGujjar-me4bf
@AnasGujjar-me4bf 3 ай бұрын
How long video can we make in Thia ai software
@culturetop3510
@culturetop3510 3 ай бұрын
why when a run "run_cpu" a don't have comfyUI manager ?
@francsharma7276
@francsharma7276 2 ай бұрын
Bro my IPAdapter is updated and now showing red colour, through which node I should replace the old IPAdapter Apply node?
@mickmumpitz
@mickmumpitz 2 ай бұрын
Make sure to download the newest version of the workflow! (v03)
@Noeltaraa
@Noeltaraa Ай бұрын
does this work on amd gpu
@mamu_jaan_619
@mamu_jaan_619 3 күн бұрын
bro your latest version is also not working..plz support (there are errors related to clip vision and ipadapter)
@KadyongAnimeTv
@KadyongAnimeTv 2 ай бұрын
SyntaxError:Unexpected non-whitespace character after JSON at position 4 (line column 5 ....sir how can i fix it 😢😢😢😢
@ProjectMindbot
@ProjectMindbot 4 ай бұрын
Error occurred when executing IPAdapterApply: Error(s) in loading state_dict for Resampler: size mismatch for proj_in.weight: copying a param with shape torch.Size([768, 1280]) from checkpoint, the shape in current model is torch.Size([768, 1024]). does anyone know how I can fix this
@plainpixels
@plainpixels 4 ай бұрын
It’s the wrong vae model. Look through the comments for a pointer towards the right one.
@animationhub.onboard
@animationhub.onboard 4 ай бұрын
Great video!!...How much storage space does it take in local?will this work same with google colab??
@MisterCozyMelodies
@MisterCozyMelodies 3 ай бұрын
1:52 it doesnt show up the button Manager here, do you know how to solve it ?
@Wicked507
@Wicked507 3 ай бұрын
I'm having the same issue, the manager button is missing. But, I'll try it again and see what happens...
@kingweb9950
@kingweb9950 3 ай бұрын
drage the icon(6 dots) on the left of "Queue size:0", now u can find "Manager" button...have fun...
@asechannel6646
@asechannel6646 3 ай бұрын
SyntaxError: Unexpected non-whitespace character after JSON at position 4 (line 1 column 5) HOW TO FIX THIS SIR THANK YOU
@user-ub8hj8ff6w
@user-ub8hj8ff6w Күн бұрын
Error occurred when executing IPAdapterUnifiedLoader: ClipVision model not found. File "E:\comfy ui ew_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "E:\comfy ui ew_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "E:\comfy ui ew_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "E:\comfy ui ew_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_IPAdapter_plus\IPAdapterPlus.py", line 506, in load_models raise Exception("ClipVision model not found.")
@user-ub8hj8ff6w
@user-ub8hj8ff6w Күн бұрын
How can I solve this problem🥲
@AkuGantengCuy
@AkuGantengCuy 3 ай бұрын
I'm running this with 2060 Super 8GB and 16GB RAM on my system. I always end up facing out of memory 😢
ANIMATEDIFF COMFYUI TUTORIAL - USING CONTROLNETS AND MORE.
24:54
enigmatic_e
Рет қаралды 82 М.
孩子多的烦恼?#火影忍者 #家庭 #佐助
00:31
火影忍者一家
Рет қаралды 3,9 МЛН
ААААА СПАСИТЕ😲😲😲
00:17
Chapitosiki
Рет қаралды 3,3 МЛН
Homemade Professional Spy Trick To Unlock A Phone 🔍
00:55
Crafty Champions
Рет қаралды 58 МЛН
Wait for the last one! 👀
00:28
Josh Horton
Рет қаралды 108 МЛН
Ultimate Guide to Seamless AI Animations (Even on Low-End PCs!)
26:38
ComfyUI AI: Inject reality into your animations
7:56
Show, don't tell!
Рет қаралды 1 М.
Games Where You're NOT the Main Character
14:52
i am a dot.
Рет қаралды 1,7 МЛН
Generate 3D PIXAR MOVIES with AI! [FREE Workflow]
11:37
Mickmumpitz
Рет қаралды 52 М.
ComfyUI ReActor Face Swap Image & Video
12:17
Data Leveling
Рет қаралды 16 М.
I made a Pixar animation with $0 in 60 days - Part 1
10:19
孩子多的烦恼?#火影忍者 #家庭 #佐助
00:31
火影忍者一家
Рет қаралды 3,9 МЛН