Flux PuLID Face Swap Inpainting ComfyUI Tutorial | Consistent Character Workflow

[@haroldhankerchief6056]

i juI just so love watching the progress bar update!

[@AiMotionStudio]

me too wink wink!

[@hicks100]

When starting the workflow, ComfyUI-PuLID-Flux-Enhanced shows that it needs to be repaired, but after pressing the repair button to restart, it still shows that it needs to be repaired. When loading the graph, the following node types were not found ApplyPulidFlux PulidFluxInsightFaceLoader PulidFluxEvaClipLoader PulidFluxModelLoader What can I do?

[@AiMotionStudio]

you need to first install Pulid correctly watch this tutorial we made for the installation: kzbin.info/www/bejne/robHpoGibJKje5I

[@ondrejzuna6070]

Is anyone getting results that it really resembles the character and a face? mostly someone you know very well? It does not seem to do a good job and just generates a generic face that is somewhat similar? I would appreciate tips how to get 100% likeness as I do when training a flux lora. Thanks!

[@AiMotionStudio]

You need to increase the denoise level to make the resemblance more prominent, the maximum denoise is 1, however lower the denoise to blend the face to the rest of the image and background.

[@ondrejzuna6070]

Hi, I did do a lot of tests, not only the denoise, but also the PULID weight. Lot of different outputs and inputs. Generated over 500 pictures. Not even one closely resembled the person. The thing is, it seems to work only on faces that the model knows, so celebrities or other generated faces from the model seem to work fine. It also has the same weaknesses that Flux has, like plastic outputs, chins etc. Have you tried it with a real person? That the model has never seen? What was the resemblance? I am not saying I am not doing something wrong, just that I did not manage to make it work and would welcome any feedback :)

[@user-Cyrine]

Love your videos so much! Can you make a review video on FlexClip’s AI tools? Really looking forward to that!

[@AiMotionStudio]

Yes i am working on a workflow for the Flux Tools. we will release very soon thanks!

[@baheth3elmy16]

Non resolvable error: PulidFluxInsightFaceLoader. All nodes installed correctly, and models downloaded correctly.

[@AiMotionStudio]

Did you followed the installation video?

[@Djonsing]

Same thing, did you solve the problem?

[@baheth3elmy16]

@@Djonsing What worked for me was downloading the models with the Manager which ultimately put them in the following folder: .\ComfyUI_windows_portable_nvidia\ComfyUI_windows_portable\ComfyUI\models\insightface\models\antelopev2

[@islandofdoctormoreau]

same, been getting this for a week...

[@AmirZed]

I have a small AI project and wanted to ask if it's possible for you to collaborate?

[@AiMotionStudio]

Sure we do collaborations, what do you have in mind ?

[@gerardcolin1643]

Hi there. Everything seems to install properly and I have no missing nodes, however I get the following error during execution: SamplerCustomAdvanced forward_orig() takes from 7 to 9 positional arguments but 10 were given I am stumped at this one. Thoughts?

[@AiMotionStudio]

Try to update confyui to the version 2.0 this is what I did to get rid of the errors during execution.

[@genso1540]

Had the same issue. Seems like CustomSamplerAdvanced stopped working. ​@@AiMotionStudio

[@genso1540]

Having same issue even after updating.

[@damoose2434]

There is an incompatibility with the latest comfyUI and the pulid node. you need to update your custom nodes to get the fix. Or at least the pulid node.

[@genso1540]

@@damoose2434 I will try this and reply back. Thank you

[@ВладимирБондарь-т8ь]

Hello! I tried everything, but an error pops up Missing Node Types When loading the graph, the following node types were not found "ApplyPulidFlux" "PulidFluxInsightFaceLoader" "PulidFluxEvaClipLoader" "PulidFluxModelLoader" Please tell me how to fix it. Thank you.

[@AiMotionStudio]

did you watched the first tutorial on how to install the pulid ? please follow the tutorial on that installation and then everything will work: kzbin.info/www/bejne/robHpoGibJKje5I

[@ВладимирБондарь-т8ь]

@@AiMotionStudio Thanks for the quick reply, I have the portable version without pinokio, to my great disappointment the same error, four red nodes.

[@btsteam-cha]

@@ВладимирБондарь-т8ь i same you :(

[@ВладимирБондарь-т8ь]

@@btsteam-cha Hello! Did you find a solution to the red nodes?

[@damoose2434]

You need to open the ComfyUI manger and install the missing nodes, then restart ComfyUI

[@JhonEscobar-l5f]

i really need help with "`newbyteorder` was removed from the ndarray class in NumPy 2.0. Use `arr.view(arr.dtype.newbyteorder(order))` instead." ive tried EVERYTHING i have enough VRAM and RAM

[@AiMotionStudio]

Try to update your comfyUI to version 2.0 this should fix it

[@damoose2434]

There is an issue with ComfyUI-GGUF. Search the issues for newbyteorder. You need to update the gguf node to get the fix

[@Sean43322]

It was great. Please update Ai Ads commercial video and make new one. Thanks

[@AiMotionStudio]

Thanks, @Sean43322! I’m glad you liked it! 😊 I’m working on some new content, and an updated AI Ads commercial video is definitely on the way. Stay tuned for more, and I appreciate the feedback!

[@Sean43322]

@@AiMotionStudio It is very good news and I am waiting impatiently. 🤩💥

[@katejackson1682]

👍👍👍👍

[@TheSORCERER-p9l]

still plastic skin as the most obvious issue

[@AiMotionStudio]

After generation you can upscale the result to fix the skin use this upscale method: civitai.com/models/713577?modelVersionId=798088

[@Falkonar]

The same. Maybe SDXL will be better

[@마음공부-u4z]

SamplerCustomAdvanced "Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! (when checking argument for argument weight in method wrapper_CUDA__native_layer_norm)" The above error occurs when generating consecutively. Thank you. ### Loading: ComfyUI-Manager (V2.51.9) ### ComfyUI Revision: 2862 [15c39ea7] | Released on '2024-11-26' # ComfyUI Error Report ## Error Details - **Node ID:** 48 - **Node Type:** SamplerCustomAdvanced - **Exception Type:** RuntimeError - **Exception Message:** Expected all tensors to be on the same device, but found at least two devices, cuda:0 and cpu! (when checking argument for argument weight in method wrapper_CUDA__native_layer_norm) ## Stack Trace ``` ## Additional Context (Please add any additional context or steps to reproduce the error here)MODEL"],[123,51,0,62,2,"EVA_CLIP"],[124,53,0,62,3,"FACEANALYSIS"],[125,45,0,62,1,"PULIDFLUX"],[126,54,0,62,4,"IMAGE"],[127,31,0,62,0,"MODEL"],[128,41,0,6,0,"CLIP"],[129,31,0,17,0,"MODEL"],[130,49,0,63,0,"IMAGE"],[132,64,0,65,0,"LATENT"],[133,66,0,64,0,"IMAGE"],[134,10,0,64,1,"VAE"],[135,66,1,65,1,"MASK"],[136,65,0,48,4,"LATENT"],[137,66,0,67,0,"IMAGE"],[138,68,0,6,1,"STRING"],[139,67,2,68,0,"STRING"],[140,69,0,67,1,"FL2MODEL"],[141,66,0,70,0,"IMAGE"],[142,49,0,70,1,"IMAGE"],[143,70,0,71,0,"IMAGE"]],"groups":[{"id":1,"title":"Face Swap Masking","bounding":[726,599,333,422],"color":"#3f789e","font_size":24,"flags":{}},{"id":2,"title":"Flux Models","bounding":[15,34,337,554],"color":"#3f789e","font_size":24,"flags":{}},{"id":3,"title":"Prompts","bounding":[371,41,342,861],"color":"#3f789e","font_size":24,"flags":{}},{"id":4,"title":"Input Image","bounding":[1425,37,338,548],"color":"#3f789e","font_size":24,"flags":{}},{"id":5,"title":"PuLID","bounding":[724,41,329,548],"color":"#3f789e","font_size":24,"flags":{}},{"id":6,"title":"Ksampler","bounding":[1069,41,345,980],"color":"#3f789e","font_size":24,"flags":{}},{"id":7,"title":"Output","bounding":[1427,604,437,552],"color":"#a1309b","font_size":24,"flags":{}}],"config":{},"extra":{"ds":{"scale":0.8390545288824038,"offset":[223.73253580966474,126.80426492827088]}},"version":0.4} ``` ## Additional Context (Please add any additional context or steps to reproduce the error here)

[@AiMotionStudio]

Make sure 1- ComfyUI is uptodate. 2 - Goto the "...ComfyUI\custom_nodes\ComfyUI-PuLID-Flux \" Directory. 3- On the address bar type "CMD" to go into Command prompt. (Black screen with current directory) 4 - On the prompt type "pip install -r requirements.txt" Make sure the python is installed. 5- After few minutes depending on the speed of the internet it will download everything and install the dependencies and create directories in COmfyUI. 6 - Type "pip list" and check the list if the items are listed in requirements.list "facexlib, insightface, onnxruntime, onnxruntime-gpu, ftfy, timm"

[@마음공부-u4z]

@@AiMotionStudio I even tried formatting my PC because of this. The error only occurs when using the flux1-dev full version model. No errors occur with FP8. Thank you!