ComfyUI Multi ID Masking With IPADAPTER Workflow

  Рет қаралды 6,516

Grafting Rayman

Grafting Rayman

25 күн бұрын

In this ComfyUI video, we take 3 sets of images and incorporate them into our final output using IPAdapter and Masking. I am using images of Taylor Swift, Margot Robbie and Jenna Ortega, you can use any image you like. For best results you will need multiple angles of the face. Don't use blurry images or low quality ones for best results.
Workflow: (Copy and paste in to your browser then save as .JSON)
pastebin.com/raw/UBkQ66FX
Anything Everywhere:
github.com/chrisgoringe/cg-us...
IPAdapter:
github.com/cubiq/ComfyUI_IPAd...
GR Prompt Selector:
github.com/GraftingRayman/Com...
Ultimate SD Upscale:
github.com/ssitu/ComfyUI_Ulti...
ComfyRoll:
github.com/Suzie1/ComfyUI_Com...
Inspire Custom Nodes:
github.com/ltdrdata/ComfyUI-I...
Model: Juggernaut Reborn:
civitai.com/models/46422/jugg...
#0013
#ComfyUI #upscale #anthingeverywhere #ipadapter #inpainting #masking #imageenhancement

Пікірлер: 50
@mattc3510
@mattc3510 Күн бұрын
You are a pro. I love your videos thank you
@user-gt9qq9uf9q
@user-gt9qq9uf9q 11 күн бұрын
Nice tutorial! I've learned a lot!
@BruknerZigfreed
@BruknerZigfreed 22 күн бұрын
Useful, lot of info, easy to understand, thanks.
@GraftingRayman
@GraftingRayman 22 күн бұрын
Glad it was helpful!
@adriantang5811
@adriantang5811 16 күн бұрын
Very useful tutorial, thank you so much!
@GraftingRayman
@GraftingRayman 15 күн бұрын
Glad it was helpful!
@kwlook90
@kwlook90 24 күн бұрын
Great work. I hope people will start noticing your channel. 😀
@GraftingRayman
@GraftingRayman 24 күн бұрын
I hope so too!
@PierreHenriBessou
@PierreHenriBessou 23 күн бұрын
Very nice video. Useful tips. Still got a few questions, if you don't mind. Is there any reason why you use the nodes [ loraLoader Model Only + IPAdapter Model Loader + clipVision + insightFace ] instead of the IPAdapter Unified loader FaceID? For the face reference, I see you use a batch load, but do not use a "Prep Image For ClipVision". I've seen this node used in many workflows. But maybe you did prepare manually your reference images. Did you make something special to your dataset, like resizing them or cropping them in the first place? Anyway, I used to run a second Ksampler at 0.5 denoising. Didn't think about running a third one. I'll try that out, nice idea. Thanks again, good job.
@GraftingRayman
@GraftingRayman 23 күн бұрын
The unified loader sometimes does not work for me, not sure why, tried a few different workflows and they seem to crap out, swapped for the standard version which works a treat. I use crop face node prior to this workflow to save the faces only.
@aeit999
@aeit999 22 күн бұрын
Subbed, cool help, thanks
@GraftingRayman
@GraftingRayman 22 күн бұрын
Awesome, thank you!
@n3bie
@n3bie 16 күн бұрын
Awesome video sir. +1 Sub.
@zraieee
@zraieee 21 күн бұрын
good done, please how can I make showing laser light for nodes
@GraftingRayman
@GraftingRayman 21 күн бұрын
thats with anything everywhere node
@Teardropbrut
@Teardropbrut 4 күн бұрын
Question, can add FaceDetailer after the Ksampler so that the different faces don't get averaged to be the same?
@GraftingRayman
@GraftingRayman 3 күн бұрын
Yes you can, I have done myself, but results show ksampler does a good job as it is
@frustasistumbleguys4900
@frustasistumbleguys4900 11 күн бұрын
I love it, but how do I make the three faces look the same after upscaling? Right now, they still look different
@GraftingRayman
@GraftingRayman 10 күн бұрын
Are you running them through a ksampler with lower noise after the upscale?
@n3bie
@n3bie 15 күн бұрын
I've been trying to use this with SDXL and I'm finding the images don't seem to be coming out with faces that look much like my reference pictures. Had 3 quick questions: 1. When you said SDXL wasn't working well for you in the video, did you mean just in general or in the case of this specific workflow in that the faces didn't seem to come out? 2: Do the reference images need to be close ups of the face, or will this work with full body reference photos as well? They can be jpegs right? 3: If I'm only making an image of a single person, it should be okay to use a mask that is just a transparent png image without the black part right? EDIT: Actually, I think I have it working better now, just needed to adjust some of the models I was using... think I had the wrong IPAdapter model selected hehehe eeer.. I'm not the smartest. Thanks again!
@GraftingRayman
@GraftingRayman 14 күн бұрын
Hi @n3bie, reference images work best if they are head shots. Not been having much luck with multi person generations with sdxl, works fine for single person but soon as I get a 2nd or 3rd person involved, it craps out, but that is using InstantID, works fine with FaceID
@n3bie
@n3bie 14 күн бұрын
@@GraftingRayman Ah I see, I actually only built a single character workflow, but it's nice to have that info for when I try to expand it. I have to say tho, this workflow as a single character generator is working fantastically for me using SDXL. I deepened the reference images to about 20, maybe a third of those are close up portraits as you suggested, but after I was having trouble generating anything but close ups of the face, I threw a bunch more in the folder including full body poses, and I'm having pretty good results generating a lot of different poses that all look like the reference model. If anybody comes across this, I'm using Darker Tanned Skin off of CivitAI for a SDXL compatible LoRA, and it's working quite nicely. Thanks again Rayman!
@mahesh001234
@mahesh001234 20 күн бұрын
Please make a workflow for SDXL also, with InstaID for multiple people
@GraftingRayman
@GraftingRayman 19 күн бұрын
the results are very crappy with instant id for multiple people, not worth the effort
@CravingWatermelon
@CravingWatermelon 19 күн бұрын
Getting below error, Error occurred when executing VAEDecode: 'VAE' object has no attribute 'vae_dtype' File "D:\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all)
@GraftingRayman
@GraftingRayman 19 күн бұрын
how much vram do you have on your gpu?
@badterry
@badterry 11 күн бұрын
damn bro. whats ur pc specs? FaceID runs so slow on my old ass machine
@GraftingRayman
@GraftingRayman 11 күн бұрын
haha, that speed is done by editing, its still slow as anything
@mahesh001234
@mahesh001234 20 күн бұрын
Getting below error, File "C:\Users\Mahesh\ComfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_GraftingRayman odes.py", line 8, in from clip import tokenize, model ModuleNotFoundError: No module named 'clip'
@GraftingRayman
@GraftingRayman 20 күн бұрын
run the following: pip install git+github.com/openai/CLIP.git
@user-wl4my6ue7e
@user-wl4my6ue7e 18 күн бұрын
"When loading the graph, the following node types were not found: GR Prompt Selector Nodes that have failed to load will show as red on the graph." it's inside ComfyUI\custom_nodes but not work Help me please.
@GraftingRayman
@GraftingRayman 18 күн бұрын
run the following command in your custom_nodes folder or use comfyui manager, "Git clone github.com/GraftingRayman/ComfyUI_GraftingRayman"
@user-wl4my6ue7e
@user-wl4my6ue7e 18 күн бұрын
@@GraftingRayman "It's inside ComfyUI\custom_nodes but not work" - it's installed, but "Failed to load"
@user-wl4my6ue7e
@user-wl4my6ue7e 18 күн бұрын
@@GraftingRayman maybe it the same problem: ``` DWPose: Onnxruntime with acceleration providers detected. Caching sessions (might take around half a minute)... 2024-05-20 16:46:37.3574522 [E:onnxruntime:Default, provider_bridge_ort.cc:1534 onnxruntime::TryGetProviderInfo_TensorRT] D:\a\_work\1\s\onnxruntime\core\session\provider_bridge_ort.cc:1209 onnxruntime::ProviderLibrary::Get [ONNXRuntimeError] : 1 : FAIL : LoadLibrary failed with error 126 "" when trying to load "D:\Ai\SD\ComfyUI_windows_portable\python_embeded\lib\site-packages\onnxruntime\capi\onnxruntime_providers_tensorrt.dll" *************** EP Error *************** EP Error D:\a\_work\1\s\onnxruntime\python\onnxruntime_pybind_state.cc:456 onnxruntime::python::RegisterTensorRTPluginsAsCustomOps Please install TensorRT libraries as mentioned in the GPU requirements page, make sure they're in the PATH or LD_LIBRARY_PATH, and that your GPU is supported. when using ['TensorrtExecutionProvider', 'CUDAExecutionProvider', 'CPUExecutionProvider'] Falling back to ['CUDAExecutionProvider', 'CPUExecutionProvider'] and retrying. **************************************** 2024-05-20 16:46:38.4698587 [E:onnxruntime:Default, provider_bridge_ort.cc:1534 onnxruntime::TryGetProviderInfo_TensorRT] D:\a\_work\1\s\onnxruntime\core\session\provider_bridge_ort.cc:1209 onnxruntime::ProviderLibrary::Get [ONNXRuntimeError] : 1 : FAIL : LoadLibrary failed with error 126 "" when trying to load "D:\Ai\SD\ComfyUI_windows_portable\python_embeded\lib\site-packages\onnxruntime\capi\onnxruntime_providers_tensorrt.dll" *************** EP Error *************** EP Error D:\a\_work\1\s\onnxruntime\python\onnxruntime_pybind_state.cc:456 onnxruntime::python::RegisterTensorRTPluginsAsCustomOps Please install TensorRT libraries as mentioned in the GPU requirements page, make sure they're in the PATH or LD_LIBRARY_PATH, and that your GPU is supported. when using ['TensorrtExecutionProvider', 'CUDAExecutionProvider', 'CPUExecutionProvider'] Falling back to ['CUDAExecutionProvider', 'CPUExecutionProvider'] and retrying. **************************************** ```
@user-wl4my6ue7e
@user-wl4my6ue7e 18 күн бұрын
I have no any D:\a folder at all, by the way
@GraftingRayman
@GraftingRayman 18 күн бұрын
delete the folder for the node and reinstall
@HeangBorin
@HeangBorin 10 күн бұрын
Please help, i got message (IMPORT FAILED) GR Prompt Selector in manager
@GraftingRayman
@GraftingRayman 10 күн бұрын
what is the full error?
@HeangBorin
@HeangBorin 9 күн бұрын
Dear Sir @@GraftingRayman, here is the log: File "C:\Users\ccc\OneDrive\Documents\ComfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_GraftingRayman\__init__.py", line 1, in from .GRnodes import GRPromptSelector, GRImageResize, GRMaskResize, GRMaskCreate, GRMultiMaskCreate, GRImageSize, GRTileImage, GRPromptSelectorMulti, GRTileFlipImage, GRMaskCreateRandom, GRStackImage, GRResizeImageMethods, GRImageDetailsDisplayer, GRImageDetailsSave File "C:\Users\ccc\OneDrive\Documents\ComfyUI\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI_GraftingRayman\GRnodes.py", line 11, in from clip import tokenize, model ModuleNotFoundError: No module named 'clip'
@GraftingRayman
@GraftingRayman 8 күн бұрын
you may try "pip install clip", that should install the clip package
@Teardropbrut
@Teardropbrut 4 күн бұрын
@@GraftingRayman I have both Auto1111 and Comfyui portable installed. The clip package got copied to the Pinokio Miniconda folder from where I copied into Comfy Lib. Still wasn't able to load the node. Import failed via manager and also the same result when git clone, same content is the folder. I also seem to have Onnx and Onnxruntime installed.
@GraftingRayman
@GraftingRayman 3 күн бұрын
Both the clip and the clip info folders were copied to ComfyUI_windows_portable\python_embeded\Lib\site-packages?
@dennischo2140
@dennischo2140 11 күн бұрын
can you share your mask.png files for us? It's very useful
@GraftingRayman
@GraftingRayman 11 күн бұрын
you can use my mask create node instead, check my github link in the bio
@dennischo2140
@dennischo2140 11 күн бұрын
@@GraftingRayman Thank you~
@cemilhaci2
@cemilhaci2 24 күн бұрын
thanks, workflow link wont work
@GraftingRayman
@GraftingRayman 24 күн бұрын
if you right click the link and save the file as a .JSON it will work
@RodiZai-pk9ty
@RodiZai-pk9ty 23 күн бұрын
@@GraftingRayman No, still not working, apparently is a pastebin issue
@GraftingRayman
@GraftingRayman 23 күн бұрын
@@RodiZai-pk9ty you can download it from my github github.com/GraftingRayman/ComfyUI_GR_PromptSelector/tree/main/Workflows
Stable Diffusion 1.5 with Fooocus - Yes you can!
8:45
Kleebz Tech AI
Рет қаралды 6 М.
When Steve And His Dog Don'T Give Away To Each Other 😂️
00:21
BigSchool
Рет қаралды 11 МЛН
Cat story: from hate to love! 😻 #cat #cute #kitten
00:40
Stocat
Рет қаралды 16 МЛН
1🥺🎉 #thankyou
00:29
はじめしゃちょー(hajime)
Рет қаралды 79 МЛН
ComfyUI May 2024 Updates: New Features, Performance Improvements & Bug Fixes
15:54
INSANE ComfyUI Node writes new Nodes with AI (and Local LLMs)
21:11
Attention Masking with IPAdapter and ComfyUI
11:38
Latent Vision
Рет қаралды 39 М.
Stable Diffusion Prompt Guide
11:23
pixaroma
Рет қаралды 10 М.
How to use Face Analysis to improve your workflows
15:43
Latent Vision
Рет қаралды 9 М.
How To Do img2img Within ComfyUI - Beginner's Guide
4:23
Prompting Pixels
Рет қаралды 4,3 М.
Create Consistent Character Face/Body/Clothes From Multiple Angles
12:39
Apple watch hidden camera
0:34
_vector_
Рет қаралды 56 МЛН
#miniphone
0:16
Miniphone
Рет қаралды 1 МЛН
С Какой Высоты Разобьётся NOKIA3310 ?!😳
0:43
С ноутбуком придется попрощаться
0:18
Up Your Brains
Рет қаралды 328 М.
😱НОУТБУК СОСЕДКИ😱
0:30
OMG DEN
Рет қаралды 3,2 МЛН