Unlocking FaceIDV2's Full Potential with ComfyUI and IPAdapter! 🚀

  Рет қаралды 19,931

Bytebrain

Bytebrain

6 ай бұрын

Welcome back, everyone (Finally)! In this video, we'll show you how to use FaceIDv2 with IPadapter in ComfyUI to create consistent characters. We'll also introduce some useful nodes available here: github.com/chrisgoringe/cg-us....
For installation and FaceID models, check out: github.com/cubiq/ComfyUI_IPAd....
Workflow : comfy.icu/c/xqOptt0
Big shoutout to Matteo from Latent Vision for his fantastic work on IPadapter. Check out his channel here: / @latentvision . Let's dive into ComfyUI and FaceIDv2 with IPadapter! 🚀

Пікірлер: 60
@TharindaMarasingha
@TharindaMarasingha 3 ай бұрын
hello !! IP ADAPTER APPLY Node Not available at this time , can you share your IP ADAPTER apply Node Folder via Google drive !! Thank youuu
@eucharistenjoyer
@eucharistenjoyer 6 ай бұрын
Great video. I had no idea about this Kohya Deep Shrink thing, it works amazing and seems to counter one of the problems Matteo pointed about upscaling and losing some of the facial uniqueness, even if using tile controlnet. Do you have any other video on this Kohya Deep Shrink node? Is there any use of changing some of its options?
@tech_bytebrain
@tech_bytebrain 6 ай бұрын
Unfortunately, I don't. The problem with Kohya Deep Shrink is that it's not compatible with ControlNet. If you're interested in these types of features, you could also look into this Lora : civitai.com/models/238891/hd-horizon-the-resolution-frontier-multi-resolution-high-resolution-native-inferencing , which serves pretty much the same purpose.
@eucharistenjoyer
@eucharistenjoyer 6 ай бұрын
@@tech_bytebrain Thank you! I'll try it out.
@AdamIverson
@AdamIverson 6 ай бұрын
FaceID does work with Automatic1111 currently, including SD1.5 V2 and SDXL version. Works great, can work with other controlnet including other IPadapter and Lora as well.
@tech_bytebrain
@tech_bytebrain 6 ай бұрын
You're 100% correct , my mistake!
@yiluwididreaming6732
@yiluwididreaming6732 5 ай бұрын
Comfy still much better results.......
@lilillllii246
@lilillllii246 6 ай бұрын
Hi. I've tried playing your workflow, but it doesn't work as the pink box comes out of "anything everywhre" I've tried several settings, but I can't. Is there no video of this installation?
@tech_bytebrain
@tech_bytebrain 6 ай бұрын
Use the ComfyUI manager to install the "Use Everywhere" nodes. Search for "Everywhere" and install the one made by Chrisgoringe. Once that is done you want to restart comfyui.
@caluxkonde
@caluxkonde 3 ай бұрын
Any update for ipadapter v2?
@8561
@8561 6 ай бұрын
Nice video! For next vid it would be nice if you zoom in slightly to your nodes, it makes the viewing experience way better when the active nodes you are using are closer. Also, what do you think are the benefits of using IPAdapter for faces instead of Reactor or roop?
@tech_bytebrain
@tech_bytebrain 6 ай бұрын
Noted ! Reactor is fine, especially at low res. They both have their advantages and disadvantages. Depending on what you’re trying to do i guess.
@HiProfileAI
@HiProfileAI 6 ай бұрын
I like FaceReactor and have had good success. Yes at low resolutions but you can do some upscaling and looped upscaling to preserve the quality and get a consistent character at higher resolutions with food detail.
@AlanHuang67
@AlanHuang67 6 ай бұрын
Great Video! I always have error in the first apply ipadapter node as below, do u know what happened? Error occurred when executing IPAdapterApplyFaceID: mat1 and mat2 shapes cannot be multiplied (257x1664 and 1280x768)
@tech_bytebrain
@tech_bytebrain 6 ай бұрын
Hit me up on discord : discord.gg/h4dJq8za
@HTwords
@HTwords 6 ай бұрын
how to add dynamic icon on Clip text ecode nodes and the menu at the top left corner?
@tech_bytebrain
@tech_bytebrain 6 ай бұрын
The menu in top left is the comfyui workflow manager : github.com/11cafe/comfyui-workspace-manager . Not sure what you mean with dynamic icon 😅
@HTwords
@HTwords 6 ай бұрын
@@tech_bytebrain the icons that animate on the Clip text encode modules in the bottom right-hand corner
@tech_bytebrain
@tech_bytebrain 6 ай бұрын
@@HTwords Oh, lol, that's Grammarly (Autocorrector) for my potato spelling!
@Epicfuzz
@Epicfuzz 6 ай бұрын
I keep getting error when it goes to the insightface node, is there a way to correctly install insightface?
@tech_bytebrain
@tech_bytebrain 6 ай бұрын
It can be pretty painful to install. What error are you getting? Perhaps you can find the answer here: github.com/cubiq/ComfyUI_IPAdapter_plus/issues/162 Make sure you update ComfyUI.
@b4ngo540
@b4ngo540 6 ай бұрын
make sure the checkpoint you are using is compatible the model you are loading , both must be SD1.5 or both must be SDXL
@minhquanglenguyen5670
@minhquanglenguyen5670 6 ай бұрын
How can I get a running light effect on a path? Could you please guide me on how to install it? thanks
@tech_bytebrain
@tech_bytebrain 6 ай бұрын
Running light effect?
@b4ngo540
@b4ngo540 6 ай бұрын
i assume you mean "long exposure" effect , try googling this word if this is what you are looking for , then you can get this effect by (long exposure lora)
@minhquanglenguyen5670
@minhquanglenguyen5670 6 ай бұрын
yeah light run on path @@tech_bytebrain
@johnloughlin6804
@johnloughlin6804 6 ай бұрын
Thanks for the walk through but I keep getting an error for 'No module named 'insightface' any thoughts... looking through comments now cheers
@tech_bytebrain
@tech_bytebrain 6 ай бұрын
It seems you haven't installed insightface correctly. Perhaps you can find the solution in the following thread: github.com/cubiq/ComfyUI_IPAdapter_plus/issues/162 , make sure you're installing it in the comfyui environment (python_embed) if you have the portable version.
@bthtunes
@bthtunes 4 ай бұрын
Hi, it seems that post is for Windows. Do you know how to fix it for Mac? Thanks a lot.@@tech_bytebrain
@8lank820
@8lank820 6 ай бұрын
Can you do a comparison on v1 vs v2? v1 produces more consistent and similar from the source image than v2 on mine...
@tech_bytebrain
@tech_bytebrain 6 ай бұрын
You can find a complete deep-dive with all the different combinations on matteo's channel: www.youtube.com/@latentvision/videos
@bigdaddy5303
@bigdaddy5303 6 ай бұрын
It does. But it's very difficult to change facial expressions. It's a little bit too strong to the source image. But you're right, it does produce a better overall result in terms of face similarity. But I still use face swap in conjunction with ipadapter. Ipadapter gives the general shape of the face, face swap nails the face.
@GenevieveSinclair
@GenevieveSinclair 3 ай бұрын
There is no "Apply IPAdapter FaceID", only "IPAdapter FaceID" which looks a bit different, and I can't get it to work.
@TheSoliver84
@TheSoliver84 6 ай бұрын
Hello can you share your extensions? what kind of extension is that at the positive and negative prompt at the bottom right? , and how do I display "#343" in the window?, what is "Format" and "Clipspace" and "save as component?". You have nice workspaice👌👌😍
@tech_bytebrain
@tech_bytebrain 6 ай бұрын
The extension is Grammarly (to check grammar) , the display #ID can be found in the Manager settings ;).
@fmt2586
@fmt2586 6 ай бұрын
Why does yours look soo cool, gimme the themes and customizations please, i neeeed it.
@tech_bytebrain
@tech_bytebrain 6 ай бұрын
Themes?
@offmybach
@offmybach 6 ай бұрын
I can't get to work. The VAE doesn't seem to be decoding and I get scrambled mess - otherwise looks great!
@tech_bytebrain
@tech_bytebrain 6 ай бұрын
Can you link your workflow?
@lilillllii246
@lilillllii246 6 ай бұрын
Thanks. Where can I download clipvision 1.5?
@tech_bytebrain
@tech_bytebrain 6 ай бұрын
Here : huggingface.co/h94/IP-Adapter/resolve/main/models/image_encoder/model.safetensors
@Ben-et8wh
@Ben-et8wh 6 ай бұрын
@@tech_bytebrain it's just called model.safetensors though?
@djivanoff13
@djivanoff13 6 ай бұрын
would you give a link to your workflow?
@MitrichDX
@MitrichDX 6 ай бұрын
use your hands =)
@OddJob001
@OddJob001 6 ай бұрын
@@MitrichDX And with that sort of comment, no interest in your channel.
@tech_bytebrain
@tech_bytebrain 6 ай бұрын
Sure, here you go : comfy.icu/c/xqOptt0 If you want to combine it with Ctrlnet, do not forget to remove the Deepshrink node, as it seems to conflict.
@MitrichDX
@MitrichDX 6 ай бұрын
@@OddJob001 np, my channel not for all, it's main sandbox =))
@lilillllii246
@lilillllii246 6 ай бұрын
I think you've installed everything you've said, "InSightFaceLoade, IPAdapterApplyFaceID" related error occurs.
@tech_bytebrain
@tech_bytebrain 6 ай бұрын
Whats the error ?
@lilillllii246
@lilillllii246 6 ай бұрын
@@tech_bytebrain User Error occurred when executing IPAdapterApply: InsightFace must be provided for FaceID models. File "/content/drive/MyDrive/ComfyUI/execution.py", line 155, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) File "/content/drive/MyDrive/ComfyUI/execution.py", line 85, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) File "/content/drive/MyDrive/ComfyUI/execution.py", line 78, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) File "/content/drive/MyDrive/ComfyUI/custom_nodes/ComfyUI_IPAdapter_plus/IPAdapterPlus.py", line 570, in apply_ipadapter raise Exception('InsightFace must be provided for FaceID models.')
@Airbender131090
@Airbender131090 6 ай бұрын
People who do those comfy ui things. Why dont u just go cure cancer or something?! I meat it looks about the same difficulty level…
@Graino69
@Graino69 6 ай бұрын
Some of the questions people asking in this comment section just make no sense... lmao
@TeddyLeppard
@TeddyLeppard 6 ай бұрын
All of this node-based UI nonsense goes away as soon as someone commoditizes this and makes an extremely simple user-friendly interface which you feed with reference photos and text prompts for continuity.
@tech_bytebrain
@tech_bytebrain 6 ай бұрын
You can as well use automatic1111 for most of these things. Whatever suits your needs is fine. 😀
@knownunknownco
@knownunknownco 5 ай бұрын
That's a silly comment. The entire creative industry uses node-based programs for a reason.
@alecubudulecu
@alecubudulecu 5 ай бұрын
FORGE. It’s auto1111 made by same folks … but runs on comfyui backend.
@lilillllii246
@lilillllii246 6 ай бұрын
I've used everything I can, including the one you told me to do,"cv2' has no attribute 'mat_wrapper faceid consistent" says the message (insight face). And on clipvision, you used "ip_adater_clipvision_sd1.5.safetors" in video and I can't find it.
@tech_bytebrain
@tech_bytebrain 6 ай бұрын
I've set up a discord to offer a minimum amount of support as its very hard to do this over KZfaq Comments : discord.gg/Q3tH6UgE . Contact me there
ComfyUI - Hands are finally FIXED!  This solution works with all models!
12:17
PhotoMaker - better than IPAdapter?
12:51
Nerdy Rodent
Рет қаралды 40 М.
DEFINITELY NOT HAPPENING ON MY WATCH! 😒
00:12
Laro Benz
Рет қаралды 63 МЛН
УГАДАЙ ГДЕ ПРАВИЛЬНЫЙ ЦВЕТ?😱
00:14
МЯТНАЯ ФАНТА
Рет қаралды 4,2 МЛН
A teacher captured the cutest moment at the nursery #shorts
00:33
Fabiosa Stories
Рет қаралды 40 МЛН
MISS CIRCLE STUDENTS BULLY ME!
00:12
Andreas Eskander
Рет қаралды 17 МЛН
InstantID: Everything you need to know
15:26
Latent Vision
Рет қаралды 58 М.
AI Face Swap Battle: PuLID vs InstantID vs FaceID
9:26
My AI Force
Рет қаралды 6 М.
How To Install ComfyUI InstantID Run With Stable Diffusion (Tutorial Guide)
22:51
ComfyUI ReActor Face Swap Image & Video
12:17
Data Leveling
Рет қаралды 20 М.
ComfyUi IPAdapter plus V2 FaceID Beginner's Tutorial
15:40
Learn AI Labs
Рет қаралды 3,4 М.
AI Models From ANY Angle & SUPIR Upscaling (Low VRAM Method)
14:23
Image stability and repeatability (ComfyUI + IPAdapter)
18:42
Latent Vision
Рет қаралды 59 М.
DEFINITELY NOT HAPPENING ON MY WATCH! 😒
00:12
Laro Benz
Рет қаралды 63 МЛН