Image stability and repeatability (ComfyUI + IPAdapter)

Рет қаралды 59,930

Күн бұрын

This time it's all about stability and repeatability! I'm generating a character and an outfit and trying to reuse the same elements in multiple settings, poses and facial expression.
Workflow and all images: f.latent.vision/download/char...
Discord server: / discord
IPAdapter extension: github.com/cubiq/ComfyUI_IPAd...
ComfyUI essentials: github.com/cubiq/ComfyUI_esse...
‪@ALatentPlace‬
00:00 Intro
00:22 Building the face
05:35 IPAdapter face model
07:55 The body
10:53 Merging face and body
16:51 Women always get the best armors
17:15 Modern outfit
18:06 Outro
** Background music **
-- "Part A" by Alexander Nakarada (www.serpentsoundstudios.com) Licensed under Creative Commons BY Attribution 4.0 License
-- "Last Stop" Synthwave by Karl Casey @ White Bat Audio (whitebataudio.com/)
-- "CyberPunk City" by Peritune (peritune.com/)
-- "White Gold" by Karl Casey @ White Bat Audio

Пікірлер: 231

@daniel99497 7 ай бұрын

U should win some kind of award for being so helpful to the community

@omarei 7 ай бұрын

Yeah seriously

@stephantual 6 ай бұрын

The irony is that it's him who's giving the awards. Matteo is an absolute legend 👑!

@sifeyanis591 6 ай бұрын

Yes indeed ❤

@Dave_AI 7 ай бұрын

Nobody has opened my eyes to the possibilities of ComfyUI more than you have. I'm only two weeks in to my Comfy journey, and I'm already weeks ahead of where I would have been had I never found your channel. If there was an 'Ultimate AI Bro' award, you would win it.

@ultimategolfarchives4746 7 ай бұрын

I was aware that moving on from automatic1111 was the correct decision, yet I hadn't realized the extent of what I was foregoing 😂😂

@ColoNihilism 7 ай бұрын

totally.

@ttul 7 ай бұрын

Really excellent overview of how you can put many node types together to achieve a fantastic result!

@swannschilling474 7 ай бұрын

Your videos are insanely dense and totally on top of being comfy to watch and packed with quality info!! ❤

@kpr2 7 ай бұрын

Terrific stuff, Matteo! I really appreciate not only that you share your amazing workflows, but that you take the time to really break things down & show us the what, when, how and why of things. I've only been using ComfyUI for a couple of weeks & these kinds of tutorials are an absolute godsend. Thank you ever, ever so much!

@chadhamlet 7 ай бұрын

Wow! This is exactly what I was looking for. Thank you so much for creating this walkthrough!

@EpochEmerge 7 ай бұрын

You are the light in the latent-space darkness. Thank you for the content!

@unforkableonion5081 7 ай бұрын

your videos are great with a lot of details explained in a simple and concise manner! keep up the good work!

@ooiirraa 7 ай бұрын

Thank you again, Matteo 🎉 your freedom of creative thinking is beautiful 🎉 so happy there are such stars in the community

@Matt-st1tt 7 ай бұрын

Just thank you. Omg been looking for tutorials on this where I can open a work flow and look it through and follow along. Thank you.

@tonikunec 7 ай бұрын

I feel like I am in some science class at the university watching your videos, you have so much knowledge, it's crazy. I watched all your videos and at the end of every one of them my jaw dropped to the floor… Amazing stuff! Keep up the good work, and thanks a lot!

@smitty7326 7 ай бұрын

I'm not sure what it is, but these are the most clear and helpful guides I've found. I think it helps that you're both building it live and also explaining very clearly what each connection does. Thanks

@terrorcuda1832 7 ай бұрын

That was probably the best video on comfyui that I have seen. I'm new to comfyui and am facing the steep learning curve that goes with it. I find many videos overly technical to start with. You clearly explained your steps, not only how to do them, but why. I learned more from this video than probably the last 15 that I've watched combined! Thank you very much for your time. Keep up the fantastic work!

@marsstaedtler 7 ай бұрын

Your tutorials are the perfect blend of technical and interesting, i sometimes watch them with no intention to try it myself but just to understand . also would love to see an example of this workflow on SDXL.

@sanbaldo 7 ай бұрын

grazie matteo, questi video sono GOLD!! grazie per il tempo che stai dedicando alla comunità di comfyui!! super apprezzati (se mai ti venisse voglia sarebbe bello avere un corso 101)

@AgentofHappiness365 7 ай бұрын

I have to say... probably the best AI tutorials out there. Well done and thanks for the knowledge!

@goodie2shoes 4 ай бұрын

So many ComfyUI video's show very little and only hint at the possiblities. Your video's are a revelation! You show SO MUCH and have a deep knowledge of the interface and its possibilities. GREAT STUFF!! thankyou!

@vladimirtsarapkin2840 4 ай бұрын

It is so uncommon to listen to a guide were author has such a clear understanding of the subject. Find you work extremely inspiring and helpful. Thank you, Matteo!

@jiml5166 7 ай бұрын

Wow. Using your tutorials I can pretty much manipulate any image to be what I imagine in my head. Thanks so much.

@WhySoBroke 7 ай бұрын

Supreme amazing stuff (like always) maestro latente!! No other person offers such great knowledge!!

@alexgilseg 6 ай бұрын

thank you so much for this! I've been waiting for this for so long! I can't begin to tell you how greatful I am for what you do. 🙏🙏🙏

@amkire65 7 ай бұрын

Fantastic video. I have no idea how long I'd have been stumbling along on my own to try and do something similar.

@pn4960 7 ай бұрын

Ciao Matteo! Thank you for your work, this is a very nice video. Easy to follow

@jiucki 7 ай бұрын

Wow, thank you very much for this amazing tutorial! I'm definitely going to try comfy UI as I would like to have characters to create a small comic

@nolanzor 7 ай бұрын

Matteo almost summoned Exodia at 11:22 Thank you as always for the great tutorials

@leonardoamaya1450 7 ай бұрын

😂

@Graino69 7 ай бұрын

Your tutorials have helped more than anything else on the internet, keep it up man! P.S. Ty for IPAdapter :)

@lucagenovese7207 Ай бұрын

Come sempre, excellent.

@ashokp9260 7 ай бұрын

Awesome! Ur ideas know no bounds.

@othoapproto9603 7 ай бұрын

Food for thought, I couldn't eat another byte or bit. Thank you for sharing your skills and hard work.

@Milo_Estobar 19 күн бұрын

Very good, i knew from my very gut, that comfyui is for advanced user.... But never be able to see what its strength because most tutorial example keep giving easy example which makes me think "why do you even need comfyui?"... Now I have seen the full picture, thank you very much....

@WuduDionysia 7 ай бұрын

this was exactly what i have been looking for the whole time!!! thank you so much

@PradeepKumar6 5 ай бұрын

Mind blowing and amazing, your all videos are enriched with vitamin, calcium, protein , great stuff. Absolute genius. Probably best in AI. Thank you very much.

@jacekfr3252 7 ай бұрын

very informative, well performed, thank you!

@blender_wiki 7 ай бұрын

Awesome 👍🏿👍🏿👍🏿. Can't wait for your tutorial of batch embeds

@McxCZ 7 ай бұрын

Jesus holy moly. Its like "So this 50 nodes is just a beggining".

@Clupea101 7 ай бұрын

Excellent Guide, Top Man

@EqualToBen 4 ай бұрын

Dude you are a comfyui NINJA this is incredible

@rockapedra1130 5 ай бұрын

You are a virtuoso comfyUI magician. I am in awe.

@flisbonwlove 7 ай бұрын

Great work matt3o 👏👏👏

@alexijohansen 7 ай бұрын

Incredible control!

@hakandurgut 7 ай бұрын

this is such a GREAT video, great knowledge, great presentation ! what else can I say..

@pk.9436 7 ай бұрын

perfect work, thank you for inspire us 💪

@jasonmonroe5067 3 ай бұрын

This is brilliant and super helpful! Thank you!

@Inner-Reflections-AI 7 ай бұрын

Great tutorial as always!

@BoolitMagnet 7 ай бұрын

What can I say, another jewel in the IPAdapter toolbox.

@nidefawl2552 7 ай бұрын

I love your videos. Keep them coming

@ok_AI_ 6 ай бұрын

Absolutely amazing. So much better than training a character lora.

3 ай бұрын

This video is an international treasure. Protect it at all costs!

@lenny_Videos 7 ай бұрын

Awesome stuff 😊

@i.venture 5 ай бұрын

this is another world. So much to practice.

@jc2shile 7 ай бұрын

The harvest is full, thanks again for sharing!

@JuanS_DuodecimStudio 3 ай бұрын

Thanks Latent Vision, really helpfull, i' was a bit scared by this V2 changes, but it seems that is a good upgrade

@billkage4279 4 ай бұрын

Great tutorial. I'm subscribed!

@PumuckelTom 7 ай бұрын

One of the best mods availeble!

@GForcenuwan 7 ай бұрын

Amazing! Thank you Matteo

@fernandomasotto 7 ай бұрын

great stuff!! U are a comfyUI wizard

@PyruxNetworks 7 ай бұрын

Thank you. Great tutorial.

@luiswebdev8292 7 ай бұрын

this is incredible!

@sylwestermoniuszko-szymans1488 4 ай бұрын

few months back I thought the image generation AI is just type some text and get the results, which was boring, but fortunately people found a way to make it skillfull again

@AnthonyDev 7 ай бұрын

Nice tutorials, thanks!

@RhetoricalTraveling 7 ай бұрын

amazing dude!!

@cdrbroda 7 ай бұрын

Esse magrão é ninja!

@justinwhite2725 6 ай бұрын

A tip that I figured out yesterday while watching some of the videos on this channel; If your images are dark and muddy it's because you are using samples that are too high resolution. There's a node called 'ImageScaleToTotalPixels' that you should run your samples through. 0.5 (512) for samples and 0.25 (256) for faces work for me.

@anthonymalagutti3517 4 ай бұрын

Truly fantastic ! Like someone else said on your channel, yiu really openned my eyes on the technical approach and i m understanding a bit more the fundamental concept! Thank you!!! I would love to get more content/ courses from you but at bit slower pace - most of the time ot s hard to get all the details from your screen recordings. I would pay for your high quality content

@ourdailyplanet 7 ай бұрын

bravo, Matteo!

@Nakopal_Nasobiral 3 ай бұрын

thank you Matteo!🙏

@MrPaPaYa86 2 ай бұрын

Upvote if you are against background music. Great videos my man,keep up the good job this is one of the best sources on the topic

@latentvision 2 ай бұрын

no worries, BGM has been removed long ago :)

@TheWolverine1984 3 ай бұрын

Listen, the only problem with your videos is that there are too few of them. Each video I watched contains a wealth of knowledge that is missing from any other comfyui or SD videos I watched. I learn so much from your work. Thank you very much.

@MassimoTodaro74 7 ай бұрын

mitico - grazie

@user-cx6jd2bj9k 4 ай бұрын

thanks you so much for tutorial

@user-cp8vm5ef2l 7 ай бұрын

Thank you!

@checkmate559 5 ай бұрын

Ur legend man ❤

@kezzit 2 күн бұрын

Thanks, it's a magic! )

@SBaldo8 7 ай бұрын

freakin amazing stuff

@SBaldo8 7 ай бұрын

I was wondering about ways to enhance animation stability with this, might try something later

@neofuturist 7 ай бұрын

Ciao Matteo, 6 un Mito!!

@ImmacHn 7 ай бұрын

Oh God, I'm glad I came back to this video, I started using attention masks but misunderstood what they were for, I thought it was so the ipadapter would only take into account whatever was in the mask /_ \

@alexmehler6765 7 ай бұрын

this is some crazy magic ..

@ColoNihilism 7 ай бұрын

Awesome (A)EYE opener

@latentvision 7 ай бұрын

I see what you did there 😄

@KooroshGhotb 7 ай бұрын

The way you harness the power of ComfyUI is amazing, I wish you could make a tutorial for Comfyui, not just IP adapter. I'm sure there are a lot of things that we can learn from you. Please consider this.

@latentvision 7 ай бұрын

I've made a couple of more generic tutorials, I'll do more in the future. thanks!

@KooroshGhotb 7 ай бұрын

@@latentvision No sir, thank you for sharing your knowledge with us. Hope I could learn more from you.

@KooroshGhotb 7 ай бұрын

A quick question though, I followed the link you provided in the captions for ComfyUI essentials extension, seems it leads to IP-Adapter GitHub page. Yet I couldn't find "Image Crop+", even after loading the workflow, Install missing custom nodes couldn't find it.

@latentvision 7 ай бұрын

my bad, wrong link, should be fixed now@@KooroshGhotb

@KooroshGhotb 7 ай бұрын

@@latentvision Thanks

@mattm7319 3 ай бұрын

grande!

@parth35ify 6 ай бұрын

Bro is a wizard

@kakochka1 7 ай бұрын

Great tut as usual! Will help me greatly in concepting my own characters) btw, could you tell me your opinion on UltimateSDUpscale and why don't u use it?)

@mariemuller6380 7 ай бұрын

Really helpful! Could you please make a tutorial about real-life characters ? Would highly appreciate it

@olabassey3142 4 ай бұрын

genius

@MegaDancesport 4 ай бұрын

Great video! thank you! but I can't figure out why the Apple IPAdapter node is missing.

@zerox9646 6 ай бұрын

crazy

@joebreaker11 3 ай бұрын

Hey, Matteo! Thanks so much for the lesson. Could you plz explain how to variate noise with the help of the Advanced IP Adapter? Its parameters are different from those of the old node that by times I'm feeling at a loss. Is there any way to use the old legacy IP Adapter Nodes?

@user-FuTaiwanCK 7 ай бұрын

wow，it can make animate

@TedWillingham 7 ай бұрын

Impressive! Do you think adding 1-2 additional images to the face ip adapter will allow for more flexible generations - e.g. a side profile view as well? Or will this simply crowd out the concepts?

@latentvision 7 ай бұрын

I would use multiple images based on what I need to do. For example if I need to generate only happy people, I would make a smiling reference. The closer the reference is to what you need to do the better. Sending two contrasting pieces of information to the IPAdapter could be detrimental. That being said nobody knows how this stuff really works and the best way is to experiment.

@ga1205 4 ай бұрын

Great video! I'm getting this error though and can't seem to find the node when searching: When loading the graph, the following node types were not found: IPAdapterApply. If I try running it regardless, I get SyntaxError: Unexpected non-whitespace character after JSON at position 4 (line 1 column 5)

@DeGandalf 7 ай бұрын

I'm still pretty new to SD, what's the difference between lowering the CFG in the K Sampler vs using the rescale CFG node?

@latentvision 7 ай бұрын

roughly said with a cfg rescale you get the benefit of a higher CFG without burning the image

@thebensimon 7 ай бұрын

Magnificent workflow! trying to extend it even further by controlling the environment with batch images and IP Adapter. Any suggestions on what would be a good way to combine such workflow that would merge/replace the current environment setup? (Clip Text Encode Prompt alongside the OpenPose CN)

@latentvision 7 ай бұрын

You could add a forth masked IPAdapter for the background (head, torso, legs, background). You need to carefully create the masks, check my other video about masked attention.

@eucharistenjoyer 7 ай бұрын

Great video as always. If you don't mind me asking, what does CFG Rescaling do? I've never seen this node before.

@latentvision 7 ай бұрын

simply said lets you use higher CFG values without burning the image

@juredujmovic 7 ай бұрын

Amazing work, Matteo! I've never liked Comfy because it often gave me errors that were hard to debug but no one explains things like you do, and now it's a lot more clear! So thank you for your tutorial - it's very helpful! However, right now I'm stuck with one error - where can I find the model you have put in the clip vision node? When I load your workflow, it's empty. I tried googling for it, but to no avail. Any help is appreciated!

@latentvision 7 ай бұрын

go to the extension repository, there are detailed instructions for installation

@lilillllii246 6 ай бұрын

Thanks. Is there any way to copy the facial expression to a specific photo?

@sanchitwadehra 5 ай бұрын

damn you control comfyui like it's your brain

@EranMahalu 7 ай бұрын

wow dude

@latentvision 7 ай бұрын

IKR?!

@lazyh0rse 5 ай бұрын

thanks for the workflow, however, I seem to get images that matches the backgrounds of the reference images supplied to the ip adapter processors. Is there a way I can reduce this bias? For example when I generate flat background of poses (gray background), it tries to generate an image that matches theese backgrounds. It also gets influenced by the hair color of the character. If I have a red hair woman, the output will contain more "red"ish things on it.

@RhapsHayden 2 ай бұрын

Have you thought about improving and importing Thin Plate Spline?

@AlastorsNight 7 ай бұрын

Awsome video! This is something I have been trying to do but have had little success with. I do have a question though, where do you find the control_v11p_sd15_openpose_fp16.safetensor file that you have in your workflow? I have seen several people who share their workflows have started to use it but I have no idea where to find it as I keep getting sent back to the regular repositories which don't seem to have them.