Early access to videos as a Patreon supporter www.patreon.com/sebastiankamph

A much better solution when using "Masked Only" is to place a tiny dot of masking on or near content of the image that gives your masked region and prompt some context. What happen with Masked Only is that the image is cropped to fit just the masked part so many times it loses context to fit the new generation into. So if you want to in paint a hand, add a dot of mask further up the arm so it knows how it should be positioned or sized to match the rest of the arm. In your example adding a tiny dot of mask to the other coffee cup would have produced a better result. Simply because the cropping will include that contextual information. You have to leave in enough for the AI to work with.

The reason that the coffee cup doesn't fit well within the image is because the render box for the inpaint area is such a small part of the image - anything generated is done so only within the context of a) what is not denoised i.e. the original image and b) what SD can actually see (within the render box). For high denoising strength you generally want a larger render box, otherwise it's easy to lose context. But what if you only want to change a small area? No problem! The render area is created as a bounding box that contains all the inpaint area you've selected - so, you can increase it by adding tiny dots of inpaint area to the scene. If you make them very small then whatever is behind it will generally be unchanged once rendered, so only the main area you've selected will be altered - but the dots will still count towards the bounding box. In the example given, I would put one dot above and to the left of the first coffee cup, and one at the bottom and to the right of the table. That way, what is rendered will probably adher more closely to both the focus (the blur on the coffee cup) and orientation and size of the table. For lower denoising strength (0.5 or below I'd say) it will generally be able to glean the context from what remains of the original image, but for anything higher I get much better results with this method.

The reason you were struggling with the coffee cup is because "full image" is not just to keep the inpaint part the same resolution, but it tells the inpaint engine to look at the entire picture when drawing. So, you will get a perfectly sized cup, and correct sunlight on the cup coming from the window, for example. But with "masked only", it only looks at the area of the cup, and that's why it won't fit the scene as well.

Hey Seb, just a little tip. Once you're done inpainting, you can put the final image into img2img with very low denoise to remove inpainting blurs, shadows, etc. for a smoother result.

I immediately scrolled to comments after coffee cup fiasko and I wasn't disappointed. This community is so great, you can learn so much, so fast.

Awesome tutorial. Understanding the difference for masked content "original" and "latent noise" helped me so much. As others had already mentioned, making the inpaint area bigger also helps. When i Inpaint Body parts like the upper torso, I often mask the start of arms and the neck as well, so that inpaint understands in which direction the body is moving.

Awesome stuff! I was wondering what all the different settings for inpainting were for. I've just started messing around with Stable Diffusion and watching your videos has definitely helped me to start figuring out what's possible. Thanks again!

Hi, only got into Stable Diffusion a couple of weeks ago and hadn't had much luck with Inpainting, this tutorial made a lot of sense and got much better results with my first Inpaint after watching this. Thanks :)

This was a really good and condensed tutorial, thanks.

Thank you for these tutorials and sharing your process. They've been a huge help for me as a beginner to these tools.

I am new at the whole impainting topic and this video helped me a lot to get an overview of the possibilities. Many thanks ❤

I love you! In a week you have turned me from someone who had zero experience using AI tools to being a pro using stable diffusion. Thank you for all the amazing tutorials!

It's like ASMR for SD. Thank you!

This is a great tutorial, while I worked through the pain of learning this myself. I know this would have helped me hugely. Bonus, I did learn a bit more about the blur settings. Thank you very much.

love learning these skills, thx for the vid.

Fantastic tutorial man, informative and simple to follow

Thank you for the knowledge. BTW, Did you hear about the artist who took things too far? Guess he didn't know where to draw the line.

Very nice video. Inpainting in SD is not intuitive but your simple, to the point instructions helped to explain some issues I've been having with it. Thank you!

I've always found inpainting to be a bit hit and miss. That was useful. Thanks.

These tutorials are great. Thanks.

Alright I've subbed? joined? I dont know what the term is- I'm giving myself 2 full time weeks to really pick up on stable diffusion and you're helping to launch me. Thank you.

This was helpful Seb, thanks. Inpainting has always been a bit of a mystery.

Fine, I'll leave a comment after watching like a half dozen of your videos. Well paced, thorough explanations, technical expertise on the matter. Ok, then, I guess I have to thank you.

Marvelous tutorials like usual, keep going the good work!

Great tutorial! Thank you

Seb I could listen to your voice for hours

thank you for making these videos! You are a great teacher!

Thanks the guide and thanks to the commenters for extra tips.

Thank you for the information.

bookmarked, liked and subscribed. mastering these parts are so important and so much to try and fail at!

Nice video. Finally worked, thanks!

Cool stuff, you're a great teacher!🎖

Thanks. Finally got it working. So cool. My best AI idea. Develop a model from stereoscopic images only so it can draw in SBS 3D!

Bro doing the lord's work. Thanks for your awesome tutorials

This is exactly what I need. Thank you.

A tutorial for inpainting in ComfyUI would be good 😉 Your SDXL Workflow file is the best I've tried so far

Damn thanks for the zooooom! Was wondering when we gonna get it

Thank you !

I'm all for self-deprecating humo(u)r, but in all seriousness, you are a very capable teacher. Thank you.

Very useful video as usual. I've been struggling to get this to work. Getting the hand now. Including help from the comments in this section. Thanks folks.

OMG this was so useful!!!! Thanks!!

Thank u! amazing tutorial

1:09 - The scroll works by holding down Shift and scrolling the mouse wheel

Thank you so much!

thanks bro!

This is soooo good. Loving the tutorials and the dad jokes man !!

Thank you.

THX again Seb, very usefull :))

Great video, thank you

I thought Sebastian was a bad teacher at first, but then he told a dad joke... That's it, that's all I've got. Thanks again for a good tutorial 😁👍 i have also been using the regular model for inpainting, feels like more often then not the corresponding inpaint model is to truncated or seems to do the exact same thing as the regular one (or im just using it wrong).

I did this before but always fucked up, what was mainly because I still described the entire picture and didn't fit the resolution to the area. Your video helped a lot thank you.

Hi Sebastian. Thank you for your videos. I have a question. How can I create a workspace with interfaces like you have? Where can I download extra stuff to get more settings for my art? Thank you

I never imagined inpainting would be so simple, which is why I'm here. I was like nice I can draw black lines on stuff how does that help me? I genuinely thought you had to be fluent with digital painting for this. Thanks for the tutorial dude.

Great! Thank you so much for this =)

This was cool! Thank you. Do you have a vid that is focused on img2img (not inpainting)? Or a vid on outpainting would be very cool, too! One last vid I would like to see is how to craft txt2img prompts that avoid common defects, such as cropped heads, double body parts, Heterochromia, crossed-eyes, and other stable diffusion oddities.

Wow, thx ! I used a lot of inpainting for my newest video but still think it looks a little bit off in some places (e.g. the Maggot Robby faces). Just did a quick test with adjusted width/height to the face properties and it yields waaaay better results. I think the inpaint sketch is tricky, most of the time it looks really off. Much effort to repair it after an object is placed. btw. loved your Bob Ross style video, you really could open a second channel and just do that there

I wish there was a tool for drawing, like, a heat map on an image, that allowed you to highlight areas where major changes are required and areas where minor changes would be better, in the context of the whole image. Inpainting with a mask is a great tool, but it will always fail to account for image context. There's basically no way to get SD to make a second cup like the first one, for example (short of exporting to Photoshop or something). There's a tool in DALL-E where you can choose different mask colors and assign each color to specific idea, and I feel like that would be really useful if you could also assign weights to those colors.

great content

Another good idea for developers, make it so u can do the sketch to image by tagging each basic shape you draw, to choose where things will be placed in the pic. Instead of sketching a flying saucer it could just be a circle tagged to that prompt.

thanks you

great vid

amazing explanation and video also a masterclass in efficient teaching! Thanks. i am only facing an issue with the inpaint sketch where the whole UI gets laggy and slow, only with the sketch option, any potential causes cross your mind?

Finally! Canvas Zoom!!

thank you so much for this tutorial and going over many important things here. i have a question, hope you don't mind. at 10:00 , this is exactly how i would like to work on this, the sketch tools are extremely simple, how would this process go that you mention at 10:00 ? i am a pretty good artist, i would love to draw in an almost good cup there, and then have the ai merge/blend it in better with the rest of the image. or if i am lazy, i would love to be able to concept bash some stuff together, and have the ai fix it up.

great tuto : when i use the inpaint for my own face trained with dreambooth and the model protogen infinity, i usaully inpainting after the first result, with à 0.45 denoise.

Thanks!

The padding is useful to give the AI information about the outside when it should change the inside. Denoise + Padding balance is needed when you encounter that AI inpaints whole body inside the face mask especially at higher resolution. i set mine at about 188 generating at 1072 x 1400

Thanks. BTW - I've used inpaint sketch very little. A few times I tried, it was VERY laggy. Can't be the GPU and I've got the latest drivers too. For you it seemed to be working OK.

I think that using something like photoshop in-between the inpainting steps is key to getting great results. 😮

I have done many times of inpainting but never understand the options. Thank you.

Glad to see you're hanging around 2.1 models lately; that's where I'm at myself lately, and I'm convinced the community is snoozing on its potential. It's much faster, looks better by default, and (once you get used to it) is honestly easier to prompt for. Got any favorites for recommendation?

7:35 This is so like Bb Ross' happy little accidents 😂

What does the nfixer negative prompt do, exactly?

you're my new asmr

Inpainting is awesome but super finnicky. Really takes lot of iterations. But one thing I like using inpainting for is different facial expressions for a video game or visual novel.

love your videos man, thanks for the help! One issue im struggling with is that inpaint sketching seems to freeze every time I try to use it and then I have to reload the UI or cancel the image for A1111 to start working again,d you know what might be the issue?

Great

That was insightful. Thanks, pase of the video was good, never i felt lagging behind. Yet i can not not notice, how come your SD so fast? Mine generates 10 times slower, is there any guides on settings for automatic1111? I have 8 gigs VRAM, Nvidia 1080

Thank you for explaining this in depth, I now see why I could never get good results. 😉

I use invoke Ai when I need inpainting or outpainting if at all possible (lora support coming in a few days means a lot of the cases I can't right now soon will be possible). Much better interface. Hoping I can switch over entirely once the migration to nodes makes addons possible.

Hello! I installed Stabel Diff. based on your tutorials, texttoimg and imgtoimg works fine, controlnet all good. I got a problem that inpaintig doesnt work.Where i mask it doesnet change or it gets a blurry transtapernt ish overlay or it fills with 1 colror and thats it. I tryed to look in redit forums discussions but cant find any soulution. Do you have any suggestion?

How can i change the colors on brush? Can’t seem to find the settings for that

For making the coffee-cup fit in the scene, what if you first did it with the whole image to get a rough picture with the AI seeing the full context, and then went with the just-mask option to polish it?

The question I have when you jumped down the second cup rabbit hole is, can you just select or mask the existing coffee cup and make a copy to insert in the image or would that be something I would export the project to Photoshop for and play with over there?

Amazed that AI nailed the starbucks logo

thanks! what are the system requirements to run this ? or does this run on the cloud?

A quick question, on your top quick settings tab for Add Lora how did you set it to none?

What Model are you using here? What Model should we be using today for tweaks like this?

Great video, as always! Wondering if you can answer a question? When I choose "Only Masked" in Inpaint, I get this error: ValueError: Coordinate 'right' is less than 'left' Any idea why?

what do you have installed that lets you in paint with color and specifically being able to pan over the image to select the color of whatever youre hovered over?

it works!!

Can you change models while doing this? Like use a different model for a sketch or to re-render a face?

If we wanna fill the face with a lora or dreamboth model which denoising strength is ideal?

This is crazy

9:25 switch to "whole picture" instead of only masked for that particular task

Thaaaaaaaaaaaaaaaaaaaaaaaaaanksss!

Where can I find the checkpoint?

Is there any way to make automatic detect cloth area and using prompt change the clothes only not real face in image.

Please make a inpainting upload tab tutorial, thanks