SUPIR: Best Stable Diffusion Super Resolution Upscaler + full workflow.

Рет қаралды 17,920

Күн бұрын

Пікірлер: 100

@stephantual 4 ай бұрын

Update: 3/29/24 (yes it moves fast) - it's been updated again - well about 10+ times actually. Because vRAM is still a concern, I've made it available as a one-click app at tinyurl.com/supirv2 , and updated the downloadable worfklow to reflect the addition of better Lightning support as well as LORAs. Cheers! 👽

@Homopolitan_ai 4 ай бұрын

Not really useful as an upscaler if with 24GB it can't even do 4K. More like a restorer really. I'll pass for now.

@stephantual 4 ай бұрын

@@Homopolitan_aiYeah it's super violent resource-wise. 👽

@moebiusSurfing 4 ай бұрын

Can be run on a 12Gb VRAM card? Even with limited output scaling?

@stephantual 4 ай бұрын

@@moebiusSurfing With teeny-tiny images yah, I think you'll be good. It's really hard to gauge though because comfy doesn't always allocate vram in expected ways.

@NotThatOlivia 4 ай бұрын

yup@@Homopolitan_ai

@noonesbiznass5389 4 ай бұрын

Love your presentation style, thanks

@musty5551 4 ай бұрын

Insane results!

@muyuliu8196 4 ай бұрын

Thank you for your tutorial！ It's really interesting and useful

@bwheldale 4 ай бұрын

Forgive me if I'm too over-excited but I love every node in this workflow, all a bonus. The switches, DeJPG Downsize, Query, text watermark, and of course the SUPIR Upscaler, all elegantly in one. Sadly I work mostly with low-quality source images almost exclusively. But I'm now getting the best results on the poorest quality source images so far that over the years of trying "this and that". This has made my day! Thank you.

@stephantual 4 ай бұрын

Great to hear! You're going to like the next video - i've managed to upscale a tiny , TINY video from my first digicam (176 px wide), using ADLCM+SD15+the new modelscope nodes.

@Chad-xd3vr 4 ай бұрын

Thanks again, great content

@kallamamran 3 ай бұрын

Good video, good speed. Thanks!

@o0playperu0o 3 ай бұрын

I like that transformer kid in the corner great video

@daovinipuxa649 4 ай бұрын

Thanks a lot!

@p_p 3 ай бұрын

@CharlesLijt 4 ай бұрын

WOW Stephan this is awesome! Thanks for the hard work!. May I ask a simple question regarding the outpainting? Do you know there is any way to do outpainting using "inpaint and Lama" like we did in A1111 webui? All I can find is a preprocessor called Lama Preprocessor for Comfy, But that node can only repaint the whole picture and change the final outputs color for some wierd reason. Is there better workflow to achieve outpainting meanwhile dont change its color and keep the consistency? Thanks in advance dude! you are a legend!

@stephantual 4 ай бұрын

It's definitely possible, but I don't think youtube comments would let me type enough words - it's quite involved but not that hard. Hop on the discord! 👽

@genAIration 4 ай бұрын

Hello Stephan! Thx for sharing your knowledge. I want to asking this is work with lightning models?

@stephantual 4 ай бұрын

That's a good question, sadly the anwer is not yet, probably some imcompatibility with the internal control net. I tried and while it didn't crash, the image came back totally cooked no matter what settings I used :)

@KichintoKiki 4 ай бұрын

Yes, even RTX 3060ti 8GB can handle this Workflow for SUPIR. Thanks you. you and Kijai.

@highcollector 4 ай бұрын

Wasn't 12GB the minimum Vram needed to use this? Maybe in your case it's sharing with the system memory so it would be extremely slow?

@tirriaq 4 ай бұрын

--lowvram?

@KichintoKiki 4 ай бұрын

@@highcollector in this workflow it use 4x upscale, but i use 2x, and i use WD14 tagger and custom prompt instead. 14 minute for 720x898 px resource image.

@KichintoKiki 4 ай бұрын

@@highcollector i think SUPIR good for upscale with small img. but med not quite good if i compare with StableSR Upscale.

@stephantual 4 ай бұрын

Thank for confirming that, short of switching gpus for testing I have no way to check 😂👽👍

@RickB2011 4 ай бұрын

Great video, thanks for the effort to research & put it together. A question, please. My installation won't load the SUPIR custom node, getting " No module named 'omegaconf' ". Any idea where this came from for you?

@stephantual 4 ай бұрын

Pytorch is probably out of date - try updating the whole of comfy + dependencies.

@marcoantonionunezcosinga7828 3 ай бұрын

I loved the music you played at min 9:25, and the woman was a little more Asian and came out a little Latin😀

@stephantual 3 ай бұрын

Haha yeah the real version of her wasn't very happy with the video 😅👽

@latent-broadcasting 4 ай бұрын

It's amazing! Any idea on how to process a folder of images in batch? I want to use it for improve the images of a dataset for a DreamBooth

@stephantual 4 ай бұрын

It will work in batch but you have to be SUPER careful with the ram. There's a batch setting in the new update of the node, and some advice by kijai on the discord 👽Thanks for watching! and it's a good point you make.

@svenvarg6913 4 ай бұрын

You can use the Load Image From Path node, there's also VHS_LoadImages node but this requires all images to be the same resolution.

@latent-broadcasting 4 ай бұрын

@@stephantual @svenvarg6913 thanks for answering both of you. I tried the batch setting and it worked! It's going to improve my dasets for sure, even with default prompt works amazingly well

@ccorkin 4 ай бұрын

Hey Stephan, I am stumped I keep getting the error (When loading the graph, the following node types were not found: SUPIR_Upscale....), when loading your workflow as well as a few over similar workflows around SUPIR. I've installed the requirement.txt file into the SUPIR custom node folder and nothing...can you offer any advice?

@stephantual 4 ай бұрын

You mean the node doens't appear when you have installed it? Make sure you have git pulled the node into the right directory, i've done that too :) it should automatically pick it up - but only after a comfy restart of course :) 👽

@user-lj3qe7oz2i 4 ай бұрын

same@@stephantual

@Ridd_Ex 4 ай бұрын

i think you need to run "python_embeded\python.exe -m pip install -r ComfyUI\custom_nodes\ComfyUI-SUPIR equirements.txt" in your main folder if your using the portable version

@Strawberry_ZA 4 ай бұрын

my comfyui shell shows: "Using pytorch cross attention" - no idea how to switch it to xformers... Any help, pretty please?

@stephantual 4 ай бұрын

mmm 0:51 is how you install xformers - but in the lastest SUPIR update (yes it's been updated twice since the vid) , xformers are no longer required. They're nice to have though :) 👽

@loubakalouba 4 ай бұрын

Thank you! I can't seem to be able to get the node working I guess the problem is "No module named 'omegaconf'" I have spent 2 hours trying to install omegafuckinconf with no luck. However, you are a good human and your tutorials are gold.

@stephantual 4 ай бұрын

Sorry, that's probably my bad. The node was updated again this morning, and it looks like the requirements are well, required now :) - just run pip install -r requirements.txt inside the node's folder (and if you're on portable, you might need to do something like going to python_embeded, then python.exe -m pip install -r ..\ComfyUI\custom_nodes\ComfyUI-SUPIR equirements.txt. I hope this helps! 👽

@loubakalouba 4 ай бұрын

@@stephantual Thank you, I get a syntax error when in python.exe, I tried to (-m pip install -r G:\comfy 2 ew_ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-SUPIR equirements.txt). Ignoring me would make your life so much better D

@LumpDigital 2 ай бұрын

its Xformers necessary to use? It keeps braking my comfy UI instalation

@user-wx9ms5zc4j 4 ай бұрын

Bruh! Should have not spent hours to get the yesterdays WorkFflow LMAO

@stephantual 4 ай бұрын

Yeah thing move FAST. The switcharoo happened to me mid-recording when Kijai announced the new one, so started from scratch haha :) it's okay it's part of the fun! 👽

@user-ie4hv3gh2x 3 ай бұрын

In the [Load Upscale Model] node, it shows that I am missing the [1xDeJPG_OmniSR.pth] model file. Can you tell me where to download it? Thank you very much.

@stephantual 3 ай бұрын

You can use any upscaler/artifact remover here, just grab it from openmodeldb.info/. The one you're looking for (which doesn't upscale but removes compression artifacts) is at models/1x-DeJPG-OmniSR

@SyamsQbattar Ай бұрын

how to show CPU, GPU, RAM and VRAM like your Comfyui?

@MaddyMF 4 ай бұрын

keep getting this error, did everything like you. not sure what "usually" goes in the ksampler Error occurred when executing SUPIR_Upscale: Sizes of tensors must match except in dimension 1. Expected size 376 but got size 375 for tensor number 1 in the list. also im getting more out of the interrogator with this prompt: describe the image as if i were blind, tell me everything about it, explain it in great detail, my life depends on this

@stephantual 4 ай бұрын

Supir got updated 7 times since this video. I'd recommend giving it another try, lower the steps and if you are 100% sure you found a bug, post on the github help section: github.com/kijai/ComfyUI-SUPIR/issues

@CabrioDriving 4 ай бұрын

4:10 no safetensors models? Crazy in 2024.

@stephantual 3 ай бұрын

That's a fair comment. Two points: a) most if not all of the comfyui nodes are 'wrappers' for algos developed by 3rd party as i'm sure you know. If they don't provide the safetensors, they can't be included. b) I agree safety is a huge concern at this point. It would be trivial to write or modify a node that embeds entire payloads, and if you look at the comments or the reddit, you'll see a lot of people don't watch the videos, they just install the workflow like it was an app, which is a disaster waiting to happen. I'm doing my best to educate, and I hope that as a community we're going to bring up the security standards higher.

@DarknessEssense 4 ай бұрын

Hey, I'm getting this error from the interrogator: "ImportError: cannot import name 'ToImage' from 'torchvision.transforms.v2'" Any idea how to fix please?

@stephantual 4 ай бұрын

Really hard to tell without knowing the environment but that sounds like your pytorch is old, or torchvision is old, or both. It can be tricky as some nodes have different dependencies, the best bet is run a update_comfyui_and_python_dependencies.bat (assuming you're on windows) in this case.Good luck!

@greyMB 4 ай бұрын

Do you think I can use it for making animation?

@stephantual 4 ай бұрын

I'll be honest - I've seen ONE person use it for that, as a test, on an A6000, with a very short vid. It's a better strategy to use animate diff + ipadater + controlGIF cn then pass the lot to Ultimate SD upscaler (the cn will maintain structure, the adapter style) - I've seen this done on zeroscope content with great results! Jump on my discord i'll be posting workflows demoing that in the next 24h (its bed time here :) Cheers! 👽

@erikdias9604 4 ай бұрын

Great job, thx for this video. I have à error message: omegaconf missing (requirements.txt line 8). If anyone knows what to do, thanks in advance. Otherwise, I will delete the files before starting again.

@stephantual 4 ай бұрын

Sure thing! Try pip install -r requirements.txt from within the SUPIR custom node folder. It's very hard for me to type KZfaq, especially while I'm on mobile, but feel free to join our Discord where there is a good community of people that can help! Tinyurl.com/URSIUM. Cheers! I'd love for you to sort it out because it's a great tool! 👽👽👽

@cfcmoon1 4 ай бұрын

Error occurred when executing SUPIR_Upscale: 'MemoryEfficientAttnBlock' object has no attribute 'group_norm' 😥

@stephantual 4 ай бұрын

Join us at tinyurl.com/ursium or if you don't have discord post worfklow + full trace on the SUPIR github issue page 👽

@LiptonDa 14 күн бұрын

i have error error occurred when executing supir_upscale

@WalidDingsdale 4 ай бұрын

what's your conclusion and answer to "the HOT new Stable Diffusion super-res upscaler that destroys every other upscaler (again). Or does it?"? As always thank your for sharing this walkthrough.

@stephantual 4 ай бұрын

The title hints at the answer - there's no such thing despite what people would like to say. Depends on the job at hand. I feel CCSR is tighter , more akin to a pixel upscaler, it's also slow. I'm using SIAX models or real_ersgan or foolhardy depending on the need when it need to 'go fast' or have an intermediary step to complete with something like zeroscope. For photo upscales, I'm a sucker for 1:1 matches so I'm using topaz. For AI-generate video upscales, something like a chain of AD LCM + Ipadapter + Ultimate Upscale. Really depends on the job!

@HestoySeghuro 4 ай бұрын

It does it. Trust me.

@WalidDingsdale 4 ай бұрын

@@stephantualthanks for your answer.

@stepahinigor 4 ай бұрын

What exactly does "this item is non-commercial, so please be very careful and considerate" mean?

@stephantual 4 ай бұрын

It means that you cannot use this on commercial projects because the license says so :( . Sadly, it's becoming increasingly common with projects, but it's not the fault of the node developers - it's models themselves that are under certain licensing terms. As for 'considerate' - it means "don't abuse the system just because no will will go and check" :) 👽

@stepahinigor 4 ай бұрын

@@stephantual this is actually an interesting topic for discussion where exactly the boundary between commercial and non-commercial use is. For example, I have a side project where I need to make X portraits of people instead of a photo shoot or other people's photos from google images and the project is 100% public good kind. But let's imagine that my supporters gave me 1 million dollars through patreon or some crowdfunding platform. Would that be a commercial use?

@AshleyBear00oo00 4 ай бұрын

Anytime I try to install SUPIR in comfyui I just get the same error, (import failed.)

@RJWLane 4 ай бұрын

Same

@stephantual 4 ай бұрын

Hello there! 🛸 It's extremely difficult for me to give technical support over KZfaq, but if you join the discord I would be more than happy to have a look! Usually this is due to either a configuration error (directories) or we could be linked to PyTorch. Try installing the requirements using pip install -r requirements.txt within the SUPIR custom nodes folder. 👽

@WhatsThisStickyStuff 4 ай бұрын

Non commercial is annoying. Id like to use this as a last pass on my freelance work

@stephantual 4 ай бұрын

Yeah I agree. It's a hot button topic right now for sure. Cascade is non-com, now this, tons of things are following suit. Very sad imho :( 👽

@WhatsThisStickyStuff 4 ай бұрын

@@stephantual hey btw do you do consulting? Would be interested in having your input on a comfy workflow Im working on.

@amkkart 4 ай бұрын

Qlhow to uninstall comfy ? I guess I don't have xformer

@stephantual 4 ай бұрын

You mean uninstalling the xformers? pip uninstall and location of packages. To completely uninstall comfy, just wipe the folder clean if you're using portable (it's self-contained). But 99% of the time it's not needed as you can recover just about anything using the terminal. Plus, it's sad if you remove comfy 😢

@amkkart 4 ай бұрын

@stephantual I mean if I have some problems with comfy I will Uninstaller to reinstall again...

@flyingdogsoft 3 ай бұрын

the ComfyUI node should not exists because it is a licence violation in my opinion (GPL). SUPIR is non-commercial only so it is not really useful without buying a proper license from them.

@hekuranmusli1072 4 ай бұрын

Supir Upscaler not showing up, Noob here what am i missing?

@stephantual 4 ай бұрын

If you mean 'it's not on manager' - it might not be like most things I demo here (I haven't checked - I don't use manager). In my video there's an explanation on how to install it via github. If you need more help don't hesitate to join the discord at tinyurl.com/URSIUM 👽

@JulienTaillez 4 ай бұрын

this will not on mac I guess (no xformers)

@stephantual 4 ай бұрын

It's getting updated as we speak and Kijai said he would provide an option. Keep an eye on the repo 👽

@user-cz3io5tg5l 4 ай бұрын

okay, with 16 gb ram it is just crashing without saying anything :(

@stephantual 4 ай бұрын

Try lowering the size of the pixels going in by using a downscale first, start at 512x512 and work your way up. Kijai might have reverted a PR.

@user-cz3io5tg5l 4 ай бұрын

I tried even 256x256 image but it crashes while loading models, probably 16gb is just not enough to fit both sdxl and supir models@@stephantual

@stephantual 4 ай бұрын

Yes that's likely. Are you using tiled vaes? It can help. Also you can reduce the size of the encoder tiles. It may introduce lines but it does make the vram usage more reasonable, a bit like what you encouter with things with ultimateSD upscaler. @@user-cz3io5tg5l

@user-cz3io5tg5l 4 ай бұрын

@@stephantual yea I did... gonna do a bit of upgrading soon

@SyamsQbattar Ай бұрын

how to run run_nvidia_gpu.bat?

@LUCArchiAI 2 ай бұрын

I get this error when using SUPIR with moondream, please help me solve it, thank you Error occurred when executing Moondream Interrogator: You have to trust remote code to use this node! File "G:\ComfyUI\ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "G:\ComfyUI\ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "G:\ComfyUI\ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "G:\ComfyUI\ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\custom_nodes\ComfyUI-Hangover-Moondream\ho_moondream.py", line 74, in interrogate raise ValueError("You have to trust remote code to use this node!")