ControlNet for SDXL is OUT!

Рет қаралды 3,659

10 ай бұрын

In this video, we are going through ControlNet Canny for SDXL V.1!
We are going to build a Colab notebook using the code provided by diffusers on HuggingFace, and we are going to use Canny with ComfyUI.
💬 Social Media:
[Discord] / discord
[Patreon] patreon.com/IntelligentArt?ut...
[Instagram] / lacarnevali
[TikTok] www.tiktok.com/@lacarnevali?i...
____________________________________________________________________
🤙🏻 Learn More:
/ membership
/ lauracarnevali
📰Article:
work in progress
📌 Links:
SD XL Paper: arxiv.org/abs/2307.01952
SD XL Base Download: huggingface.co/stabilityai/st...
SD XL Refiner Download: huggingface.co/stabilityai/st...
Canny ControlNet: huggingface.co/diffusers/cont...
Depth ControlNet: huggingface.co/diffusers/cont...
Openpose ControlNet: huggingface.co/thibaud/contro...
ComfyUI GitHub: github.com/comfyanonymous/Com...
SD XL 0.9 in ComfyUI!: • SDXL in ComfyUI!
Colab notebook: colab.research.google.com/dri...
ComfyUI .json file: drive.google.com/file/d/1XE88...
01:09 Create Colab Notebook
01:53 What is Canny ControlNet
03:45 Connect Colab to Google Drive
08:24 Low and High Threshold
10:45 Canny with ComfyUI
15:37 Importance of mask: Low and High Threshold
#aiart #stablediffusion #generativeart #stabilityai #stablediffusiontutorial
#sdxl #controlnet #canny

Пікірлер: 19

@paskmoe4969 10 ай бұрын

Great video thx.

@ZorroComputers 10 ай бұрын

Jesus, these guides ARE HARD.

@MemesAnimatedd 10 ай бұрын

Hi, is it possible to run multiple controlnets on colab? say canny, depth, and pose? great video, very helpful.

@LaCarnevali 10 ай бұрын

Yes you can, but not with SDXL yet. To run multiple ControlNet wtih SD 1.5 you need to go into settings > controlnet and increase the number of controlnet windows

@MemesAnimatedd 10 ай бұрын

thanks!, found a handy colab notebook with a manager and some custom nodes, i managed to make it work partially.. still experimenting with comfy and waiting for controlnet model updates for sdxl @@LaCarnevali

@ronen6020 10 ай бұрын

Thanks for the video. How come my prompt ask for black dog and I get a white dog?

@LaCarnevali 9 ай бұрын

generate in batch - or put black dog in brackets to give more importance ((black dog))

@LouisGedo 10 ай бұрын

@afaqandroid7757 10 ай бұрын

Hi Laura, instead of using colab for control net I want to use my local gpu. Please add a video on how to use local gpu with visual studio instead of using colab. Thanks.

@ozziemort 10 ай бұрын

Visual studio is just an IDE whereas colab is an environment, you'll need to replicate the environment locally I believe

@sherpya 10 ай бұрын

@@ozziemortI think some of dependency needs vs runtime or even visual studio on windows

@MikevomMars 10 ай бұрын

Doing hard cuts while explaining a ComfyUI set is a NO-GO! 😡It`s hard to follow the nodes anyway but each time you do a hard cut the viewer is kicked completely out and has to completely re-orientate again.

@LaCarnevali 10 ай бұрын

I can share my notebook/interface, but I don't think I have cut anything lol. If you start from the default interface should be easy to follow. Happy to help if needed :)

@MikevomMars 10 ай бұрын

@@LaCarnevali 12:36 / 12:44 / 13:14 / 13:20 and so on... this is very annoying. If you did no hard cuts, your notebook may be too slow for quick movements, I don`t know. In this case, you could try to move the screen a bit slower, so it is easier to follow.

@LaCarnevali 10 ай бұрын

@@MikevomMars I see what you mean, I have now shared the .json file: drive.google.com/file/d/1XE88ldcONAwGx_akqqDPDoDtFSmARPxT/view?usp=sharing

@jokosalsa 10 ай бұрын

@@MikevomMarsand you could be a little bit nicer. "Please" and "thank you" are magical words....manners manners.

@MikevomMars 10 ай бұрын

@@jokosalsa Oh, a lonely knight in search of love, using others to make himself look nice. We haven't had that in a long time.