How to connect everything to Stable Diffusion

Рет қаралды 19,039

Күн бұрын

In this video we'll go over basic examples of how to connect a Webcam, Photoshop or any other software to #stablediffusion, using #touchdesigner, #ComfyUI and OBS.
Socials:
/ olegchomp
/ oleg__chomp
Timecode and Links:
00:00 - Intro
00:23 - Install TouchDesigner
derivative.ca/
00:33 - Install ComfyUI
github.com/comfyanonymous/Com...
00:40 - Install ComfyUI Manager
github.com/ltdrdata/ComfyUI-M...
00:57 - Download Stable Diffusion model
civitai.com/models/4384/dream...
01:11 - Download VAE
huggingface.co/stabilityai/sd...
01:20 - Download ComfyUI updates
01:30 - Install External Tooling nodes
01:40 - Generate image in ComfyUI
02:13 - Preparing Workflow for TouchDesigner
02:55 - Download TDComfyUI
github.com/olegchomp/TDComfyU...
03:00 - Create a project in TouchDesigner
04:30 - Connect a webcam to Stable Diffusion
05:16 - Speed up Stable Diffusion (LCM, Latent Consistency Models LoRAs)
huggingface.co/latent-consist...
06:55 - Example of generation in Photoshop
06:57 - Install OBS
obsproject.com/
06:59 - Install Spout OBS Plugin
github.com/Off-World-Live/obs...
07:01 - List of Spout plugins
spout.zeal.co/
07:11 - Configure OBS and Photoshop
08:08 - Spout in TouchDesigner
08:22 - AutoCrop picture by Alpha channel.
forum.derivative.ca/t/image-p...
08:50 - Create an interface
10:44 - Draw in Photoshop
You can support VJ SCHOOL once or do it monthly at Boosty.
- boosty.to/vjschool
Join Discord server
- / discord

Пікірлер: 62

@optiphonic_ 6 ай бұрын

Exactly the workflow I was looking for, thanks for compiling this for us!!

@asquidsink 6 ай бұрын

just discovered your channel - this is my first project in touchdesigner and it's been awesome. looking forward to going through the rest, you're amazing keep it up!

@alecubudulecu 5 ай бұрын

Awesome vid. Very helpful. Been looking for something like this to hook photoshop into comfyui

@__ciscodisco 5 ай бұрын

u have no ideea how much I was lookin for this ! u have my subscribe

@ThePyramid21 6 ай бұрын

thanks , great explanation

@k0mario 8 күн бұрын

What an outstanding work! Thank yo uso much

@INITart 6 ай бұрын

this is awesome, thanks

@bipinpeter7820 5 ай бұрын

awesome! keep going 👍

@uncannyrover 4 ай бұрын

so helpfull! thank you

@dleon9781 4 ай бұрын

brilliant!

@santiago15608 4 ай бұрын

Thank you for the video! Although, why only the dreamshaper model seems to work?

@ed6280 5 ай бұрын

Спасибо!!! Подскажите, на какой карточе в тд юзали дифузию и какой макс фпс получился? И быть может посоветуете мелкую и быструю модельку, для макс фпс?

@youngtaekim3537 4 ай бұрын

I enjoyed the video you uploaded. This is a very interesting lecture. I have a question. It felt like the final output video was cut off at every frame. I would like to know if there is a way to make this part play more smoothly.

@rofococo 2 ай бұрын

Thanks for sharing so much knowledge! Is it possible to do all this when you have comfyUI working on cloud GPU services? If so would there be any difference in the workflow? My hardware handles touchdesigner but there's no way i could have decent performance with Stable Diffusion locally. Thanks in advance!

@eraizei 6 ай бұрын

Amazing work! Is it possible for you to share this Touch Designer workflow? Looks like a bit tricky =)

@zaidabueisa5285 5 ай бұрын

Hello , the image input doesnt work when i press generate it generate what is written in the prompt par , not what is inside etn_loadimagebase64 , what seems the proplem ?

@vrvr4969 4 ай бұрын

I wonder if there is a way to create differents prompts and randomize them

@vj-baker-88 4 ай бұрын

Thanks for this video about TD and Comfyui. Do you know other optimisations to reduce delay with webcam ? (choice of models, lora LCM, use of cuda/directML in comfyui, ...)

@alexdoho 3 ай бұрын

Looking for an answer on this too. any luck please?

@eyeleveleyeTube Ай бұрын

Hi. Thank you for tutorial. Is it real to transfer a picture directly from obs to stable diffusion?

@diegolg1189 6 ай бұрын

While trying on the Touch Designer step Generating the img2img banana still generates the same Angel from the sample, any idea on how to fix this ? Thx

@VJSCHOOL 6 ай бұрын

Try to change denoise parameter, something like 0.5 value

@topkek7049 5 ай бұрын

One issue i have, seed stays the same... Need to generate seed from each updated image from spout

@maurypb 6 ай бұрын

Thanks for publishing this! I'm having a problem... In TDComfyui node, the parameters aren't showing in the "workflow" page... any ideas as to why? I've tried hitting "re-init" on TDComfyUi node, as described in the node's instructions. I get status Connected, then disconnected. Thanks again!

@Adellovisuals 6 ай бұрын

Hi i just had the same problem. The issue was the format of the json. You have to use "save (API Format)" in ComfyUI instead of the normal save.

@mavro360 5 ай бұрын

Same issue here, i triede 22 version, re - init and save has api format and allways get same error in dax op in TD

@thedailyoseofpeace 5 ай бұрын

same!@@mavro360

@lee_sung_studio 4 ай бұрын

Try re-initing [TDComfyUI] before connecting [workflow_api]op to the [TDComfyUI] input.

@alexandertrattler2115 4 ай бұрын

try tind the safetensors in the text dat @@lee_sung_studio

@Dennis-vf3ny 2 ай бұрын

Hi any idea why i cant see the manager and share button in the comfyui

@JiaCUI-gd3qu 5 ай бұрын

Thanks , great explanation. My problem is how to build the SD-API? I install the stable-diffusion-webui in my computer locally. But, how to connect the local sd with the TD?

@VJSCHOOL 5 ай бұрын

You should use another component for a1111 webui github.com/olegchomp/TDDiffusionAPI

@bryanhernandez34 Ай бұрын

@@VJSCHOOL I have an urgent question for another video, can you help please?

@triangulummapping4516 Ай бұрын

Which Windows requierements do i need to run all this?

@asquidsink 6 ай бұрын

does anyone know of an easy way to integrate runpod or other external host for stablediffusion into a workflow like this?

@VJSCHOOL 6 ай бұрын

You can change ip and port in settings tab and connect to remote server

@user-cz3io5tg5l 6 ай бұрын

HI, thanks for tutorial but I am facing a problem. When new image begins generating, output replaces with black color. I have tried versions 1.0.1 and 1.0.2 of TDComfyUI but result the same

@VJSCHOOL 6 ай бұрын

There is logDAT output (pink color) where you can find status of generation and maybe there are some errors

@SebboThePotato 6 ай бұрын

I'm having the same issue any chance you found the solution?

@VJSCHOOL 6 ай бұрын

@@SebboThePotato read comment above. Without knowing what happing, no way to help somehow

@optiphonic_ 6 ай бұрын

I'm assuming you can probably just pipe the Load image Base64 into controlnet as well?

@VJSCHOOL 6 ай бұрын

Load image works like a pipe between ComfyUI and Touchdesigner, so you can connect it wherever you want. And also you can set multiple nodes, to use multiple images at same time.

@andresumbarila2833 4 ай бұрын

How do I make it as fast as the video you uploaded on Instagram?

@amkkart 18 күн бұрын

How can I connct tagtool to touchdesigner ?

@diegorojax 2 ай бұрын

Bro, this is brilliant, but I have Mac. Is it possible to do this with the M1?

@xLucio91x 2 ай бұрын

I would also like to know the same!

@upsidedownhorror 6 ай бұрын

stable diffusion runs in local right? cause i can't casue i have a amd graphic card

@VJSCHOOL 6 ай бұрын

It can be run on remote server also

@arzigogolato82 4 ай бұрын

Thi is insane but the connection between TouchDesigner and ConfyUI keeps disconnecting, is there a solution?

@andreasknops3123 2 ай бұрын

dang, what happend to bradley cooper in the thumbnail?

@Reddkomet 6 ай бұрын

I get broken workflow when loading into touch designer. Can you share your workflow?

@VJSCHOOL 6 ай бұрын

check that you export "API format" from ComfyUI

@Reddkomet 5 ай бұрын

@@VJSCHOOL I am, it's something with the load image node. I found out I needed an older version of touch designer, 2022.32660 is working.

@user-lq7cw7ni1f 5 ай бұрын

@@Reddkomet Thanks so much, your reply helps a lot!!!

@danielrubinstein6714 6 ай бұрын

This work with SDXL turbo?

@VJSCHOOL 6 ай бұрын

Yes

@ExplicityDesigns 4 ай бұрын

"broken workflow" ???

@phajel6629 2 ай бұрын

super cool, but the prompt execution time is too high. does anyone know how to speed it up? i have a m1 mac.