TD Diffusion API - Stable Diffusion image generator in TouchDesigner

Рет қаралды 12,280

Күн бұрын

In this video I will show you how to use #stablediffusion in #touchdesigner locally on your computer.
Socials:
/ olegchomp
/ vjschool
/ oleg__chomp
Links & Commands:
00:00 - Pipeline description
00:28 - Distributive
github.com/AUTOMATIC1111/stab...
github.com/olegchomp/TDDiffus...
00:40 - Python 3.10.6
www.python.org/downloads/wind...
00:50 - Git
git-scm.com/download/win
01:00 - PIP
py -m ensurepip --upgrade
01:07 - Pillow и Requests
pip install pillow
pip install requests
01:19 - Automatic1111 API installation
--api
01:37 - Stable Diffusion model
huggingface.co/models?other=s...
01:54 - Check Stable Diffusion
127.0.0.1/7860
02:04 - TDDiffusion API
02:34 - Lexica
lexica.art/
03:26 - ImageReady trigger
You can support VJ SCHOOL once at Gumroad or do it monthly at Boosty.
- boosty.to/vjschool

Пікірлер: 39

@sonic_canvas 7 ай бұрын

Thank you so much. The TDDffussionAPI file has now been updated to 2.0.9. And there are a lot of menus here that aren't in the tutorial. Do you happen to have any thoughts of creating a new tutorial with a project that utilizes this with additional explanations on this?

@erende44 Жыл бұрын

fantastic job! Thank you a lot

@mustaTraceur 4 ай бұрын

MacBook Air M1 I´m having this issue, when I drop the .tox at and I reload the dependencies in the settings I get 'AUTOMATIC1111 not running. I already running the webUI through the terminal, and I'd flag the --api I dont know if it´s true but I´d read that MacOS doesnt execute the .bat files... Someone maybe know how to run the api on mac?

@santiagoespinoza5265 Жыл бұрын

Thanks for the video, really helpfull. Just a question, there is a way to animate between generated images?

@rockinrobin8834 Жыл бұрын

(really appreciate your sharing) I encounter a situation (v.2.0.6) where the log says "Status: Connected to Automatic1111" while the txt2img function stays grey (unactivated)

@dosu5064 Ай бұрын

2:14 Where did you get that Node in Touch Designer

@reijoloik9784 7 ай бұрын

Hi, Oleg. The API is amazing. I´m trying to use Roop (or any faceswapper) within TD to create a TD/AI photobooth for an art installation. Do you know - could Roop somehow be added to my workflow through TdiffusionAPI?

@guillaumepreat708 Жыл бұрын

Amazing !

@erende44 9 ай бұрын

hello again, we work with your great TDDiffusion tool. And there was always sth peculiar with "image ready used as "pulse" instantly. It is somehow always trying to :take too much on itself" and after some time, generations are delayed/ queued, don't know how to describe it. Did you have similar experiences?

@michelleWalter-jm9hm Жыл бұрын

Hey, I'm having some issues with lexica: There are no pictures appearing in the lexica window, but they are generated as I can see them in the folder but not on touchdesigner...

@syverlauritz Жыл бұрын

Same here.

@mikhailplotnik5689 Жыл бұрын

same for me

@VJSCHOOL Жыл бұрын

hey! please update to new version on Github page.

@user-xo9lq7je2b 6 ай бұрын

Hi，Oleg。Thank you for your sharing.I am trying to put the Api argument into the notepad which is shown on 1'26'' in this vedio,i wonder how to find the api argument and paste it.I can't understand it clearly.

@cmllcstlln Ай бұрын

the API argument is the description, you can see that it is " --api "

@aboalyuss 4 ай бұрын

Hello Am I the only one here using mac and having issues? It says Automatic 1111 is not running and there is no python in settings to add it. what could be the solution with newer versions

@ianfan4224 Жыл бұрын

may i ask how to use the new version of TDA of imgtoimg mode,where should i put the TOP/other img into the imgtoimg mode🙏thanks

@VJSCHOOL Жыл бұрын

There is TOP in named img2img, connect any top to it and use img2img tab in component

@DSJOfficial94 Жыл бұрын

cool

@cocompi Жыл бұрын

webui works for me but not Lexica inside TDDiffussionAPI (using mac here). It says "Lexica not available". Do you know any solution to this?

@VJSCHOOL Жыл бұрын

Can you dive into comp and check WebClient + JSON DAT for errors? You can make screenshots of errors and send them to me on GitHub or discord. This error means that something is wrong with your connection to the Lexica website. Also, what's your TD version?

@cocompi Жыл бұрын

thank you, I contacted you in Discord in the API channel

@b4rretto Жыл бұрын

how did you manage to make it run on a mac? The auto1111 is running just fine and I've pasted the python path but I'm having an error that says "json1 dat is empty".

@VJSCHOOL Жыл бұрын

@@b4rretto hi! there is new version on Github, that should works on 2022.32120 version.

@unveil7762 Жыл бұрын

thanks this is pritty good!! i would like to use deforum stabel diffusion rather than automatic1111, for now i am recompiling the the .py and run a subProces not sure if deforum has this kind of API... i ll check your tox thanks for sharing!!!!!!!

@NickFidalgo 9 ай бұрын

have you figured out how to use this with deforum?

@Muktahasan Жыл бұрын

is Lexica must needed or can use an free one if there are any or is it fully free ?

@VJSCHOOL Жыл бұрын

Lexica is optional

@erende44 Жыл бұрын

one question, should controlnet work already or we need to put some work in it?

@VJSCHOOL Жыл бұрын

What you mean “work in it”?

@erende44 Жыл бұрын

@@VJSCHOOL mispelled. I checked - there was an API update and controlnet doesn't work anymore trough API in TouchDesigner

@satyamjha_2 Жыл бұрын

Is there a way to do img2img using touchdesigner as well?

@VJSCHOOL Жыл бұрын

Yes! There is 1.1.5 version in beta test. For now I’m waiting for feedback and will release it.

@sebadelprado Жыл бұрын

@@VJSCHOOL Looking forward to it, thank you very much for your dedication

@VJSCHOOL Жыл бұрын

@@sebadelprado check new version on Github

@sebadelprado Жыл бұрын

@@VJSCHOOL 👌

@user-hf4iq7nc7u 11 ай бұрын

Want to update the tutorial with a new version

@user-ll4xl1dt9h Жыл бұрын

Why doesn't the image appear when I click？

@VJSCHOOL Жыл бұрын

On what step this happened? Does status line show any error? If you familiar with GitHub, you can open issue on TDDiffusionAPI git and share screenshot and more info. So it will be much easier too find the issue.