Using Stablediffusion to create a pointcloud 3D effect in Touchdesigner. Part 1

Рет қаралды 10,772

Күн бұрын

In this tutorial, we are going to look at a method to simulate a Pointcloud model in Touchdesigner based on a StableDiffusion output.
The second part of the tutorial will be available on my Patreon along with project files.
/ dith_idsgn
Some useful links to install stablediffusion and models :
stable-diffusion-art.com/
civitai.com/
If you want to follow me on other social platforms :
/ dithdsgn1
/ dith_idsgn
Website :
www.dith.media

Пікірлер: 30

@comp1mov 5 ай бұрын

Thank you! Very interesting!

@albertoveiga3689 4 ай бұрын

Awesome!

@lihanfitz5561 15 күн бұрын

So clever and simple thanks!

@folders_apries 5 ай бұрын

really cool!

@Csavenables 5 ай бұрын

Amazing! Thank you! 🙏🏻 🎉

@Dithdsgn 5 ай бұрын

Glad you liked it :)

@RusticRaver 3 ай бұрын

incredible, merci

@ethanalloway5946 3 ай бұрын

Nice concept!

@Dithdsgn 3 ай бұрын

Glad you think so!

@gnomalab 5 ай бұрын

pum! Love it.

@Dithdsgn 5 ай бұрын

Glad you do !

@markus_knoedel 5 ай бұрын

Wow!

@RUSTCOHLE59139 4 ай бұрын

Merci c'est trés fort

@nguyencuongmuoiba 3 ай бұрын

part 2 plz

@kaonashi3D 5 ай бұрын

Would u be able to do this this with a real time generated depth map? Like from video footage ? Is there away I could dm u some questions

@kaonashi3D 5 ай бұрын

Never mind after many hours I figured it out! Hahah it’s definitely possible just was a bit tuff

@Dithdsgn 5 ай бұрын

Sorry, just seeing your comment now. I would be curious to see what solutions you came up with :) On first thinking I wouldn't use stablediffusion depthmap to do so, as in order to achieve it you would need to extract each images of a movie, and then process the depth map of each pictures. The stability in the results would be a bit odd. But you could extract the depthmap out of a movie using davinci resolve. It will offer a better stability, and the yes, you could process it realtime in touchdesigner.

@KAZZinteractive 4 ай бұрын

7:10 What if I used Midjourney and MiDaS Depth Maps (which produces an 8-bit fixed RGBA image)? Is it not compatible? or do i just edit the GLSL top settings to an 8bit fixed RGBA pixel format?

@Dithdsgn 4 ай бұрын

You can of course use Midjourney to generate the first image, but for the depth one you will need something at 16 or 32 bit float.

@KAZZinteractive 4 ай бұрын

@@Dithdsgn when i add the color rgba to the Geo COMP there’s an error. Is this because the the colormap is 16bit pixel, and the depth map is 8bit pixel? Do they have to be the same?

@Dithdsgn 4 ай бұрын

@@KAZZinteractive No, the bitrate should not be an issue, but the resolution of each operator is. Are you sure your color map and depth map are the same resolution ?

@KAZZinteractive 4 ай бұрын

@@Dithdsgn yes they're the same. The error says all ops must generate the same number of instances.

@Dithdsgn 4 ай бұрын

@@KAZZinteractive That means that your tops your are instancing from do not match in resolution. Are you using a top for the scale aswell ? You should check the resolution of all the tops you are referencing in your geo.