Real Time Camera to AI in ComfyUI

Рет қаралды 20,188

6 ай бұрын

Get 4 FREE MONTHS of NordVPN: nordvpn.com/enigmatic
Topaz Labs Affiliate: topazlabs.com/ref/2377/
Real Time AI Generations using your Camera in ComfyUI.
Twitter: @toyxyz3
HOW TO SUPPORT MY CHANNEL
-Support me by joining my Patreon: / enigmatic_e
_________________________________________________________________________
SOCIAL MEDIA
-Join my discord: / discord
-Twitch: / 8bit_e
-Instagram: / enigmatic_e
-Tik Tok: / enigmatic_e
-Twitter: / 8bit_e
- Business Contact: esolomedia@gmail.com
________________________________________________________________________
My PC Specs
GPU: RTX 4090
CPU: 13th Gen Intel(R) Core(TM) i9-13900KF
MEMORY: CORSAIR VENGEANCE 64 GB
LCM Lora:
civitai.com/models/195519/lcm...
Real time custom node: github.com/toyxyz/ComfyUI_toy...

Пікірлер: 103

@enigmatic_e 6 ай бұрын

Topaz Labz BLACK FRIDAY SALE: topazlabs.com/ref/2377

@jaharoni 6 ай бұрын

Quick with it!! Thank you for your dedication to these tutorials

@marcjoymedia 6 ай бұрын

Thank you so much for sharing. So many new possibilities!

@JingIeFett 5 ай бұрын

I'm having issues opening CaptureCam. I did the git install, clicked setup bat and then after when I click run bat, a command window briefly opens and closes and then nothing happens. Any ideas?

@BrunoPiresBPS 2 ай бұрын

same here

@lunarlouie 14 күн бұрын

@@BrunoPiresBPS do you find a solut8on to this?

@lunarlouie 14 күн бұрын

did you find a solution to this

@Vsmphoto 6 ай бұрын

Oh man, I could have used this last weekend. I did the same thing with Touch Designer and Compute Render, but this looks way faster and has custom models, which is crucial. You are great, and I love watching your videos.

@enigmatic_e 6 ай бұрын

🙏🏽🙏🏽

@digitalfun2072 6 ай бұрын

Wow, I am really wondering if TouchDesigner could send and receive the real-time image to ComfyUI. Sounds like a AI camera interactive installation project

@dbusmire 6 ай бұрын

Lmao same!

@Vsmphoto 4 ай бұрын

@@digitalfun2072 I was just looking into this. Were you able to make any progress getting it to output to touch?

@louward7823 Ай бұрын

@@digitalfun2072 DId you ever try this out? or get a better frame rate than the above example?

@rodneyjweltham150 2 ай бұрын

That is fascinating. I noticed that the processing is really slow. I would imagine you need a quantum computer to make that thing run smoothly, nevertheless it's interesting to see what can be done

@KolTregaskes 6 ай бұрын

Very cool. Have you also seen Krea? Someone has hooked that up to a webcam too and is basically the same thing, without ComfyUI.

@enigmatic_e 6 ай бұрын

No I haven’t. I want to check that out.

6 ай бұрын

Great video, thanks !!

@pavpav8627 6 ай бұрын

Was just thinking about how to set something like this up and boom - here it is !

@enigmatic_e 6 ай бұрын

It was bound to happen

@TheAgeofAI_film 6 ай бұрын

Thanks for sharing, I have subscribed, this is very interesting, I love to try this in our short films...

@ParvathyKapoor 6 ай бұрын

Wonderful! Thanks for the tut

@enigmatic_e 6 ай бұрын

Thank you!

6 ай бұрын

Nice :) Though this still needs to become much faster so we can say it's real-time. Maybe this would be a great candidate for the TensorRT compatible SDXL to show it's muscles. Nevertheless, it's awesome we have so much toys to play with.

@mohammedrashid1910 6 ай бұрын

damn this so cool. ai is now getting close to allowing content creators to just turn a camera on and make a cartoon in realtime. cant wait

@Duckers_McQuack 6 ай бұрын

Though, one node we do need, is one that can create a virtual webcam being those generated frames :D

@gabrielmoro3d 6 ай бұрын

It’s absolutely insane how fast this is 😮

@enigmatic_e 6 ай бұрын

I know right! It’s going to be crazy when this could run without any lag or frame skipping.

@normalplayer163 4 ай бұрын

Great Video! Easy to understand! but I got stuck on the step where I have to run bat. I tried several time and that webcam app didnt show up. HELP PLEASE!!!

@Vsmphoto 4 ай бұрын

Is there a way to output your preview to another screen or to syphon?

@user-zk4cm5md8h 4 ай бұрын

you can batch those generated single images photos into animatediff node or animate diff combine and create a gif or a video. Nice tutorial thank you :)

@HiddenInformation10 2 ай бұрын

It works, but I have a question, could those photos somehow be made as a camera, for example for obs?

@JeremyBotz 6 ай бұрын

I can't get past the computer vision init. It keeps saying cv2 module not found, i've confirmed openCV was installed. Need help

@Dante02d12 5 ай бұрын

The little app is confusing. It seemed to work at first, then stopped working. It created a new render image by itself first ,then I reinstalled it and it doesn't seem to do it anymore. I just don't understand how to use that thing. Any advice? It's super interesting for so many things!

@InkaHacker 6 ай бұрын

Do you recommend using this on Linux or Windows? Would it be too much resource intensive for a RTX3060 while streaming?

@enigmatic_e 6 ай бұрын

I don’t think this is ideal for streaming, at least not now.

@TR-707 6 ай бұрын

thanks for your video! Was looking for a solution for this. My plan is to just pipe a virtual cam/ desktop capture into comfy and this is a simple solution

@enigmatic_e 6 ай бұрын

Awesome!

@user-mt3me3th7m 6 ай бұрын

i DON'T HAVE THE "LOADwEBcAM" NODE

@wuetsby5448 5 ай бұрын

this is cool

@CineFlavor 5 ай бұрын

My LoadWebcamNode doesnt give me an option to load the image path. It just is blank and red. When I first drag the image of the node layout on for the preset it tells me there is no webcam. So all I have is a blank node with a title. What is this type of node called? Can I add it manually?

@enigmatic_e 5 ай бұрын

Have you updated everything already?

@enigmatic_e 5 ай бұрын

If you are on webcam 0 try webcam 1 or webcam 2.

@CineFlavor 5 ай бұрын

There is no option to choose webcam 0 or 1. Its just a blank node. Everything should be updated since i just installed it last week. My webcam is plugged in via USB so i'm not sure if that changes anything. it's the Elgato Facecam@@enigmatic_e

@CineFlavor 3 ай бұрын

The issue turned out to be that I needed to install the missing nodes using ComfyUI Manager@@enigmatic_e

@user-ui2hw5of9l 6 ай бұрын

thanks~! Is it possible to use the capture cam if I run my ComfyUI on Runpod?

@enigmatic_e 6 ай бұрын

Sorry not sure. I never ran it with Runpod.

@AscendantStoic 6 ай бұрын

We are very close to having older games being remastered through rendering in real time using AI, it will be glorious 😊

@enigmatic_e 6 ай бұрын

That’s going to be crazy!!

@genAIration 6 ай бұрын

Sir how do you show up your embeddings? I mean like a pop-up one. I don't know this node

@enigmatic_e 6 ай бұрын

When I start typing embedding in the negative prompt, it automatically shows me embeddings I have available and I just select what I want.

@genAIration 6 ай бұрын

@@enigmatic_e oo I see. I use a lot comfy but always use sdxl models but i don't have any sdxl embbebings then thats cz its don't show up to me . Thx so much sir 🙏🏿

@shopbc5553 5 ай бұрын

I would want to output HD 30-60 p or even 4K 30; is it possible, and how big of a computer would I need to make?

@enigmatic_e 5 ай бұрын

I have a 4090 and I dont think I could do that with this gpu so not really sure.

@aimademerich 6 ай бұрын

🔥 🔥 🔥

@enigmatic_e 6 ай бұрын

🙏🏽🙏🏽🙏🏽

@nickdivito4662 5 ай бұрын

Can you combine something like these new LCM models into Vid2Vid work flows to get faster render times?

@enigmatic_e 5 ай бұрын

Yes you could!

@louward7823 Ай бұрын

Did you try this out? or had any luck with better frame rates?

@koosiuhang5257 5 ай бұрын

where can i get the ModelSamplingDiscrete node , i tried the install the missing node , but not working , 🙏

@enigmatic_e 5 ай бұрын

that should be a native comfy node. Have you tried updating to the latest version of comfy?

@koosiuhang5257 5 ай бұрын

ya , i did manuel update though download the comfy ui zip file and copy and paste the extra node folder and work ! @@enigmatic_e

@jbiziou 6 ай бұрын

very cool,:) I got stuck at ,, ( Load WebCam Image Node was RED warning) I then ran the run.bat in the CaptureCam folder, and restarted but nothing worked. Launched OBS and started recording, and restarted Comfi, but still not working. Any Idea please ? thanks :)

@enigmatic_e 6 ай бұрын

Not sure what it could be. I would go on X and message the developer, he said to reach out to him if you run into problems. I put his link in the description

@jbiziou 6 ай бұрын

@@enigmatic_e Thanks:) will give that a try.

@jbiziou 6 ай бұрын

Ahhh think I got it. In the manager I loaded custom node for Webcam, and boom, the node is no longer red :) got the preview image in the webcam,, but its squashed, haha,, Progress though:) 1 step at a time

@jbiziou 6 ай бұрын

Last thing was ,, Had to rename the LCM lora to ( pytorch ), from LCM.

@JustMaier 6 ай бұрын

“This is if you wanna catfish somebody at some point” 😂

@enigmatic_e 6 ай бұрын

😂 you know its gonna happen

@koningsbruggen 6 ай бұрын

Can I use a screencast as the output?

@enigmatic_e 6 ай бұрын

Haven’t tried it, might be possible.

@hiddenintheshadows530 6 ай бұрын

screen cast? It has Region Capture, you can capture your screen and feed it into ComfyUI. Once again @enigmatic doing only part of the full tutorial

@enigmatic_e 6 ай бұрын

@@hiddenintheshadows530 my bad I’ll try to do better. I’m still in the learning process. 🙏🏽

@frankyaKaBIGMAC2 6 ай бұрын

u sir r a fcking gangster og

@enigmatic_e 6 ай бұрын

🤣 thanks!!

@Iamdevvvv 6 ай бұрын

We are now more closer to see whole world through ai😅

@enigmatic_e 6 ай бұрын

I wonder what AI will look like a year from now.

@chaptermah2847 5 ай бұрын

Can i convert video to ai video

@enigmatic_e 5 ай бұрын

Yes by putting a save node to save each frame

@USBEN. 6 ай бұрын

Damn bruh real time deep fakes, oooo baby!!

@enigmatic_e 6 ай бұрын

🤣

@KennethEstanislao 6 ай бұрын

What’s your gpu?

@enigmatic_e 6 ай бұрын

It’s in description. It’s a 4090

@KennethEstanislao 6 ай бұрын

@@enigmatic_e nice! sorry I didn't saw it as some youtubers usually didn't put it anywhere! thanks for the reply!

@enigmatic_e 6 ай бұрын

@@KennethEstanislao all good. I recently just started doing it because many ask about. 👍🏽

@liquidmind 4 ай бұрын

webpage is gone?

@liquidmind 4 ай бұрын

This site can’t be reached

@enigmatic_e 4 ай бұрын

@@liquidmind not sure, things in the AI world changes so much it’s hard to keep track of it all unfortunately.

@TheHologr4m 4 ай бұрын

so my little i7 laptop with GTX1060 3gb probably stands no chance at behaving anywhere close to your monstor of a machine.

@Parzival047 6 ай бұрын

.....so many things missing :(

@enigmatic_e 6 ай бұрын

What is missing? I can try to include it in the description.

@Parzival047 6 ай бұрын

@@enigmatic_e bro I went on to install comfy UI, then I downloaded that aniverse, but how to add this aniverse into comfy UI? I try loading it but it just doesn't loads. At this point, I am just installing every model which is there 😭

@Parzival047 6 ай бұрын

If I follow your path to install this... Then. 1. Install comfy UI 2. ? 3. ? Then what should I do next such that it WORKS 😢

@enigmatic_e 6 ай бұрын

You save that model in your checkpoint folder. Are you new to comfyui? I have a tutorial on how to get started kzfaq.info/get/bejne/ja6ofNWKl92wgXk.html@@Parzival047

@Parzival047 6 ай бұрын

@@enigmatic_e yes bro new to comfy UI ❤️