STABLE VIDEO DIFFUSION

STABLE VIDEO DIFFUSION | COMFYUI

Рет қаралды 38,171

6 ай бұрын

Get 4 FREE MONTHS of NordVPN: nordvpn.com/enigmatic
Topaz Labs BLACK FRIDAY DEAL: topazlabs.com/ref/2377/
Stable Video Diffusion is finally compatible with ComfyUI
HOW TO SUPPORT MY CHANNEL
-Support me by joining my Patreon: / enigmatic_e
_________________________________________________________________________
SOCIAL MEDIA
-Join my discord: / discord
-Twitch: / 8bit_e
-Instagram: / enigmatic_e
-Tik Tok: / enigmatic_e
-Twitter: / 8bit_e
- Business Contact: esolomedia@gmail.com
________________________________________________________________________
My PC Specs
GPU: RTX 4090
CPU: 13th Gen Intel(R) Core(TM) i9-13900KF
MEMORY: CORSAIR VENGEANCE 64 GB
Stable Video Diffusion Models:
comfyanonymous.github.io/Comf...
Workflow:
mega.nz/file/aQAzkA4L#n43K8o6...
Water Lora by joachim:
civitai.com/models/210754/aet...

Пікірлер: 121

@enigmatic_e 6 ай бұрын

If you’re new to ComfyUI watch my beginners tutorial here kzfaq.info/get/bejne/ja6ofNWKl92wgXk.htmlsi=HV61VB9nt4wxn18L

@AIPixelFusion 6 ай бұрын

this thanksgiving I'm grateful for enigmatic_e's tutorials! 🙌🙌 shouts outs to Kijai as well!

@enigmatic_e 6 ай бұрын

🎉

@daroniousmaximus 6 ай бұрын

Thanks. Just starting to fiddle around with this.

@quietlyworking 6 ай бұрын

👏MASSIVE thanks. Soooooooo glad I found your channel! You've got a new sub.👊

@enigmatic_e 6 ай бұрын

Yooo! Thank you!! 🙏🏽 🙏🏽

@mohammedrashid1910 6 ай бұрын

super cool. cant wait to see what this does in a month. longer videos would be amazing.

@enigmatic_e 6 ай бұрын

Exciting times!

@MarylandDevin 6 ай бұрын

I didn't know this was a thing. Thank you!

@kurozeitsuki7846 4 ай бұрын

I have a problem finding where and how to install the RIFE VFI node. Could you tell us where we can find it? Otherwise thanks for the video!

@SBaldo8 6 ай бұрын

Omg the advancements in video/animation are crazy lately 🤯. I think i still like having control on the animation with motion loras more but hey this setup is so easy. I can also imagine it being used in conjunction with other methods

@enigmatic_e 6 ай бұрын

Its insane how fast we're moving with this! I can't wait till we get even more control.

@falconbmstutorials6496 6 ай бұрын

Strangely it always never works, because of conflicts, not able to install the missing nodes, not able to install missing libraries, etc

@enigmatic_e 6 ай бұрын

Do you know which nodes are missing?

@pretzelbat.m 6 ай бұрын

Great video as always! Keep it up!

@enigmatic_e 6 ай бұрын

Thanks 🙏🏽

@paulverge5536 6 ай бұрын

Wow, this is a game changer my brother! Is there a frame cap similar to AnimateDiff? Thank you so much for putting this awesome tutorial out there!

@enigmatic_e 6 ай бұрын

You can add frames but I think it gets destroyed after some time

@pogiman 6 ай бұрын

this is beautiful

@chanchanchan1137 5 ай бұрын

I am getting a lot of help from your video. I have one question. Among rife VFI ckpts, which repo contains files such as rife40.pth, ....., sudo_rife4_269.662_testV1_scale1.pth? No matter how much I searched, I couldn't find it. I'm looking forward to your smart answer to my stupid question.

@JaimeAndresMedia 6 ай бұрын

It’s insane how much progress ai art has made in the last 6 months alone…

@laemon300 3 ай бұрын

facts

@tonyambito8028 6 ай бұрын

wow looks great man.thx

@enigmatic_e 6 ай бұрын

No problem!

@ancientpsychictandemwarele5197 6 ай бұрын

i get this error in in the rife node "Prompt outputs failed validation RIFE VFI: - Value not in list: ckpt_name: 'sudo_rife4_269.662_testV1_scale1.pth' not in ['rife40.pth', 'rife41.pth', 'rife42.pth', 'rife43.pth', 'rife44.pth', 'rife45.pth', 'rife46.pth', 'rife47.pth', 'rife48.pth', 'rife49.pth']"

@vlada9740 5 ай бұрын

click on refresh and pick again model

@ItsSherryTee 5 ай бұрын

@@vlada9740 Please elaborate. Same error. No missing custom nodes. Refreshed. Model picked again and server restarted. Thanks.

@haki_1337 5 ай бұрын

Always getting: Error occurred when executing KSampler: Conv3D is not supported on MPS on M2 :/

@JimboSkinner 6 ай бұрын

So great that you set this up. Thank you so much! It’s working great, but I do see this error after the job is run “exception in callback Proactor BasePipeTransport.callconnection lost” at asyncio\events.py line 80 in run… and then “an existing connection was forcibly closed by the remote host”… I think there are processes hanging around after the run than need to be cleaned up

@amkkart 3 ай бұрын

I followed your steps to install comfy but whenever I want to let it run.. it says request to download models and I have to wait for a while.. how can I solve that ?

@aguyandhisguitars435 5 ай бұрын

need some help, im getting Error occurred when executing KSampler: input must be 4-dimensional, when trying to do the stable difusion animate in comfy ui, i have an AMD 7900XT.

@kpr2 5 ай бұрын

Interesting. Curious to see if you can combine this with text prompt conditioning to guide the video output. I'll certainly be doing some mad science experiments. Thanks!

@HanSolocambo 4 ай бұрын

Remove the if. Of course we can do that already, we always could. Prompts influencing the generation of pixels is the whole purpose of Stable Diffusion...

@kpr2 4 ай бұрын

Thanks, haha! Yeah, I've gotten there. Love the freedom & flexibility ComfyUI offers.

@blockchaindomain2226 6 ай бұрын

Im getting Boring animations! It always happens to me when I use animatediff with comfy or automatic...but... I LOVE CLI with animate diff! Ill keep at this and tweaking my settings! THANK YOU FOR YOUR HELP!!!

@OLEH.IBRAHIMOV 6 ай бұрын

thanks for sharing, man! 😘

@enigmatic_e 6 ай бұрын

🙏🏽🙏🏽🙏🏽

@fleabillydesign 6 ай бұрын

thanks for the workflow! can you tell me where the YHS module sends your exports? cant figure it out.

@enigmatic_e 5 ай бұрын

it send here: ComfyUI_windows_portable\ComfyUI\output

@Gabriecielo 6 ай бұрын

It seems not working on mac, I have ComfyUI & all custom nodes installed, but still got tons of error when calculation reaches KSampler

@digital_magic 6 ай бұрын

sweet, thanx for sharing :-) Cool stuff!!!

@legend-x-amvs7985 6 ай бұрын

Is it possible to add controlnets like openpose then have this animate an image using the controlnet information?

@enigmatic_e 6 ай бұрын

Not at the moment, at least not anything that looks good.

@sadshed4585 6 ай бұрын

When I import your workflow I get When loading the graph, the following node types were not found: RIFE VFI Seed (rgthree) Nodes that have failed to load will show as red on the graph. the seed and RIFE VFI panels are errored out any advice?

@sadshed4585 6 ай бұрын

nevermind fix for this is installing missing nodes^

@enigmatic_e 6 ай бұрын

Glad you found a solution!

@tanyasubaBg 6 ай бұрын

Thank you. Your videos are really great and helpful. But is it possible to do something similar if we have an AMD card?

@enigmatic_e 6 ай бұрын

Hello!, unfortunately I don't know. I don't own an AMD card to test this. Technically you could run ComfyUI through CPU but its very slow.

@tanyasubaBg 6 ай бұрын

@@enigmatic_e thank you. It always scared me. That's why I haven't tried it yet; I just watch videos about it.

@cgdtb 3 ай бұрын

Thanks

@MaybePlato 6 ай бұрын

Is it able to work with any image or does it need to be a stable diffusion generated image?

@enigmatic_e 6 ай бұрын

No, it could be any image but I’ve noticed that some images work better than others.

6 ай бұрын

Really cool, Thanks

@JamesELarkin 5 ай бұрын

how do you get smoother natural skin?

@PumaFronAfk 5 ай бұрын

you can conneect the output from VAE decoder to SVD, and make promp to video

@enigmatic_e 5 ай бұрын

Have you gotten good results?

@wesallenmedia 7 күн бұрын

What is the specific file to download from the huggingface site?

@Hardts 6 ай бұрын

Where is it saved though? Just cannot find the file! Can confirm it works on GTX1080 with 8GB Vram. But, it takes a while. I've succesfully generated 25frames of 1024x768 video.

@enigmatic_e 6 ай бұрын

Where is what saved? The video?

@user-fk9hl6wr7e 5 ай бұрын

I'm getting the following errors and don't know where to start Prompt outputs failed validation ImageOnlyCheckpointLoader: - Value not in list: ckpt_name: 'svd_xt_image_decoder.safetensors' not in ['shendan v2.safetensors', 'svd.safetensors', 'svd_xt.safetensors', 'v1-5-pruned-emaonly.safetensors'] RIFE VFI: - Value not in list: ckpt_name: 'sudo_rife4_269.662_testV1_scale1.pth' not in ['rife40.pth', 'rife41.pth', 'rife42.pth', 'rife43.pth', 'rife44.pth', 'rife45.pth', 'rife46.pth', 'rife47.pth', 'rife48.pth', 'rife49.pth']

@tdfilmstudio 6 ай бұрын

Great tutorial as always! Can we increase the output video duration?

@enigmatic_e 6 ай бұрын

You can but it starts to degrade over time.

@tdfilmstudio 6 ай бұрын

@@enigmatic_e Yes I have realized that. Hopefully there will be a workaround like there was for Animatediff with prompt travel + IP Adapter. Do keep us updated

@enigmatic_e 6 ай бұрын

@@tdfilmstudioyea I’m sure we will get new tools soon! Can’t wait!!

@mzrendy8120 6 ай бұрын

so sick

@HyperGalaxyEntertainment 4 ай бұрын

is it possible for batch process?

@rezahasny9036 2 ай бұрын

the best maan

@charlesagnew3801 4 ай бұрын

Where do I install the sudo_rife4_269.662_testV1_scale1.pth in ComfyUI ??

@believablybad 3 ай бұрын

Bumping this - running into the same issue @enigmatic_e

@CyberPhonkMusic 3 ай бұрын

Is there a way to extend a video after it has been created?

@enigmatic_e 3 ай бұрын

Do you mean like add frames to allow slow motion?

@CyberPhonkMusic 3 ай бұрын

@@enigmatic_e good ideia

@aimademerich 6 ай бұрын

🔥 🔥 🔥

@amkkart 6 ай бұрын

How many frames can i generate i mean can i create a video of 2 to 4 minutes long ?

@enigmatic_e 6 ай бұрын

Not really. I think some people find word arounds like getting the last frame of a 25 frame video and rerun it and at then edit them together.

@fiogurru 2 ай бұрын

hi, how can i install automatic1111 on confyUI

@2PeteShakur 6 ай бұрын

cheers mate, hitting that ai spot once again! ;)

@enigmatic_e 6 ай бұрын

😎👍🏽

@NotThatOlivia 6 ай бұрын

nice 😍

@InTheCity3D 6 ай бұрын

On an 4090, how long for each video?

@enigmatic_e 6 ай бұрын

It takes about 1 minute or so for a 24 frame video.

@XzirosetCypherFr 6 ай бұрын

Where does we have to put the svd files ?

@enigmatic_e 6 ай бұрын

In your checkpoint folder

@RiiahTV 6 ай бұрын

Error occurred when executing SVD_img2vid_Conditioning: 'NoneType' object has no attribute 'encode_image' File "C:\comf 2\ComfyUI_windows_portable\ComfyUI\execution.py", line 153, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) File "C:\comf 2\ComfyUI_windows_portable\ComfyUI\execution.py", line 83, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) File "C:\comf 2\ComfyUI_windows_portable\ComfyUI\execution.py", line 76, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) File "C:\comf 2\ComfyUI_windows_portable\ComfyUI\comfy_extras odes_video_model.py", line 45, in encode output = clip_vision.encode_image(init_image)

@RiiahTV 6 ай бұрын

wont let me generate. i updated and restarted and downloaded models and put them into the checkpoints folder in the models folder

@RiiahTV 6 ай бұрын

do you think you can help me out further

@Paracast 6 ай бұрын

running the run_gpu_updates.bat fixed everything for me, i was having same issue, idk if its same for you

@seriks82 6 ай бұрын

@@Paracast where is this found?

@RiiahTV 6 ай бұрын

what foilder is that in? @@Paracast

@DavidSeguraIA 6 ай бұрын

What is the minimum requirement of VRAM?

@enigmatic_e 6 ай бұрын

I’ve heard some say 10-12 vram works but I haven’t tested that.

@Repossessionn 6 ай бұрын

At least with using my 3060 12gb it runs around 8gb vram

@Zippo08 6 ай бұрын

i loaded everything clicked update all, but i dont get the new video nodes :(

@enigmatic_e 6 ай бұрын

Did you restart everything?

@Zippo08 6 ай бұрын

@@enigmatic_e yes, restarted everything

@enigmatic_e 6 ай бұрын

@@Zippo08 then I would just check to see if downloading missing nodes through manager works.

@Paracast 6 ай бұрын

running the run_gpu_updates.bat fixed everything for me, i was having same issue, idk if its same for you@@Zippo08

@Zippo08 6 ай бұрын

@@enigmatic_e hmm its says all updated ;( but thank you anyway

@konraddobson 6 ай бұрын

Can't get it to work. Keep getting errors :(

@enigmatic_e 6 ай бұрын

At what point does the process stop? Which nodes has a red outline?

@Hardts 6 ай бұрын

My GTX 1080 does not like this. Very, very cool though! Maybe when Nvidia GPU's do not cost the same as a half decent used car, I can get in on it too. I actually just built a new pc days ago, but there wasn't enough money for a new GPU..

@enigmatic_e 6 ай бұрын

Did you try it with both models?

@Hardts 6 ай бұрын

I've only tried the XT one (25fps). It does actually work, it's just slow :) Using an external model, "BB95" and getting some slightly weird results, but it's not like AnimateDiff that just generated noise.. This actually works! Can't find the saved clips though.. Thanks! @@enigmatic_e

@epelfeld 2 ай бұрын

Can't get why but my video is oversaturated every time...

@fahdherati 6 ай бұрын

how VHS ?

@fahdherati 6 ай бұрын

Ask me for VHS_VideoCombine ? I could not find it in the manager

@enigmatic_e 6 ай бұрын

Sometimes I lose track of where I get the nodes from, either manager or just google it and and install it into the custom node folder.

@kacecarol 6 ай бұрын

excelent, now it's time to throw L2d into trashcan

@thatstorygamer2711 3 ай бұрын

Bro you need to go into better detail about how to install the required nodes. I literally just installed the basic ComfyUI, not everyone has the same nodes as you do.

@enigmatic_e 3 ай бұрын

Sorry about that. Are you new to comfyui? If so I just pinned a comment with a link to my beginners tutorial. You need to install manager and there’s an option to install missing nodes automatically.

@TPCDAZ 6 ай бұрын

Comfy Ui? nope. I'll wait for Auto 1111

@enigmatic_e 6 ай бұрын

Comfy is not so bad 😂

@TPCDAZ 6 ай бұрын

@@enigmatic_e I just dont enjoy having to create a whole workflow for something auto 1111 does with a single switch, it's slower than auto1111 in most cases too.