Bring Images to LIFE with Stable Video Diffusion

Bring Images to LIFE with Stable Video Diffusion | A.I Video Tutorial

Рет қаралды 68,550

Күн бұрын

Stable Video Diffusion is a powerful AI tool that turns images into short videos. This tutorial will teach you how to easily create videos from your pictures and text prompts using SVD.
ThinkDiffusion: bit.ly/3PoCkoN
How to Install ComfyUI: • Generate AI Videos Wit...
ComfyUI: bit.ly/3LM1hbN
ComfyUI manager: bit.ly/3LRqYrg
SDV img2video model: bit.ly/3Rkl18h
Base Workflows: bit.ly/3RkO6Aj
My Custom wokflows: bit.ly/3TkQ5Y0
SDXL model: bit.ly/3v1hIeA
Topaz Video AI: bit.ly/3t04Otl
Disclaimer: Some links in the description are affiliate links. If you make a purchase through them, I may earn a small commission at no extra cost to you.
⏲ Chapters:
0:00 Stability.ai's video model
0:16 How to Run Stable Video Locally
0:16 How to Run Stable Video Online
1:48 Why use ThinkDiffusion?
2:49 Image to Video
6:25 Upscaling AI Video
7:00 Text to Image
7:54 AnimateDiff Tutorial
Support me on Patreon:
bit.ly/2MW56A1
🎵 Where I get my Music:
bit.ly/3boTeyv
🎤 My Microphone:
amzn.to/3kuHeki
🔈 Join my Discord server:
bit.ly/3qixniz
Join me!
Instagram: / justmdmz
Tiktok: / justmdmz
Twitter: / justmdmz
Facebook: / medmehrez.bss
Website: medmehrez.com/
#AIvideo #stablediffusion #ThinkDiffusion
Who am I?
-----------------------------------------
My name is Mohamed Mehrez and I create videos around visual effects and filmmaking techniques. I currently focus on making tutorials in the areas of digital art, visual effects, and incorporating AI in creative projects.

Пікірлер: 125

@MDMZ 7 ай бұрын

The future of video seems WILD 🚀 ThinkDiffusion: bit.ly/3PoCkoN - if you can't see the manager after installing, make sure you have the latest version of GIT and re-install, if it persists, retry the installation methods here: civitai.com/models/71980/comfyui-manager

@DJTide 5 ай бұрын

ty for the workflow! it really saves me alot of hassle having to use other websites just to animate my images!

@asialsky 4 ай бұрын

If you want longer videos, just save the final frame and run it again as the new source image. It may take a few attempts to get camera motion that doesn't make you sick, but it'll get the job done.

@MDMZ 4 ай бұрын

great idea, but there might be a visible cut, did you try it ?

@VinylSolutions 2 ай бұрын

@@MDMZdepending on the output it may or may not work from outputs we've seen on various image to video/gif creations.

@AbdulKhamis 5 ай бұрын

very useful! Thank you!

@MedAmineTN 7 ай бұрын

The best person to explain the montage method in A.I

@MDMZ 7 ай бұрын

Thank you bro

@lightndreamsmachine 6 ай бұрын

love this video

@sameeramin822 6 ай бұрын

Awesome bro 😎 big fan ❤

@Thomas_Leo 6 ай бұрын

Very concise tutorials. All your tutorials always help me. 👍👍

@MDMZ 5 ай бұрын

glad to hear

@timoi7777 7 ай бұрын

Bro you are the best tutorial person I've found. Thanks

@MDMZ 6 ай бұрын

glad I could help

@holly11111111 3 ай бұрын

THE BEST TUTORIAL!!! THANKS THANKS GRACIIIIIAAAAAAAAS 😍😍😍

@MDMZ 3 ай бұрын

Glad it was helpful!

@jvtosiartist 7 ай бұрын

Thanks again!!! Great tutorial

@MDMZ 7 ай бұрын

Glad you liked it!

@jvtosiartist 7 ай бұрын

@@MDMZ Thanks to your help, I just tried Think Diffusion, it is very good, it is very fast and easy to use. This is what I did: kzfaq.infoGy-HeW3Stj8?si=sc1i8Z6qiuACuC9V

@ZakariaNada 7 ай бұрын

Your tutorials are much easier to follow than most KZfaqrs. Keep it up! But if you have time, you still need to do the controlnet animatediff or any video generation method using controlnet.

@MDMZ 7 ай бұрын

Noted! and thanks a lot

@apdirectedit 7 ай бұрын

BIG BIG BIG FACTS!!! FULL SUPPORT INSTANT SUB'D!

@Morri91 7 ай бұрын

What ever the others are. You re allways next level and complete describer. Thank you brother❤

@MDMZ 7 ай бұрын

this means a LOT 🙏

@Saidgarciac Ай бұрын

Could you help me with the installation process of img2vid for Comfyui to run it from stability matrix?

@andresfc435 2 ай бұрын

incredible, really helfull ❤❤

@MDMZ 2 ай бұрын

Glad it helped!

@illuminat_empire 2 ай бұрын

Really good content 👍

@MDMZ 2 ай бұрын

Thank you 🙌

@shireensingh2834 10 сағат бұрын

a question- do we really have to use this complex method (comfy UI) like you have done for other things as well. or is there any other less complex way to do it? THANKS

@matt_fpv 7 ай бұрын

Great tutorial, thank you! Do you know a way to upscale the video directly in comfyUI? Not everyone has Topaz Video AI, its quite expensive...

@MDMZ 7 ай бұрын

there are ways to do it with custom nodes, I covered one example here: kzfaq.info/get/bejne/odOKaLZjvZuZlok.htmlsi=ehay3olnLfJckLUN&t=547

@nachoquiroga307 6 ай бұрын

con una laptop se puede hacer? tengo un i5 de 10ma generacion y una rtx 3060

@reviewflicks Ай бұрын

I am looking for the video combine node, cant seem to see it anywhere. Need it to change output file type, any help? cheers!

@MDMZ 26 күн бұрын

I believe it's been changed to another node, you can use my custom workflows from the description, those still have it

@JefHarrisnation 6 ай бұрын

Great and easy tutorial, and thanks for the workflow template. Though I'm not able to find the Video Combine node.

@MDMZ 5 ай бұрын

did yo utry installing it from the ComfyUI manager ?

@ruggio.o 7 ай бұрын

I'm currently using stable diffusion video on Mac m2 pro and I have the same problem with the ksampler... in particular this one: "Conv3D is not supported on MPS". Do somebody know how to deal with it and fix the problem? It would be very nice if someone can help me 🙏🏻

@MDMZ 7 ай бұрын

running on MAC can be tricky sometimes, looks like a PyTorch issue, you might be able to get some help here: github.com/cocktailpeanut/mac-svd-install Please let me know if that worked If it persists, I would definitely try an online solution instead

@hosseinahmadi1855 5 ай бұрын

is it possible to control the result of the video by giving some prompts? And another question. Is there a model to produce transition between two images/frames (I have frame images, but I want to turn them into a video and frames are not very close to each other so it cannot be used in conventional video editing software)?

@MDMZ 5 ай бұрын

I guess you can add prompt nodes to have more control, but I'm yet to try it myself, you can try using RunwayMl instead. I don't have an answer for the second question, sorry :/

@deepinworld1 7 ай бұрын

Hey I don't have pc Can you do this on mobile especially in moon valley ai

@MDMZ 7 ай бұрын

I've actually covered this topic in the video

@romeoottaviani5325 6 ай бұрын

hello, great guide. Congratulations. But I have a question, if for now the maximum limit is 5 seconds, how do some people animate the models that run on instagram? Just faceswap?

@MDMZ 6 ай бұрын

I think you are referring to video2video, I just posted a video on that, this is img2video

@romeoottaviani5325 6 ай бұрын

@@MDMZ tks

@prabuddhagupta519 7 ай бұрын

I installed the comfy ui manager, but the option isn't visible there. i updated the comfy ui but still the manager option is not showing. can you tell me what to do?

@MDMZ 7 ай бұрын

make sure you have the latest version of GIT and re-install, if it persists, retry the installation methods here: civitai.com/models/71980/comfyui-manager

@ertezsssz 7 ай бұрын

is there a way to add a Clip Text Encode module between the SVD_img2vid_Conditioning and the KSampler to add positive and negative prompt to have more control with the camera movement ?

@MDMZ 7 ай бұрын

interesting, not sure about that, but will look into it

@ertezsssz 7 ай бұрын

@@MDMZ thank you very much, i think it could be an even greater tool to be able to influence the animation with prompts, not sure if its possible or not or even if the curent models are able to do that

@MDMZ 7 ай бұрын

@@ertezsssz I remember seeing motion models that allow that, but you can also try including movement description in the prompts, it usually helps

@ertezsssz 7 ай бұрын

I searched on civitai without finding one

@spacemultimedia2979 6 ай бұрын

Can you do this on the normal Stable diffusion? With the normal UI, I hate this type of UI with tons of modules everywhere. If I installed comfy UI locally, would it be a separate ui from the normal Stable diffusion? It wouldn't launch the same for sure. Would that mess up my current SD local install?

@MDMZ 5 ай бұрын

this won't interfere with your local A1111 installation, I highly recommend you give it a shot, it looks complicated but it's much more flexible and gets easier with time

@simonhick9124 6 ай бұрын

The video Combine does not upload the video, it has an output that says filenames, i dont know what node I should use to see the video

@MDMZ 5 ай бұрын

you mean the video is not being saved to your output folder ?

@tendest1 4 ай бұрын

Hi dude, is there any method to increase the length of the generated video?

@MDMZ 4 ай бұрын

not that I know of :/

@SefaKaratekin 7 ай бұрын

I get this error. Does anyone have any idea about how to fix it? Prompt outputs failed validation: Exception when validating node: VideoCombine.VALIDATE_INPUTS() got an unexpected keyword argument 'frame_rate' VHS_VideoCombine: - Exception when validating node: VideoCombine.VALIDATE_INPUTS() got an unexpected keyword argument 'frame_rate'

@luqaszoq 7 ай бұрын

I had the same problem and fixed it by Update All in Manager.

@SefaKaratekin 7 ай бұрын

@@luqaszoq It worked for me, thanks a lot for your help, mate!

@muhammadsyafiq1004 6 ай бұрын

is it possible to run this with laptop? Seems load heavy.

@MDMZ 6 ай бұрын

It will depend on the specs, you can definitely give it a shot

@TheBeastiaryPetshop 6 ай бұрын

followed all the steps but i get Prompt outputs failed validation ImageOnlyCheckpointLoader: - Value not in list: ckpt_name: 'svd.safetensors' not in (list of length 21) any help?

@MDMZ 6 ай бұрын

have you downloaded the svd model? make sure it's in the right folder

@Thomas_Leo 6 ай бұрын

You have to actually select the downloaded checkpoint from the list. The default name doesn't match the one you downloaded.

@user-wb1ud9nr8f 6 ай бұрын

can I make loop animated pictures, or what called cinemagraph with AI?

@MDMZ 5 ай бұрын

I don't think there are ways to make it look so seamless using these tools, unless there's a method I don't know of.

@user-wb1ud9nr8f 5 ай бұрын

@@MDMZ Thank you.

@kakashi99908 6 ай бұрын

Can you do this with stable diffusion too?

@MDMZ 6 ай бұрын

this IS stable diffusion

@kaleabspica8437 4 ай бұрын

cant find the manager option

@MDMZ 4 ай бұрын

check the pinned comment

@sinc356 2 ай бұрын

When I queue prompt, my problem is Cuda out of memory how to fix that?

@MDMZ 2 ай бұрын

it means your VRAM is a little low for it, did you try setting a lower resolution ? and maybe a smaller steps number

@sinc356 2 ай бұрын

@@MDMZ how to set lower resolution?

@ruthskiba-otway-peelvirtua9678 5 ай бұрын

Can this be done in Automatic1111?

@MDMZ 5 ай бұрын

I believe so

@alberto64674yt 7 ай бұрын

i hate comfy ui any method to use that on automatic1111 ui?

@MDMZ 7 ай бұрын

why!?

@alberto64674yt 7 ай бұрын

@@MDMZ is harder to me understand that module mess better the automatic1111 its just tabs and options

@alberto64674yt 7 ай бұрын

node*

@ThaMoonwalkerFSDBetaChannel 5 ай бұрын

is this only for PC?

@MDMZ 5 ай бұрын

you might be able to make it run on MAC, dome people did

@socialsculptmedia-vs8jm 5 ай бұрын

Doesn't work 'NoneType' object has no attribute 'encode_image' "How to solve this?

@MDMZ 5 ай бұрын

which node is showing in red when yo uexecute?

@rohithkumarsp 3 ай бұрын

how to do this locally

@MDMZ 3 ай бұрын

it's covered in the video

@lilillllii246 4 ай бұрын

is it possible text prompt?

@MDMZ 4 ай бұрын

yes, I've covered it in the video

@leylauk 2 ай бұрын

Gen 2 is easier?

@MDMZ 2 ай бұрын

it definitely is, but to me SVD gives better results

@Paranormal-yg4ph Ай бұрын

great vid. It's a shame it ruins people's eyes when using people :(

@MDMZ Ай бұрын

that's true, I noticed it happens sometimes

@Samuirobotics 5 ай бұрын

I have a problem like this% ERROR:root:!!! Exception during processing !!! ERROR:root:Traceback (most recent call last): and here goes long list with the cherry on top - RuntimeError: MPS backend out of memory (MPS allocated: 15.61 GB, other allocations: 2.90 GB, max allowed: 18.13 GB). Tried to allocate 562.50 MB on private pool. Use PYTORCH_MPS_HIGH_WATERMARK_RATIO=0.0 to disable upper limit for memory allocations (may cause system failure). Prompt executed in 3701.64 seconds Appreciate for any help. MacBook Pro m1 16GB

@MDMZ 5 ай бұрын

plz check the pinned comment

@jamiemunsey 2 ай бұрын

Is anyone else getting "500 - Internal Server Error" when trying to upload images? Or know how to fix that?

@MDMZ 2 ай бұрын

hi Jamie, might need more context, does this happen when u try to generate ? or literally when u browse for an image and try to upload it ? are u using ThinkDiffusion or running locally

@jamiemunsey 2 ай бұрын

@@MDMZ I get that error when trying to upload an image! Running it off Google Cloud (think that's the only way, since I have an Intel Mac?)

@MDMZ 2 ай бұрын

@@jamiemunsey I see, not sure how hosting and image loading works over there, can u try loading different images from different locations and see if any of it works? othwerwise you can check other services such as thinkdiffusion, if it's cheaper than google cloud it might make more sense to use that instead

@Draqee4 Ай бұрын

am facing this issue in local device Error occurred when executing ImageOnlyCheckpointLoader: Error while deserializing header: HeaderTooLarge File "K:\ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "K:\ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "K:\ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "K:\ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\comfy_extras odes_video_model.py", line 21, in load_checkpoint out = comfy.sd.load_checkpoint_guess_config(ckpt_path, output_vae=True, output_clip=False, output_clipvision=True, embedding_directory=folder_paths.get_folder_paths("embeddings")) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "K:\ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\comfy\sd.py", line 498, in load_checkpoint_guess_config sd = comfy.utils.load_torch_file(ckpt_path) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "K:\ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\ComfyUI\comfy\utils.py", line 15, in load_torch_file sd = safetensors.torch.load_file(ckpt, device=device.type) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "K:\ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI_windows_portable\python_embeded\Lib\site-packages\safetensors\torch.py", line 311, in load_file with safe_open(filename, framework="pt", device=device) as f: ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^

@MDMZ 26 күн бұрын

can't say for sure, but it's possible that you are downloading the wrong files, make sure you get the correct models and place them in the right folders

@Draqee4 24 күн бұрын

@@MDMZ yeah i was doing it wrong now it s working

@cucciolo182 29 күн бұрын

wow any updates?

@MDMZ 26 күн бұрын

Luma dream machine is now better than this, at least in my experience

@시니어티브 6 ай бұрын

비디오 생성기

@raymondvaldes_ 7 ай бұрын

not a TIFF file (header b'n' not valid)

@raymondvaldes_ 7 ай бұрын

please help man, i dont get this

@raymondvaldes_ 7 ай бұрын

happens with jpegs, png work fine

@DIAMIN305 5 ай бұрын

RuntimeError: input must be 4-dimensional

@MDMZ 5 ай бұрын

do you see any nodes turning red when you execute? I'm suspecting that you're loading a non-video file, or a corrupt video file

@druqsdude 3 ай бұрын

because you have an AMD card and running it with --directml thats what i found online

@RodieOsc 5 ай бұрын

Time to cook my 4090

@MDMZ 5 ай бұрын

welcome to the club

@AllSeasonsVideo 7 ай бұрын

Think diffusion is a rip off of a much larger and much better service. Everyone uses that one. Way more apps. Way better service. Think diff is nothing special.

@maresionut-laurentiu7128 7 ай бұрын

Except it's totally free

@Justafakestory 7 ай бұрын

Lol what service

@nelsonduffle496 7 ай бұрын

What service are you referring to?

@tooluuke7638 3 ай бұрын

@@maresionut-laurentiu7128 Think diffusion is free just for 30 minutes