How to Use Frame Interpolation in ComfyUI for Fluid Animations

Рет қаралды 5,373

Күн бұрын

#comfyui #aitools #stablediffusion
Frame interpolation in a video processing technique that adds additional frames to make animations smoother. Here's how you can add it to your ComfyUI workflow.
Time Stamps
Intro - 00:00
Installing ComfyUI Frame Interpolation Custom Node: 0:11
Workflow Overview: 0:25
Adding Frame Interpolation to Workflow: 0:45
Comparing Original Output to Frame Interpolation Output: 1:43
2x Frame Interpolation vs 4x Frame Interpolation: 2:13
RIFE VFI vs. FILM VFI: 2:52
GMFSS_Fortuna VFI: 3:06
Outro: 3:26
Workflow from the Video:
promptingpixels.com/comfyui-w...
ComfyUI Manager (To Install Custom Nodes):
github.com/ltdrdata/ComfyUI-M...
Frame Interpolation Node (thank you Fannovel16 for making this awesome node):
github.com/Fannovel16/ComfyUI...
VideoHelperSuite (to support Video Combine):
github.com/Kosinkadink/ComfyU...
Important links:
- Patreon: / promptingpixels
- 👾 Discord: / discord
- 🌐 Website: promptingpixels.com/

Пікірлер: 20

@JakeDownsWuzHere 4 ай бұрын

thank you! thank you for your workflow archive as well!

@PromptingPixels 4 ай бұрын

You're very welcome!

@tacji1284 Ай бұрын

Great Video - Thanks

@cormac8613 5 ай бұрын

This is so helpful. Thank you

@PromptingPixels 5 ай бұрын

Awesome - so happy to hear. Hope whatever projects you have cooking up are seeing a nice result.

@sudabadri7051 5 ай бұрын

Great info thanks

@PromptingPixels 4 ай бұрын

No problem!

@Parsitube_yt 5 ай бұрын

perfect

@PromptingPixels 5 ай бұрын

Thank you!

@AlexDisciple 5 ай бұрын

Thanks for this! I was seeing some examples of videos where generated scenes "morph" into each other. Could you give some pointers on the best methods to achieve that? In A1111 it seems like it is an img2img with Film interpolation method

@PromptingPixels 5 ай бұрын

Ah, well a video of frame interpolation was on the list - you just helped me bump it up in the queue :-). I am thinking what you mean by the morphing feature is essentially prompt traveling/prompt scheduling. I touch on it a bit in this video: kzfaq.info/get/bejne/ga9_oLSjncWmgHk.htmlsi=HhHfn--jzh-v5dg4&t=280 If you fast forward to the 10:36 mark you can see the output of the prompt where the scenes blend into one another. As a reference I am using the Fizz Nodes custom node to allow this to work (github.com/FizzleDorf/ComfyUI_FizzNodes) It would probably be best to do another video on just prompt scheduling techniques to give a little better/controlled results. Hope this helps out!

@WhySoBroke 5 ай бұрын

Thanks for the details! Can this also be used for img2img interpolation for creative morphing on separate images based on prompts?

@bender203 3 ай бұрын

I'm just starting out with Comfyui: Noob question_How do I take the code from your workflows and convert it into a drag and drop .json for Comfy?

@PromptingPixels 3 ай бұрын

Hey - if I understand your question correctly, best way I could explain it is in this gif: giphy.com/gifs/CSXFKlBdguJZqMqbJc Basically just drag and drop the saved json file onto the workspace. Let me know if this does the trick!

@Pauluz_The_Web_Gnome 2 ай бұрын

I suggest doing this with a 4090 only?

@dwisugiarto8399 4 ай бұрын

how to fix install failed: ComfyUI Frame Interpolation?

@EricJamesHurley Ай бұрын

I like the video, ultimately these methods feel kind of weak as a video professional. I hope comfy gets something closer to Topaz Video at some point.

@deadcatanimation 3 ай бұрын

are you running interpolation on a mac? It doesn't seem to be supported yet. tell me your secret :)

@PromptingPixels 3 ай бұрын

But I can't share my secrets...! Unfortunately very little processing is actually being done on my mac that I use for these videos. For my setup I am using a remote windows machine on the local network that has a GPU. So all the heavy lifting is happening there. The mac is just a portal to it all.

@deadcatanimation 3 ай бұрын

@@PromptingPixels aaahh... you tricked me :)