Interpolate infinite number of frames with small VRAM usage in ComfyUI AI, RIFE, FILM

  Рет қаралды 3,001

Neuron

Neuron

4 ай бұрын

In this tutorial I walk you through a special interpolation workflow in ComfyUI. This workflow is able to handle infinite number of frames without crashing your RAM. It is running through your files step by step. No need to interpolate all your frames at once.
Be sure to install all the needed custom nodes which are linked below.
Please comment if you have questions or tell me your suggestions for future videos.
The ComfyUI workflow:
github.com/hyperneuron/tutori...
Custom Nodes:
github.com/WASasquatch/was-no...
github.com/BadCafeCode/masque...
github.com/evanspearman/Comfy...
github.com/theUpsider/ComfyUI...
github.com/Fannovel16/ComfyUI...
github.com/Kosinkadink/ComfyU...
Connect with me:
/ _neuron_ai
/ _neuron_ai
The equipment that I use (affiliate links):
GPU: ASUS ROG STRIX RTX 4090 amzn.to/42ptUTi
#comfyui #stablecascade #stablediffusion #tutorial #animatediff #automatic1111 #aiart #ai #inpaint #interpolation

Пікірлер: 22
@electronicmusicartcollective
@electronicmusicartcollective Ай бұрын
Very clever, thanks 4 sharing this
@AlexGolovkoUa
@AlexGolovkoUa 10 күн бұрын
Thanks 4 sharing
@mikea8858
@mikea8858 2 ай бұрын
This is so slick!! I've been playing with SD hyper 1step gen and animate diff now I need to interpolate, and this is exactly what I've been searching for!! Thanks a bunch!
@neuron_ai
@neuron_ai 2 ай бұрын
happy to hear that :)
@sudabadri7051
@sudabadri7051 3 ай бұрын
amazing! love your chan
@Make_a_Splash
@Make_a_Splash 2 ай бұрын
Hi, I have a PC with a low spec. I use comfy UI Ok. for image generation. What's the purpose of this workflow? Is it mainly for video generation only?
@neuron_ai
@neuron_ai 2 ай бұрын
If you use animatediff or svd or something like this and you want to make interpolation it can be hard on the vram because it gets done in one step. with this workflow you can interpolate between frames step by step. so you dont need large vram.
@lone_soul1643
@lone_soul1643 3 ай бұрын
Sup bro , i wanted to ask you when doing animatdiff is there any way to process the 16 frame batch size 1 by 1 and then combine them cause my 4gb gpu can't render 16 image batch at once
@neuron_ai
@neuron_ai 3 ай бұрын
yes, this should be possible. you have to devide the batch. I can tell you the nodes later.
@hatuey6326
@hatuey6326 4 ай бұрын
awesome tuto thanks !! can you make one but this time to create image one by one with a path of pose image already done ?
@neuron_ai
@neuron_ai 4 ай бұрын
Not planed at the moment. But I keep it in mind.
@lionhearto6238
@lionhearto6238 Ай бұрын
hi. when i select allow RGBA output, it doesn't output a transparent png. any idea how i can solve this?
@neuron_ai
@neuron_ai 20 күн бұрын
thats strange. check all the settings. this should be possible.
@ARTificialDreams
@ARTificialDreams 4 ай бұрын
Hi Neuron. Really cool you made this video! Very impressive and massive thanks!! Nevertheless I found two things rather curious. Maybe you want to have a look into that: - With this workflow, it seems that it doesn't save more then the fist 3 images.. - The Load Batch Node loads ALL images in your folder.. twice.. which might take up a few minutes when you have a lot of images in your folder..
@neuron_ai
@neuron_ai 4 ай бұрын
Thanks! :) I tried the workflow again, and for me it works and goes through all of my frames. Be sure that the max_value of the base incrementor node is bigger then your amount of frames. The double loading of the images is not the best solution, you are right. Maybe I come up with a different solution for this.
@ARTificialDreams
@ARTificialDreams 3 ай бұрын
​@@neuron_ai Hi Neuron. I re-tried a few more times with other setting and with other datasets: and it seems to work now! I have no idea why it didn't work on my initial testing. But I wanted to let you know your workflow is working well. I'm currently stress-testing it on a huge batch, to see if it would run out of memory eventually. (which in theory it should not)(I will keep you informed!) Is there a way we can load parts of a batch / specific images only, in order to speed up the process? So let's say I have 100k images, the workflow will load ALL 100k images, which takes likes a few minutes, and seems unnecessary process time. Looking forward to hear from you. Many thanks!
@neuron_ai
@neuron_ai 3 ай бұрын
@@ARTificialDreams Hey, I am glad it works for you now. Its a tricky workflow, and I had some strange things happening when buidling it. Might be some buggy nodes. You can divide your images in parts by simply adjustinge the seed of the incrementer node to the starting frame -1 and the second one to the starting frame and set the max value to starting frame + amount of frames you want to process. that way you can render everything in parts.
@ARTificialDreams
@ARTificialDreams 3 ай бұрын
@@neuron_ai Hi Neuron. I tried out a small batch, and went well. I tried a small batch with multiplier 10 and also went well. Alright, the big test: I retried and let it run loading a folder of 190k images, having the first frame starting at 15000. multiplier at 10... ...the animation would go well as intended until frame 120. But then the exported frame 120 is a random frame from my folder. It seems like that the 'Load Image Batch'-node 001 has have some issues loading the right image. Node 'Load Image Batch 002' seems to still be correct loading the next one. I can make a video and upload it, if you want to see the results. Anyway, maybe you know what the issue might be. I suspect that the node itself might have issues handling bigger numbers. Or maybe we can flush the memory inbetween? Alternative I was thinking about, we might get the same results with loading a folder into animate-diff? So far I believe that has limitations as it couldn't handle SDXL in the past, but maybe now it's possible and open opportunities to explore new workflow to solve the issue? Let me know what you think! And would be awesome if you have a solution. Many thanks!!!
@sudabadri7051
@sudabadri7051 3 ай бұрын
@@ARTificialDreams i know theres a ksampler with restarts perhaps a way of "restarting" at current frame before it gets to 120? Thanks for your testing also!
Survive 100 Days In Nuclear Bunker, Win $500,000
32:21
MrBeast
Рет қаралды 76 МЛН
Mama vs Son vs Daddy 😭🤣
00:13
DADDYSON SHOW
Рет қаралды 48 МЛН
Optimized inpainting for Stable Cascade in ComfyUI AI
10:40
How to Use Frame Interpolation in ComfyUI for Fluid Animations
3:58
Prompting Pixels
Рет қаралды 6 М.
Animate IPadapter V2 / Plus with AnimateDiff, IMG2VID
6:56
Samsung laughing on iPhone #techbyakram
0:12
Tech by Akram
Рет қаралды 6 МЛН
Bluetooth connected successfully 💯💯
0:16
Blue ice Comedy
Рет қаралды 1,3 МЛН
Better Than Smart Phones☠️🤯 | #trollface
0:11
Not Sanu Moments
Рет қаралды 17 МЛН
8 Товаров с Алиэкспресс, о которых ты мог и не знать!
49:47
РасПаковка ДваПаковка
Рет қаралды 175 М.
Копия iPhone с WildBerries
1:00
Wylsacom
Рет қаралды 8 МЛН