Using AI to smooth my footage 😌 with James Perlman. This tech is pretty obscure now, but I do think it will be mainstream within the next year or two.
It's called DAIN, which is an AI technique that smoothly interpolates frames. For every frame you see, it generates 8 frames in between with incredibly smoothness and accuracy. Its main use case is to create artificial (and very convincing) slow motion on clips, but I thought it'd be interesting to apply it to stop motion to create "impossible" movements.
You can try DAIN by visiting grisk.itch.io/....
It works on Windows and NVIDIA only (it requires a TON of GPU power) and isn't the easiest to set up or run. But I do believe that this technology will become more mainstream and it won't be too long before people can download an iPhone or Android app, press a button, and apply this effect.
Keep in mind though that with this clip, and with most things I share on this page (especially AI-related) there's massive selection bias - I'm cherry-picking the best examples to show you. We tested over 100 clips and these were my favorite results. There's a lot of motions and movements that didn't do well - for example anything where I rotated my body or had overlapping movements.
Director @karenxcheng
Editor James Perlman
DAIN-App by Gabriel Poetsch
Credits to the incredible AI researchers who created DAIN: Wenbo Bao, Wei-Sheng Lai, Chao Ma, Xiaoyun Zhang, Zhiyong Gao, Ming-Hsuan Yang
See their research here: arxiv.org/abs/...
Follow me on IG for more videos
IG: / karenxcheng
WHO AM I
Hey, I'm Karen X Cheng.
I’m a creative director and I love sharing my creative ideas and experiments!
#stopmotion #artificialintelligence