Using CopyCat for Roto with

Рет қаралды 57,248

Күн бұрын

Visual Effects Artist Alfie Vaughan showcases a real world example of CopyCat being used for roto in production. It covers analysing the footage for reference frames, setting up the CopyCat nodes, running the training and then utilising the output with an inference node.
Learn more about Nuke 13.2 here: hubs.la/Q017_8yp0
As the industry-standard compositing tool, Nuke gives artists everything they need to tackle diverse compositing challenges at any scale and resolution.
Watch the Tutorial here:
learn.foundry.com/course/6495...
About Us:
We are the creators of industry-standard visual effects, computer graphics and 3D design software for the Digital Design, Media and Entertainment industries. Since 1996, Foundry has strived to bring artists and studios the best tools for their workflows so they can battle industry constraints whilst staying creative.
Subscribe to our channel and get the latest news, tutorials, webinars and updates from the Foundry team.
Follow Us:
/ thefoundryteam
/ foundryteam
/ thefoundryteam
/ foundryteam

Пікірлер: 85

@FoundryTeam 2 жыл бұрын

For more Nuke tutorials, check out: learn.foundry.com/nuke For Nuke product information, go to: www.foundry.com/products/nuke-family

@DKGCustom 2 жыл бұрын

When is Nuke going to run natively on Apple Silicon, when so many other software developers kicked in so quickly. Seem to be missing the game changer

@Blank201 Жыл бұрын

Thanks for adding this tutorial, really glad to see an example of the usefulness of this tool. After following the directions I wasn't getting any useful data when my Copycat was done processing. So I went and listened once more and noticed something that you said that you actually didn't do in your script. In the first Remove Node (connected upstream from Copycat 'Input') you say to Keep the RGBA, but in your Node Graph you actually only kept the RGB. I think that's why I wasn't getting any results the first time through.

@doginconfusion 2 жыл бұрын

While the idea of AI assisted roto is impressive, you could have picked a trickier shot for demonstration. The guy nearly moves, mocha would take seconds to track.

@doginconfusion 2 жыл бұрын

@Behram Patel I agree with you. He does say though that this approach pretty much saved the entire project and at some point there is a tricky shot with Gozer that he says he used copycat to extract a matte for. Cheers!

@AlfieVaughan 2 жыл бұрын

It definitely does work! I used it for the whole entire project. Some shots the actors were flying around on harnesses, landing and doing flips then taking off again... It was crazy. And copycat managed to more or less nail the entire 5 minute sequence. Seriously impressive!

@doginconfusion 2 жыл бұрын

@@AlfieVaughan That's great to hear! We are still stuck with Nuke 12.7 where I work but an upgrade is on the way. Looking forward giving it a spin. Cheers!

@AiLife115 2 жыл бұрын

@@doginconfusion me too, there is many plugins still not up-to-date that the company usually used..I have to stick with nuke 12

@angosalvo5734 2 жыл бұрын

Yeah I was disappointed also with the example used. Not challenging at all.

@darviniusb 2 жыл бұрын

Wow this is awesome. I had a very complicated project almost 3 years ago that required roto for 2 actors and each of theyr body parts including many objects for 2000+ frames nd a very short deadline. Was a cartoon conversion from real footage to 2D. I had to write a python AI program to run on 3 high end nvidia gpu's of that time and even after letting it run 20+ hours over a weekend on 4k frames it had a lot of trash in it and was never so clean like this, but was usable and better then nothing, was 70% there, so i had to literally paint each frame to get the trash out. Was crazy work and i wish i had this tool. Is incredible how the technology evolves so fast. Resolve 18 just came out and the Ai roto in it is also extremly impressive.

@FireballVFX Жыл бұрын

Perfect, quick and precise explanation. Thanx!

@KedarKhot Жыл бұрын

Thanks for sharing your knowledge...

@user-dy3pe9hh7j Ай бұрын

thank's for making this video !!

@ContentMonsters 4 ай бұрын

SO DOPE! ⭐

@omw9965 Жыл бұрын

Somethings in Nuke are just easy while other simple things are nearly impossible but with Mocha in After Effects this can be done in seconds. Mind boggling.

@AlfieVaughan Жыл бұрын

Sure, this specific one is easy. But I just picked this as the example. A lot of the shots were hundreds if not thousands of frames and much more complicated. The reason I used copycat for this is because once you train it on one shot it can do all of them as long as they're similar.

@nixipanda798 Жыл бұрын

Mocha works for Nuke as well

@elijahmurphy4980 9 ай бұрын

Thank you the good explanation.

@cupcakenest 2 жыл бұрын

have you tried white balance the footage before keying,might have helped

@nguyenbui90 2 жыл бұрын

It will be great to have the footage to practice copy cat

@BrimoStudios 2 жыл бұрын

Brilliant! I'll try this tomorrow on a green screen plate that I've been having issues with and was dreading doing a heap of roto on

@Bbentley81 2 жыл бұрын

Is there a big improvment from copycat in 13.1? I have tried it on a pretty simple shot and it produced totally unusable results.

@353productions 10 ай бұрын

@AlfieVaughan, Hey, I'm prepping for some post work and want to use a similar approach. In my case it's a rigid bodied object in a roughly similar position in varying lighting conditions. Do you need to do per shot roto + training? Or can I do 2-3 frames on let's say 10 shots and use those as my ground truths and use one inference for 60+ shots for example?

@ReinOwader 2 жыл бұрын

To me this looks like perfect task for Mocha.

@gravitymg5315 2 жыл бұрын

yo. tnx!

@themysteriousunknownrevealed Жыл бұрын

What Ghostbusters project is this? It looks great!

@pamgonzales9030 2 жыл бұрын

how good does this work on shots that have motion blur? All the examples I have seen of it always has fairly static subjects.

@AlfieVaughan 2 жыл бұрын

It does a pretty good job. You can either roto the motion blur in the reference frames by blurring and feathering the edges of the mattes. Or what I sometimes did is run the hard roto through a 2D motion blur node to fake it a bit. It depended on the shot which one I chose to do. Hope that helps!

@MrGnagnagnou 2 жыл бұрын

Is the production video somewhere we can see ? This looks great !

@AlfieVaughan 2 жыл бұрын

Unfortunately not. It was for a live experience project so I don't think there are any videos online

@madlookzvfx 2 жыл бұрын

is there any difference if we do key for a single frame and use that to generate matte and do roto for the single frame? I appreciate if you would have used copycat to generate matte for the Screenleft character as that's the tougher task in the shot

@stephen12holbrook 2 жыл бұрын

I would think it wouldn't make a difference, as long as the key is clamped to min 0 and max 1 values, the end result should be the same.

@AlfieVaughan 2 жыл бұрын

You can do that too. When I show the bigger shot at 2:50 you can see I'm using a mix of keying and roto to generate the mattes

@madlookzvfx 2 жыл бұрын

@@AlfieVaughan Did you tried copycat with the other character in the FG?

@Agniii Жыл бұрын

This would be like 5 minutes of work with AE roto brush or Davinci Resolve's Magic Mask. This is too much work for automation..

@Nibot2023 2 ай бұрын

where do I find colouredge?

@reed4109 2 жыл бұрын

Does the roto you create for each reference require the same amount of anchor points?

@jMcWill781 2 жыл бұрын

I don't think so - as he mentions the copycat node is interpreting the input as Images rather than roto shapes, so I believe you could even have different numbers of roto shapes in your reference frames and it will be fine.

@AlfieVaughan 2 жыл бұрын

Nope it just uses the alpha! :)

@ruta24studio71 2 жыл бұрын

Where can I find the ColourEdge gizmo? Please, it will come very handy.

@ivaylo.paskalev 2 жыл бұрын

Did you find colouredge gizmo ?

@TheNjordy Жыл бұрын

@@ivaylo.paskalev he didn't find the colouredge gizmo

@ghostinthemachine563 Жыл бұрын

@@TheNjordy is there anybody who found the colouredge gizmo?

@juanmartinvillafane426 Жыл бұрын

Can I use the reference frames from one shot and use copycat with those reference frames in another shot? How would be the process?

@AlfieVaughan Жыл бұрын

You can yes! As long as they're the same sort of shot then you can use an inference node from the training on other shots and it will do the same thing.

@alexjohnson2599 2 жыл бұрын

Fantastic explanation, thankyou

@AlfieVaughan 2 жыл бұрын

Thanks!

@alexjohnson2599 2 жыл бұрын

Has anyone had issues with it saying "Empty frame range" when trying to restart it? Can't seem to crack it

@user-ct4oo7bp8k Жыл бұрын

I`ve got the same problem

@zurasaur 2 ай бұрын

Can I try this in the non-commercial version? This is insane!

@FoundryTeam 2 ай бұрын

Hi! Of course you can! Feel free to share your thoughts in our community once you give it a try too community.foundry.com/discuss/forum/197/nuke-non-commercial-users

@mikakettunen7939 2 жыл бұрын

We are still on the stoneage, speaking as as Vfx artist here

@stephen12holbrook 2 жыл бұрын

If it took 40 min for copycat to produce an alpha for a 66 frame shot, how long did it take for that 2300 frame shot?? I can definitely imagine this being very useful, thanks for the tips!

@AlfieVaughan 2 жыл бұрын

For the really long shots I left it training overnight for about 9 hours. I don't think it needed all that time it was just a good opportunity to leave it running for ages. Most the time it was useable within a few hours :)

@littlecurrybread Жыл бұрын

@@AlfieVaughan how do you feel copycat compares to runway's tools? I'm not sure if you've talked about it online somewhere.

@sara9373 2 жыл бұрын

can copy cat node be used for paint-prep shots ?

@FoundryTeam 2 жыл бұрын

Hi! yes, copycat can be used for any image to image process. So if doing paint cleanup of markers, or things like dust, scratches etc, you could give copycat a few frames of the cleaned-up version and train it on that to have this applied to the rest of the frames in the shot. Like with any machine learning the quality of the data you put in will help determine the quality of the result you get out.

@bandersnatch9469 2 жыл бұрын

"Unimaginable power, unlimited rice pudding!"

@LucasNoce 2 жыл бұрын

Can we address the fact that this is a production level with actors, a studio BUT just one artist in post production !? Can we replace producers with AI already ?

@AndrewJarvis 2 жыл бұрын

Is that shot you were working on at 2:57 from Ghostbusters Afterlife!?

@joesherman5209 Жыл бұрын

Hello Alfie how do I contact you to ask question on application using copycat for project, best joe

@AlfieVaughan Жыл бұрын

Hey Joe. I guess here! What would you like to know?

@mylopintorizvi4349 2 жыл бұрын

whats the seventh doctor doing here?

@macprofire 8 ай бұрын

At 5:26 you say to keep RGBA though I‘m sure you only mean RGB

@rizwanahmad1130 Жыл бұрын

Mocha can do that in seconds.

@rythmncolors Жыл бұрын

dont you think it can be done with a planar tracker . Cheers!

@TriniFlix Жыл бұрын

Someone need to fire the VFX supervisors on that set lol...

@heeeeeresrossy Жыл бұрын

Is that Sylvester McCoy?

@AlfieVaughan Жыл бұрын

It is!

@AKAHatter 3 ай бұрын

I'm a year late, but finally someone pointed that out. Like was I the only one who noticed the 7th Doctor??

@pranitgadankush2296 2 жыл бұрын

Will it end roto jobs? Plz answer

@igormajdandzic7587 2 жыл бұрын

@pranitgadankush2296 2 жыл бұрын

@@igormajdandzic7587thnku

@TheCookingPixel 2 жыл бұрын

Not now, but may be in future 🤔

@Kuk0san 2 жыл бұрын

If anything, it will create even more roto/comp work because you can now crank out these shots in a fraction of the time. So you'll be able to get even more shots done with less work.

@angosalvo5734 2 жыл бұрын

Adobe roto brush is killing them already.

@shutthefupdonnnie 9 ай бұрын

I really don't understand why this isn't keyable - the greenscreen looks absolutely fine, just need to remove markers near the actors and use a degrained plate to stop the buzzing edges. It honestly blows my mind when compositors don't know the most basic (and advanced) art of keying - NOBODY gets a good key with 1 keying node, it's naive to think you could. And having worked on many many large productions over the years, we would NEVER roto a shot like this, that's not normal if its on a decent green/bluescreen (such as this), people just need to learn how to key.

@matthiaskoch331 2 ай бұрын

Clean-Plate + IBK Gizmo would have done the job. :D