3d Camera Tracking, lens distortion, ground reconstruction in Fusion / Resolve 17

Рет қаралды 17,103

3 жыл бұрын

I haven't seen too many tutorials on dealing with the full pipe of doing 3d tracking in Fusion, so I figured I`d put a quick one together.
We'll be tracking the footage, and using the point cloud to create a rough approximation of the ground/landscape. Use our lens distortion information to further fit the tracking data to our plate, and lastly use overscan rendering to expand the area the distortion cropped.
Let me know if you guys would like more of these videos, I was hoping to do a series on cleanup, projections and integration using these techniques.
Please leave a like, comment and subscribe :)

Пікірлер: 96

@thisisryker 3 жыл бұрын

Wish you make videos more often!)

@RonnieMirands 2 жыл бұрын

Man, you are a Fusion Genius. You do need more thing like this! Your knowlegde is amazing!

@statixvfx1793 2 жыл бұрын

🙏🏻

@VFX_BUDDY 3 жыл бұрын

Whoa! That's awesome 😮👏 please make more

@totox691 Жыл бұрын

High level tutorial, mesh construction from cameratracker is really missing in fusion, but you solved it :)

@statixvfx1793 Жыл бұрын

It’s a bit of a hack, but it helps :) Glad you enjoyed it.

@JeremyOrlow 3 жыл бұрын

This is amazing! Looking forward to more videos!!

@UlfErlingsson 2 жыл бұрын

The video is only 12 minutes but it takes 30 minutes to view, so packed with good information!

@AdrianLopez_vfxwolf 2 жыл бұрын

This was bloody brilliant! Would love to see more tutes from you....

@hisroyalillness Жыл бұрын

Wow, I never assumed that tracking points could generate uv's. Also crazy that it is possible to use the cleanplate note to fix the displacement. hanks for sharing al those awesome tips.

@MikeHughesShooter Жыл бұрын

Amazing, So many concepts and insights. Thank you so much. Please note that if there are this many positive comments, you likely affected 10x more so this sharing is incredibly valuable.

@statixvfx1793 Жыл бұрын

Thanks Mike. I hope to do more tutorials on cases like this. Time permitting.

@XSession 3 жыл бұрын

Thanks man...... needed that!

@zsoltszalanczi4508 3 жыл бұрын

great vide, would be nice to see more!

@statixvfx1793 3 жыл бұрын

Thanksm ill try to do another one.

@timothywhiting1836 3 жыл бұрын

Really excited for the next step!

@richard_robert 3 жыл бұрын

This one was very interesting. Subbed, please do make more of these amazing tuts.

@Manoloalube 3 жыл бұрын

Good tutorial. Yes, I will like to see more videos as this. Thanks

@NedBrannigan 3 жыл бұрын

I've just stumbled across you channel and love the tutorials I've seen! I'm new to Fusion and VFX in general, so my brain is a bit fried, but you still make everything easy to understandable and easy to follow. Thank you!

@niallcochrane3331 2 жыл бұрын

Insane knowledge of Fusion, thanks for taking the time to do this tutorial!

@aki_gong6271 2 жыл бұрын

Wow! I'm happy to be a long time subscriber from your channel. That's simply amazing. Can't wait for more actually! Keep it up ;)

@csgregorium 3 жыл бұрын

you deserve 100x more subs !! keep doing this great work!

@MeinVideoStudio 3 жыл бұрын

Insane. Love it. Thank you for that Position Pass Trick!

@ABlackbirdCalledSue 3 жыл бұрын

Great tutorial and awesome trick!

@Altek2k 3 жыл бұрын

Can't wait to see more videos on how this is used.

@smepable 3 жыл бұрын

Amazing! Thanks for Putting this together

@monemarz 2 жыл бұрын

what a great tutorial, thanks a lot....you are great

@lalamax3d 2 жыл бұрын

thanks for sharing, its beyond awesomeness

@mandienk2702 3 жыл бұрын

Woo really amazing, I will try it asap, thx for this great video :-)

@scarabrae 2 жыл бұрын

Brilliant tutorial

@marcinrucinski 3 жыл бұрын

Love the video. Nothing like this right now on KZfaq. Have been learning recently about Davinci fusion 17 point cloud, 3D tracking. And just for this few minutes have learned few things... I have mavic pro 2 so now I will know what data to put exactly and to tick so it will not calculate again after I put data. I learned that I can turn off grid from 3D view. Thanks for al this ... great if you could mention in next video how to alight object/ text what is the best way so it perfectly match points in point cloud... I know there is option with points to publish but have no idea how to use it . SUBBED waiting for next videos... 🙏🏼

@HartmutNoerenberg 3 жыл бұрын

This is incredible amazing. Would be awesome to see how you paint out some parts (like the people) and show a a little bit of a possible workflow

@statixvfx1793 3 жыл бұрын

Thanks Hartmut, good idea. There's definitely some easy ways to do cleanup if you have decent tracking and geometry data.

@darviniusb 3 жыл бұрын

You project the footage on the 3d generated geo from the tracked footage, render uv's out, paint the uv's and reproject back. IT should work.

@HartmutNoerenberg 3 жыл бұрын

@@darviniusb you should make a video about it.

@gosalh Жыл бұрын

@@statixvfx1793 Hi @Statix vfx are you able to share the link to the footage so people can follow along and play around with it? I have intermediate fusion experience but I tried your method on different footage but similar and I got really different results, thanks

@jaanpotter7124 Жыл бұрын

I also would like to see video about paint out people video.

@MagivaIT 3 жыл бұрын

next level stuff, really appreciate you putting this together ive been looking for a simple way to create a displaced area that would displace shadows of a text. Essentially recreating a moving building or a hillside so that 3d text shadows follow a simulted topography. I imagined pulling at a grid to displace a plane manually and fixing it in 3d space......this is wayyyy more than i anticipated haha, but awesome education and i think ultimately, the right way. I do wonder if its possible/easy to create a very simple displaced plane and "fit" it into the 3d space

@gabrielkenine68 3 жыл бұрын

This is great. I'm really happy with the tutorials you mke. I really hope someday you can look into stereoscopic compositing. Its a topic i still don't understand yet. Thanks for the tutorials man.

@statixvfx1793 3 жыл бұрын

Thanks, Ive worked on several stereo films. But never in Fusion.I might have a go at it, but I dont have any stereo footage at hand tho.

@user-us3lc1og7v 5 ай бұрын

@@statixvfx1793then which software did you used if not fusion 🤔🤔

@tyronemackayTV 3 жыл бұрын

Fantastic my goodness you just saved me so much round tripping. ;D. thanks. GOODONE

@statixvfx1793 3 жыл бұрын

Happy to hear that.

@gianpaolorende 3 жыл бұрын

Thanks awesome trick!!!

@suatsekil 3 жыл бұрын

wooooowww u are the number 1, how can I learn like you :) ?

@antoniopepe 3 жыл бұрын

thanks for sharing. very usefull

@TimesaverVFX 3 жыл бұрын

awesome!

@kenzorman Жыл бұрын

amazing

@MarioDiazDelgado 7 ай бұрын

thank you very much!

@crypt0sFX 3 жыл бұрын

If I ever buy Fusion, I'll have to remember this video.

@crypt0sFX 3 жыл бұрын

@PAKA Oh I already do. I'm just saying if I ever choose to buy it, I'll try and remember this video for the camera tracking as it's not included in the free version.

@jurajstefanik5069 3 жыл бұрын

Hi, I using mavic mini 1/2.3 sensor, what is the Aperture Width and Height for it? Any tips, manny thanks.

@pavinivfx Жыл бұрын

This is nice. I can also use a geometry with the tracked geo in Houdini for my simulations.

@wendellestate Жыл бұрын

you are a god

@mtscott44 Ай бұрын

Holly shit dude, this is amazing. Thank you!

@mtscott44 Ай бұрын

Any tips getting this data out to Blender?

@statixvfx1793 Ай бұрын

@@mtscott44 You can instance small spheres to the point cloud if you're setting the point cloud to renderable. You can instance using the replicate3d node and the fbx exporter node to save it out.

@mtscott44 Ай бұрын

@@statixvfx1793 Cheers.

@nikolaostsimpetonidis4243 3 жыл бұрын

Thank you very much for you the great video. May I ask please, how would you compare the current version of Fusion, to Nuke? In brief, why Fusion hasn't been adopted by most of studios yet, or at least part of it considering that it has the same tools and an excellent price model comparing to the competition (even Nuke Indie has an annual subscription license, which you need to renew, in order to keep using it). Many thanks for any info. Keep up the great work!

@antonian4466 2 жыл бұрын

Thank you so much for puting time in sharing this! I am just starting in Davinchi and that is really big help. Could you recommend any BIG good COURCES on fusion?

@skapeedits3209 11 ай бұрын

amazing tutorial, do you know how to apply the textures of the image to the mesh?

@olegromanov7671 3 жыл бұрын

Begging for more!

@user-gd6pj6oh8p Жыл бұрын

Amazing video! Will you make more video about fusion? I want to know how to make the AE Effect Plexus plugin in Davinci fusion! (like point and line staggered together)

@denisdodo 3 жыл бұрын

u r baack!

@statixvfx1793 3 жыл бұрын

weeeee

@tobiasbauer7902 2 жыл бұрын

Please make a consecutive one to this on how to use that to put objects and text according to the plane

@XSession 3 жыл бұрын

It's the one you post after 2 years ....why don't you upload more....so curious to see more

@statixvfx1793 3 жыл бұрын

This youtube channel is just for when I have extra time. So hence its fairly sporadic when i post new stuff. Glad you liked it.

@XSession 3 жыл бұрын

@@statixvfx1793 i love to see more from you!!

@TomSidProductions 18 күн бұрын

What can I do to get this geometry to act as a bounce collision for particles?

@maximoremedios 2 жыл бұрын

Amazing. Thanks for sharing. Would it be possible to have access to the footage to practice?

@RobertNilsson 3 жыл бұрын

That was awesome! Will you be able to export this with camera to for example Blender to do some advanced cool stuff?

@tyronemackayTV 3 жыл бұрын

you most certainly can ;D. how exciting

@RobertNilsson 3 жыл бұрын

@@tyronemackayTV this is the shit. To do the same in blender takes ages

@statixvfx1793 3 жыл бұрын

Yes, Fusion cant actually export the point cloud but if you use this technique you get the ground reconstruction and camera if you export to FBX. Alternately you can use a replicator3d to add tiny spheres to the point cloud and export that too.

@RobertNilsson 3 жыл бұрын

@@statixvfx1793 thank you. Will try that!

@midphase 3 жыл бұрын

This is quite interesting. Is there a way to export the displaced grid as geometry through Alembic or FBX so that the scene can be processed in another DCC app like Houdini?

@statixvfx1793 3 жыл бұрын

Theres an fbx exporter in fusion you can use to export it.

@DonEsteban3D Жыл бұрын

Can you do tutoral with blender ->fusion vfx compsiting pipeline in future? Something ike dynamic camera render from blender+ fusion vfx. There are almoust no good tutorials about that. Only nuke stuff... :-/. Or maybe you know any good one?

@suatsekil 3 жыл бұрын

thanks please what is ur graphic card and cpu? may u advice graphic card and cpu? thanks

@max60213 3 жыл бұрын

omg can you just slow every steps down a little bit?

@redhootoboemonger4328 3 жыл бұрын

These videos assume you have intermediate to advanced fusion knowledge prior. If it’s a little too fast perhaps watch at half speed.

@totox691 Жыл бұрын

I did it on one of my video and its working nice. I have still a question, is there a way to smooth the mesh we obtain without add a lot of tracking point. But thanks again, that open a lot of doors to make some cool effects in camera tracking.

@statixvfx1793 Жыл бұрын

You can smooth the mesh by blurring the position/displacement image :) Granted that also means it'll interpolate between actual tracking points so the mesh will be less accurate.

@totox691 Жыл бұрын

@@statixvfx1793 I will try that, thx again

@alpha18_81 5 ай бұрын

How can i use this mesh for casting shadows of for example a 3d text?

@3d3rbart 2 ай бұрын

i use blender for that , just export the scene to fbx and do every thing in blender very easy

@kAdRaKeS 2 жыл бұрын

Can you please add the video as well, just to follow along?

@skullbrew_ 3 жыл бұрын

I am confused, seems like it's possible to do some 3D in fusion, even though it's marketed as a compositor... So my question is; What can you do in Fusion and what can't you do?

@statixvfx1793 3 жыл бұрын

Fusion is a compositor first, and a 3d system second. Much like Blender is a 3d program first and a compositor second (its got a built in comp tool). Fusion's 3d system is very advanced when it comes to dealing with VFX and motion graphic related tasks. Projections, effects, looks, adding elements etc can all be done in 3d. However, fusion isnt made for modeling, animation and physically based realistic lighting.

@rano12321 Жыл бұрын

Who said you can't do 3D stuffs in compostors? It's only after effects where you can't do anything 3D, other compostors like Nuke, Fusion all can do 3D stuffs.