The Foundry Nuke: 3D / Warp Stabilization

3D Camera Stabilization in The Foundry Nuke by Mazyar Sharifian from www.cubichead.com
This is a Nuke tutorial on how to 3D stabilize your camera shake or in other words, how to warp stabilize your shaky footage.

[@Niotex]

This was exactly what I needed to stabilize a cam operator rolling over a wire on something on set

[@jannovak6987]

This is absolutely unbelievable. You're obviously a genius. I thought I'm good with the 3d workflow in nuke, but I'd have no idea how to fix this shot. What you have done, and how you matched the stabilized footage to the original one using those reformats etc, is just amazing.

[@manojkumarcheerala9727]

you literally made my mind more stronger and less afraid obviously ... thanks !

[@Cubichead]

Thanks Manoj 🙏🙏🙏

[@rattanykem781]

Very well explained ! Hope to see some more interesting nuke videos !

[@Cubichead]

Thank you Rattany, I’ll do my best!!!

[@tomcypher3864]

This is actually real 3d stab. This is what I was looking for!

[@Cubichead]

🙏🙏🙏

[@bishalgurung5093]

you saved me !!! thanks for this tutorial. life saver

[@Cubichead]

Thanks for the comment Bishal!

[@mani_visual]

This Tutorials You Make , Are Awesome Man . I'm Really Glad That I Found You , AND MORE IMPORTANTLY than that : I'd be Happier you make some more great FARSI Tutorials PLS ! Keep it up , Amazing !

[@Cubichead]

Thank you for your comment Persian VFX! :)

[@greenbowlfarming7203]

Thank you very much, very helpful session.

[@Cubichead]

I am glad if was helpful! Thank you for your comment 🙏🙏🙏

[@sergeimuliar6717]

Thanks dude! Simply useful!

[@Cubichead]

🙏🙏🙏

[@janardhanaraothota8796]

Awesome tutorial sir best technics 👍🏻

[@Cubichead]

Thank you Jana ❤️❤️❤️

[@hunter8980]

Love it ! Thank YOU !!!

[@Cubichead]

🙏🙏🙏

[@FixMotionPictures]

wow really cool ...

[@diegodipaola]

really good job!!!

[@Cubichead]

Thanks Diego 🙏🙏🙏

[@wfqtube]

very good,thank you very much

[@Cubichead]

🙏🙏🙏

[@NIKHIL_SHOt]

Thanks man👍

[@Cubichead]

🙏🙏🙏

[@ronydey2696]

GREAT TUT'S EVER THAT'S MUCH NEEDY AND HELPFUL SIR HI SIR MYSELF RONY I'M AN VFX CG STUDENT FROM INDIA

[@apmanti12]

i usually use sphere instead of creating point cloud

[@rohithkumarsp]

Can you please provide the input for practise.

[@dainvfx]

i'm seeing some sharp edges when projecting on close foreground. do you know how to blur those sharp edges on projections?

[@Cubichead]

Just check your anti-aliasing option in your scanline render node, it should fix it.

[@FixMotionPictures]

i have a footage character is still but bg wall and lights are animating in focus and defocus , i have cleaned character but issue is focus and defocus matching do you have any idea ?

[@Cubichead]

That’s going to be a little bit tricky, because cameratracker doesn’t understand defocus! You can try to mask those areas out the same way you are masking out the moving subject, and if you don’t get enough information for tracking, you can add manual user tracks, or you can freeze frame those areas and recreate them before doing cameratrackkng, in a way prepping your footage before tracking it.

[@hunter8980]

How to merge multiple videos (from different angles) of the same location and convert it into the 3D space in NUKE or MAYA?

[@Cubichead]

To do that, you still need to matchmove either with the same technique I showed you here or in maya. Then you have to make some rough proxy geo from the environment based on the point cloud you get from the matchmove data. Finally, you pick different angles you wanna project, freeze them (the 2d frame and the camera) then use “Project3D” for each angle to project on the proxy geo. However, because you have multiple projections from multiple camera angles, you need to first use a “MergeMat” to combine all the projections and then connect that MergeMat node to the proxy geo. I hope that makes sense!

[@hunter8980]

This is a priceless tip for me. Thanks YOU !

[@Cubichead]

❤️❤️❤️

[@overnightclassic2]

There's a much easier way to stabilize this shot. All you have to do is track the camera and remove any translation values from the camera that make the camera move down the street. That means if you orient the camera right, remove say the Z translation. Why? Because 90% of camera shake is nodal shake (rotation only) and then there is only a small amount of remaining camera shake that is moving up and down vertically (y direction). Then you would simply project your footage ontly a cube which represents the scene's road,building walls, etc. Obviously if you project onto a cube you will get hard lines so how do you solve this? Make a cube in say maya and smooth it so the edges are soft. And the best part about doing this is you don't take a double filtering hit since you only go through a scanline 1 time Not only did your stabilization not produce a good result but it also did not produce a "locked-off" result which is important for using the background for a driving comp.

[@myyoutubechannnel4]

he literally did the same that you, i dont see major difference

[@Cubichead]

It’s true that we a nodal stabilization, we can make it happen for this specific shot, but the point from this tutorial is that it would be applicable for most scenarios and in many situations we just don’t have nodal point camera shake, especially when you are walking and you have a up-and-down motion on the camera (like a sine-wave) and just fixing the rotation won’t be enough. In regard to filtration, I am not using scanline twice, I used it once. I would assume you have seen the entire video before writing such a comprehensive reply! Thanks anyway for commenting.

[@overnightclassic2]

@@Cubichead my point is it DOES solve up and down camera shake. My method is not to solve nodal camera shake only. But what my method does that yours does not is produce a "locked off" result which is the type of stabilization you would desire for this type of shot your method only produces a "smoothed" version of the camera. It is useful as a stabilization method though if you project onto a sphere. I did use it for another shot

[@praveenrajaram3939]

its strobes ,edge work is there

[@manojkumarcheerala9727]

Can we have the footage please?

[@Cubichead]

You don’t have to necessarily work on this footage, there are so many examples if you google “shaky footage”. I just did it and here’s one example: kzbin.info/www/bejne/n6qZfnVma5p3pNE

[@mprudhvi5077]

teach about model building and point cloud generator teach port full professional artist type

[@Cubichead]

Sure, I just need to spend some time to find a practical way of teaching it!

[@AndhraboysTelugu]

Ok

[@arturovalle5990]

you talk to much

[@Cubichead]

I hope that’s a compliment.