Blender 3.0 for Production - 2D & 3D Tracking Workflow - 10 3D-Integration, Shadowcatcher & Masking

In this tutorial series, we will talk about Blender as a solution for 3D Camera and Object Tracking. Step by Step you will learn how to use Blender for preparing your footage in the Video Sequence Editor (VSE) and getting used to the Movie Clip Editor. Then we will cover the important fundamentals of 2D-Tracking in Blender and also some use-cases for directly using these data. Then we build upon these 2D-Tracks and start solving a 3D-Camera and talk about good and bad tracks, nodal shots, tricks like offset-tracking, joining of tracks, and analyzing solve problems. In the final tutorials, we will finish with Object-tracking for props replacement. After this tutorial series, you have a solid understanding of Blender's Camera and Object Tracking and how to use the solved data inside of Blender or in other applications like Maya, Cinema, or Houdini.
If you have questions or topics, which should be added, please let me know.
If you want to support me for publishing more free tutorials you could join my Patreons:
👉 / pixeltrain3d
or give me a fast Coffee time Tip:
👉 PayPal: paypal.me/pixe...
Want to start learning Blender Fundamentals with Helge?
👉 • Publication Trailer - ...
These topics are covered in this tutorial:
Analyzing the tracked scene
Understanding the „Setup Tracking Scene“ Setup
Additional Camera View for checking the work
Building helper objects
Understanding ViewLayers and Collections
Holdout and Contribution (Indirect only) Switches
Setting Draft Render Settings
Setting up a compositing layout
Understanding the compositing setup
Indirect contribution of a collection
Understanding the Blender compositor setup
Movie Distortion Node
Scale Node
Rebuilding a optimized render setup
Adding Sunlight & Shadows
Shadow Catcher in Blender 3.0
Shadow Catcher options on Objects & Light sources
Shadow catcher pass
Understanding the Shadow catcher interactions
Reflections + Global Illumination
Generating a bumpy ground
Blocking out Shadow Catchers
Rotoscoping in Blender
Masking Environment in Blender
Masking Dopesheet
Adding new Masks
Rotoscoping techniques
Masks vs. Mask Layers
Animating a Mask
Autokey for Masks
Parenting Masks to Helper Trackers
Mask Lifetime
Mask Display
Mask Feather Settings
Using Masks in Compositing
Mask Node
Set Alpha Node
Adding Mask Points
Changing Handle types
Combining Mask Layers
If you want to use the same footage, here is my Gumroad link:
pixeltrain3d.g...
Be aware, that these files are included in my Patreon ;-)
/ pixeltrain3d
This tutorial series „Blender for Production“ focuses on Blender as a full Production Suite for (Indie) 3D- & VFX Productions. In these tutorials, I will explain how to work with the different Modules of Blender and how they are connected. I will give you an introduction to the specific functionalities, but also the production context and workflows, which can help you to use Blender in your productions.
As a Senior 3D & VFX Trainer, Helge Maus teaches 3D- & VFX Applications for 20 years. His focus lies on VFX, but he also works with many studios and agencies from different visualization areas. He focuses on Houdini FX, Blender, and NUKE for his daily work and training.
If you have questions or topics, which should be added, please let me know.
If you want to support me for publishing more free tutorials you could join my Patreons:
/ pixeltrain3d
or give me a fast Coffee time Tip on
PayPal: paypal.me/pixe...
Find more information on www.pixeltrain.net
KZbin: / pixeltrain3dvfxtrainings
Twitter: / pixeltrain
Mastodon: mastodon.art/w...
Instagram: / pixeltrain3d
LinkedIn: / pixeltrain
Artstation: www.artstation...

[@maximoremedios]

Best tutorials on the topic I've seen on KZbin!

[@quochaihaikahai4309]

Great video, great tutor !!!!!!

[@Kryptonian0024]

Good tutorial

[@MadManTnT]

Great tutorial !

[@testtesta3780]

Wieder ein super Video. Du machst das großartig! Freue mich schon auf die nächsten Videos.

[@pixeltrain3d]

Danke :-)

[@johntnguyen1976]

This really has been a fantastic series

[@carlitosdemurcia]

Always excelent!! Better learn for any situation than for one shot. You are a great teacher

[@carlitosdemurcia]

I know that is an example to understand workflow, but In this case for final real result , is It interesting make a 3d sides of the little footbridge, to create shadows and gaps of the fence??. I think that a mask parent to any point to create the cube is inside the bridgefoot (left side) its cool, but the other side (right), that proyects shadows above the cube its better with a 3d element, i mean....in real scene i think that the sun proyects above the cube some shadows of the right fence, and this fence have some gaps where the Sun pass through. Thats right?

[@lennylin5651]

Always learn something useful from your tutorial! Thank you indeed!

[@ppsystems4317]

Vielen Dank ! Again a detailled explanation. You are actually really good at explaining ! Keep it up and I'm looking forward for the next one...

[@joshuagaramendi9597]

hello, you don't have a tutorial where the shadows of a video touch the 3d model. how would that process be done for vfx. thanks for the tutorial

[@danielsonderhoff5882]

Ich bin froh deine ausführlichen Clipts zum Camera tracking gefunden zu haben - vor allem auch wegen der ganzen Hintergrundinformationen. Ist es möglich nur die Blender Objekte zu rendern? Da ich später das Color Grading in DaVinci Resolve machen möchte. Allerdings will ich nicht mit dem Blender Objekt in Fusion weiterarbeiten, sondern es als Layer in der Edit Timeline über dem Vdieoclip benutzen-.

[@pixeltrain3d]

Sicher, gehe in Deine Render-Settings und setzt den Film auf transparent. Render Properties -> Film -> Transparent

[@danielsonderhoff5882]

@@pixeltrain3d Nein das funktioniert nicht, da diese Einstellung nur den Worldbackground deaktiviert. Vermutlich muss ich mich mit dem Workspace Compositing befassen und da in den Nodes den Movieclip nicht mit dem Composite verbinden. Vielleicht hat da schon mal jemand mit Erfahrungen gemacht. Denn bei Produktionsabläufen im Bereich der immersiven Medien wird das immer mehr gefragt. Also nur das "getracked object" inkl. Shadowcatcher in eine MontageApp und dann über den Movieclip.

[@MikeIlin]

Hello, thank you - your video tutorials are very helpful. Please tell me how to properly set up the ovascan renderer - for subsequent compositing in foundry nuke? I mean that tracking, lineup and modeling with rendering will be done in blender.

[@pixeltrain3d]

Hi Mike, the is no automatic way of setting up an overscan in Blender. So you have to re-calculate it by your own. For this there is a formular, have to look where to find it again. The result is a slighty bigger Render with the same perspective as the normal Full Plate format. Maybe I find it, then I will make a short tutorial out of that. But, as said, Blender way of working with undistorting the plate is different than NUKEs approach. Blender shrinks the plate for undistorting, which means if you later use these values for redistorting your CG to the original plate you don't need an overscan, because the CG is then always increasing its size. If have already captured a lesson about lens workflows, I hope its covered good there, otherwise I have to make a separate workflow demo.

[@MikeIlin]

@@pixeltrain3d I'm still just trying to figure it out - the fact is that when eliminating distortion, the image does not always shrink, sometimes, on the contrary, it expands beyond the edges of the frame. I found the "render camera overscan" addon, but I still don't quite understand how it works.

[@pixeltrain3d]

Hi Mike, OK, do you have a link for me for the footage? Then I can look into it and try myself and try to build a clean setup. Could you write me an email, please.

[@FredAubert]

Thank you Helge, I always learn so much from your tutorials! The only "trouble" is that I get so much focused onto your exercises that I keep on watching your different episodes but skip the trying it out myself... so have to rewind and watch again and practice. Concerning the other applications you mention - Nuke, Maya, etc... - they are quite pricy unfortunately. I personally use Vegas Pro (within my budget) but would you have some recommendation for a better solution? Thank you again and many greeting from Northern CH. Fred

[@pixeltrain3d]

Hi Fred, great to hear :-) Yes, NUKE is really, really pricy. That's the reason why I plan to show the Blender Node-based Compositor much more in the future, because I believe that everyone should be able to finalize their visions, not only if you have much money. For Editing we use DaVinci Resolve (Studio) + the free version. Also Affinity Photo + Designer and Ocenaudio. Works great for us. Have a great day.

[@FredAubert]

​@@pixeltrain3d Thank you for the quick response and suggestions. Yes I know Davinci, great for colour corrections but I still prefer Vegas Pro for masking + rendering. I don't know Affinity Photo, will have to check out their trial version, though 55 US$ sound attractive. Now I use an old Adobe Photoshop 7.0 version, so far so good. For Audio I use Sound Forge, it came with the Vegas upgrade and I am happy with what it delivers. I just sent you some cash for the Cappuccino request (though in CHF which turns out to be a ridiculous amount in Euros) 😂🤣

[@pixeltrain3d]

Thanks a lot :-)

[@mirality2464]

Super Danke Helge for another great tutorial! Q: Any chance, in the near future, to do some BM Fusion tutorials for composition ? I know Nuke is the industry standard but it's very expensive for a beginner freelancer. Thank you very much for all your time.

[@pixeltrain3d]

Thanks. I will take a look into it. I would be really intersted how many Blender users are using Fusion for compositing. I use NUKE, because I still work with many studios using Houdini and NUKE , so it's a good fit. For Blender users I find the Blender compositor would have great potential. It's still slow, but the tools are good. I hope, project Heist will bring more realtime compositing into this area. So, any Blender useres out there how want to tell us, what they use? Blender Compositor Fusion Nuke ???

[@mirality2464]

@@pixeltrain3d Thank you for reply. Like Final Cut Pro, Davinci Resolve Studio (Fusion Studio included) license is for life and only 295 USD. Lately BM put some intro tuts on their YT channel and free material training and books. kzbin.info/www/bejne/o3yUqYWtgN2psKs

[@Kryptonian0024]

@@pixeltrain3d i use nuke here in india studios have stop using fusion

[@rivusmedia]

@@pixeltrain3d Ich nutze den Blender Compositor, für ein kleines Videounternehmen ist das die beste Möglichkeit und ein Tutorial wäre extrem hilfreich!

[@pixeltrain3d]

Thanks for your inputs. I hope, we get some more, but I think investing time into the Blender compositor would be a good step.

[@AtillaLifeson]

Hey there Helge, what do you think about implementing chapters right here on KZbin? I keep coming back to specific parts of your videos and having chapters would allow me to quickly jump into the part I'm looking for.

[@pixeltrain3d]

Hi Atilla, I thought about that before. But I don't have clear chapters normally in my tutorials, because I follow the work, so I decided to not do that. It also takes more work. I will think about it again. Thanks, Helge

[@Surajsingh-ox5dl]

I need help :- I import cube as you did but mine cube was not showing in camera view although it was visible in 3d view " I have only one camera which is active I tried many times but got same problem occurred

[@pixeltrain3d]

Hm, how far is the cube from the camera? very close or far away? Then it could be a clipping setting in the camera. Go to your camera data properties to the display section and activate the limits tick. Is the cube in these limits?

[@SteamfriedShorts]

I dont see any materials at all. They are fully transparent in the foreground