Creating VFX with NeRFs - Nerfstudio Blender Add-On Tutorial

[@james84490]

sir mean we don't need to track camera for vfx. wow, thankyou so much!!

[@james84490]

Sir, plz tell me i have gtx 1650 it's work in this graphic card? Or it want higher

[@cyrusvachha]

I'm not sure if a 1650 will work, and I tried using a 1070 a while back and that worked, but it was very slow (2-3 hrs to train and render). Newer graphics cards might work better

[@gaussiansplatsss]

is graphics card required in using nerfstudio? Is amd integrated graphics enough????

[@cyrusvachha]

Nerfstudio requires a CUDA compatible nvidia graphics card, so I don't think amd graphics cards will work.

[@crebiiGG]

great video man straight thru thanks much

[@Murdalizer_studios]

Oh my goodness. wow. i don't say this lightly...Broooooooooooooooooo!? this is amazing; thanks for making and sharing.

[@deathseverance]

THANK YOU FOR YOUR EFFORTS 🙏

[@jamesriley5057]

Is that UC Berkeley in the NeRF shots? That's my home town. Excited about this technology Edit: Is the workflow for this addon as circuitous as it appears in the GitHub link? clean it up a bit and make some revenue on it.

[@cyrusvachha]

Yes, Nerfstudio and NeRFs were created at UC Berkeley!

[@DanielLopez-up6os]

Thank you for this very informative video.

[@Jeroen_Ech]

I see you're working on a mac, but nerfstudio doesn't have an installer for mac. How did you make that work?

[@cyrusvachha]

I was running Nerfstudio through SSH to a remote desktop in visual studio

[@OnelineNight]

I also looking for an option for a mac. what model is your mac? M1, M2, M3 ? / What are the specs of the remote desktop? I would love to have the same setup. Thank you in advance!

[@dibbidydoo4318]

This is crazy!

[@irissantos4795]

How many points do you have in the point cloud imported to the blender scene?

[@cyrusvachha]

There isn't a minimum number of points required, but I used the default amount, which is 1 million points. It helps to have enough points to show a decent reconstruction of the scene.

[@poyodiazmusic]

hello ive been for two dys now trying to export a camera path from blender but the path doesnt work after importing it in nerfstudio , any hints?

[@cyrusvachha]

You may need to press the Reset Keyframe Timing button (three lines at an angle) on the render panel in the Nerfstudio viewer.

[@james84490]

sir can you make a tutorial on how to use nerf studio as camera tracking mean i want to make videos like chair fly mean real life interaction, btw why you use camera tracking tracky app if you have a neRFs? camera tracking is important? because tracky app is hard to make it for i phone!! and i don't have a mac book. i'm waiting for your replay!

[@cyrusvachha]

I used Tracky to create a hand held iPhone camera effect and for compositing the NeRF over a real video, but it is not required. This also could be simulated with a blender virtual camera. Also, Blender has a motion tracking system as well built in which can motion track video input. With the virtual camera movement, the Nerfstudio add-on can create the camera path to render the NeRF to create the camera tracking.

[@james84490]

@@cyrusvachha mean it's just for giving camera realistic movement. I'm right?

[@cyrusvachha]

@@james84490 Yes, and I also used Tracky as the background video layer but that's optional.

[@morecarstuff]

thank you.

[@bruceli3688]

Awesome

[@mandreenfrank8246]

👍

[@franko9928]

the blender addon is gone?

[@cyrusvachha]

The Blender add-on is still part of the system. Here is the documentation: docs.nerf.studio/en/latest/extensions/blender_addon.html

[@franko9928]

@@cyrusvachha yes, but its not downloadable. its just a wall of text. i'm not not that technical. thanks for helping me clear this up though.

[@cyrusvachha]

@@franko9928 The add-on is a python script, and you can download it by right clicking on the "Blender Add-on Script" link and selecting "Save link as..." to save the python file. Or, you can also copy and paste the text into an empty file and save it as a python file. Then, you can import the script through the add-on window in Blender. Let me know if that helps.

[@franko9928]

@@cyrusvachha oooohhhh... cool. thanks man.