3DoF to 6DoF, Photogrammetry in the Metaverse | Masterclass by Eric Hanson

Today, we are moving from 3 DoF (Three Degrees of Freedom) to 6 DoF (Six Degrees of Freedom) using your familiar knowledge of 360 virtual tour and 360 video. To create in the Metaverse, photogrammetry is the next-level immersive capture technique that you should learn as an immersive content creator. You will learn from the expert - Professor Eric Hanson from USC school of Cinematic Arts - in this in-depth Photogrammetry Masterclass. Don't forget to subscribe and follow along.
Let's learn photogrammetry - capture the world of what if.
0:00 - Introduction
1:40 - Meet Prof. Eric Hanson
2:55 - What is Photogrammetry?
4:06 - Photogrammetry in 360 Virtual Tour - 3 DoF to 6 DoF
5:42 - Photogrammetry in AR, Virtual Production & the METAVERSE
7:50 - Photogrammetry: Amature vs Professional
8:54 - HDR Photogrammetry Rig: 3x SONY w/ Nodal Ninjas
13:16 - Pro Photogrammetry Rig: 5x SONY - Speed & Ease of Use
16:13 - Drone Photogrammetry
17:32 - Photogrammetry Software: RealityCapture, Meshroom, Metashape
18:52 - Real-world Example: Blueplanet VR demo
🌎Check out Eric's Photogrammetry BlueplanetVR App on Oculus: ocul.us/3E6XhNt
🎥Check out VR filmmaking Masterclass: film360.video/
#photogrammetry #photogrammetrymasterclass

[@r.in.shibuya]

Make sure to add Blender alongside Maya, you’ll be missing a big market if you don’t. Adding Blender to the toolset in this course is worth delaying it.

[@aaronshoemaker4270]

I really believe photogrammetry, lidar and 360 capture are going to lead to fully immersive walkable environments. This is great.

[@hughhou]

Same here Aaron! That is why our mission is to explore more 6DoF capturing technique - to expand our library of content and tutorial. We also has VolCap and MoCap coming next - more tools for creators to use!

[@andershjemdahl6547]

We’re already doing it - check out Blue Planet VR

[@Mitchdzj]

@@hughhou A huge Thank You to you and Eric for pursuing this subject as a masterclass. I have been a long time follower of you in an attempt to stay in the loop in the world of VR and 360. I have a brief background in visual effects but felt like Post Production was not a fit for me. I wanted to pursue more into the field of photogrammetry but did not make a connection into how to get into the field. This course is a revelation for me!!! I’ll be the first to sign up!

[@Mitchdzj]

@@andershjemdahl6547 are you guys hiring? I believe my artistic goal is in alignment with what you guys are doing at Blue Planet VR. It would be awesome for me to be a part of that.

[@natfoot]

@@hughhou I am not seeing the masterclass and am ready to sign up when you post it.

[@GdnationNY]

Photogrammetry has changed my career and I am so excited at how it will be radically improved with the neural networks being introduced.

[@openroomxyz]

O yea xD Interesting fusion of tech.

[@AlCaudullo]

Hugh my friend, great job on showing Eric and his amazing photogrammetry work. It certainly not for everyone but it's great to see it given some exposure with this piece. Fantastic job thanks so much!

[@KevinNMurphy]

Thanks for this great overview and sharing the technique and thinking on the camera rigs, very generous. Looking forward to taking the class!

[@simpsonelli]

Thank you both for this! Great video, inspiring!

[@AClarke2007]

The best intro to this field I have seen on KZbin so far!

[@toja-360]

Wow... i want do something like this

[@BrianScotland]

Been playing with panorama for 10 plus years, photogrammetry for a few. 360 since gearVR. This is awesome info.

[@simonflodu1687]

Greta work Eric Hanson ! Thank you for sharing your expertise and passion. And thx for your generosity Hugh!

[@DanielFox]

a lot of amazing information - thank you. When will the Masterclass be out? And will it be an added chapter to your current MasterClass? Thank you Hugh and Eric for sharing your knowledge and insights.

[@sixfigureskibum]

Oh. A big fish fighting harness for the outdoor rig... 💪 😀 😎

[@marketmovies]

Bought BluePlanet, thanks for your work. Full time VR professional since Apples QTVR came out. Love to collaborate on projects.

[@WeareVRMUSIC]

Thank you! Another great Episode!🤘👍

[@hughhou]

Our pleasure!

[@hmhhou6464]

讲述清楚。360拍摄很精彩！

[@TheDingsBoms]

Incredible!!

[@FJRamosArt]

Wow! This stuff looks amazing and it’s just the beginning.

[@hughhou]

It really is!

[@TheDavinci2012]

Absolutely amazing!

[@davidayoun]

WoW great episode ! Thank you !

[@hughhou]

Glad you enjoyed it!

[@echelon2k8]

World of Warcraft? lol

[@sitedev]

This is very cool. Is there a mailing list that we can sign up to get notified when the course is available?

[@rubenlazaro726]

Very interesting!

[@pedzsan]

It has now been 20+ months and the link in the description just goes to a parked domain. Did you ever complete the class? It would seem like a very good topic for a master course.

[@saemranian]

So useful, thanks for sharing

[@hughhou]

Glad it was helpful!

[@PP3D]

Very interesting subject Hugh. I have been using Mushroom for sometimes now and love it. 👍👍👍

[@hughhou]

Wonderful! Mushroom can do 360 stitch too. What do you use it for?

[@PP3D]

I use it to 3D photo scan 👍

[@michaeldamore2571]

What are the pros and cons of shooting in portrait? Are there a lot more set ups needed to create the necessary overlap for stitching in post? Amazing rigs by the way!

[@evoogold5172]

Thank you 👋 awesome!

[@hughhou]

Thank you Evoo!

[@vbdaiduong]

Hi Eric, I have experience with using a laser scanner in real estate and construction industry. What are the pros and cons of using the 3D mesh coming out of the point cloud for volumetric VR? Do you think it's feasible with the current VR headset and apps/platforms?

[@colognez4601]

Круто!!!

[@basedmuslimbooks]

This seems great! Is there a rough eta / link to the course? What's the progress? Release in 2023?

[@johnburke4926]

Hi Hugh thank you for always providing such amazing and useful content! Do you know what Eric is using as his "interface" inside of the VR headset? The interface in his VR headset allows him to switch to the map, 3d model, 360 video, etc. Is there a program to create this interface? It's at minute 20 in the video. Thanks again for all your wonderful content.

[@jungeroemer]

is the masterclass available yet?

[@Arhpeco]

Im not sure if i understood correctly at 12.55 does the author make HDR photos first and then processes them further for photogrametry?

[@mspaziani2]

Very useful introduction on photogrammetry! Im' wondering if it is possible to handle the time variable in a VR photogrammetry application? For example, exploring a 6DOF environment, and the sea on the background with the waves moving

[@hughhou]

Yes! That is all coming in the actual masterclass

[@herrpedro]

Great and very very nice app

[@MitchellFX5]

Can you tell me more about the photogrammetry class? I didn’t see any links or any new videos.

[@jide_yeni]

Thank you for the video. Please, where and how do we access Prof Eric Hanson's course?

[@wemakevrofficial]

Well done Hugh and Eric. super nice topic. We also did a mix of photogrammetry and scanning for "Angels of Amsterdam", (and volumetrics), would be happy to share insights if you're interested. Keep up the awesome work!

[@hughhou]

Yes we will love to!!

[@ScottWitte]

I've wanted to get into photogrammetry for some years. This upcoming course looks like a great way to get up to speed quickly. In the meantime I have a burning question: Was that little guy a Dorgi -- a Dachshund/Corgi mix designer dog???

[@hughhou]

Lol it is a Shiba

[@danmorgz]

Any update on when this course will be ready?

[@hughhou]

Hopefully soon

[@danmorgz]

@@hughhou Thanks, this really does look like a great course so I hope you get it out. I need to buy some learning in this area soon so any heads up of an expected date would be helpful. thanks, Dan

[@pearsemcmahon]

Has the course been completed/released yet? i am eager to improve my photogrammetry captures

[@hughhou]

Not yet. Hopefully soon!

[@brettcameratraveler]

Thank you Eric! We have been enjoying Blue Planet. Would love it if a update allowed free natural walking. As of right now, we end up walking into or above any virtual ground that isnt flat.

[@relaxvideo3d]

Brink Traveler

[@ePreneurs]

22:40 Why can you only teleport to certain areas; not in a free mode? Since these are not just 360 images connected, and it is a scanned area?

[@ciscolara]

How can I take this course? I have been doing photogrammetry for 3 years now and I would like to take it to the next level. Where should I go for buying this class?

[@danmorgz]

Hi Hugh - any update on the release?

[@hughhou]

Still no. Instant NeRF really mess up the playing field - lots of knowledge catch up to do.

[@danmorgz]

@@hughhou Shame to hold this up because of future nerf promise. Photogrammetry is right here right now!

[@Bantammenace1903]

Great presentation. I look forward to joining the course. I have one question that does sometimes keeps me awake at night however, and that is whether it is theoretically possible to use 360 images to create a model, and if so how is this most likely going to be done ?

[@Bantammenace1903]

@Eric Hanson Thanks Eric, I can sleep well tonight. I am a land surveyor in the UK and it is both refreshing and exciting to see the resurgence of photogrammetry in this way.

[@DownhomeTraces]

@Eric Hanson Can the Canon dual fisheye VR180 lens for the R5 be used for photogrammetry? Is it common for people to capture stereoscopic images to use for photogrammetry?

[@360Pros]

When capturing complex outdoor scenes, how do you maintain relative geospatial positioning? As in, how do you make sure all shots are in the correct location relative to the rest? In camera GPS?

[@RiderRedField34]

The photogrammetry app from Oculus Quest 2 shown in the video is launched from the glasses or from a wireless PC?

[@RiderRedField34]

@Eric Hanson Incredible!

[@Aaronnoraator]

Where can I find the masterclass?

[@Fitzaey]

I need help to stitch fisheye footage to 360 video together but there’s stiching software like ptgui just for video :\

[@RodneyGin]

Can’t wait for the class… when is it available?

[@hughhou]

Hopefully soon. It is pretty in-depth - and more than 5 hours of content - so it will take us a while to make it look as good as possible :) I will let you know when it is in pre-release!

[@geosense_]

​@@hughhou is there a pre-order list? thanks!

[@lixinzhao6987]

VR360拍摄很好很特别！

[@edrift3d]

Is there a notification list we can sign up for when the course launches?

[@hughhou]

Not yet! We are working on it tho.

[@yannickboers4601]

@@hughhou eagerly waiting for this

[@afsandrefrossardsignes6780]

the expert says that this technique would apply to 360 videos, but it was not very clear. he demonstrated, in the last video inside oculus quest 2, a material that appeared to be a video with 6DOF. my question is: is it possible to make videos with 6DOF using this technique? with people on the move, a real environment like a square full of people? I ask because all the places he demonstrated are just landscapes. of course the capture quality is infinitely superior, but it felt like a simple virtual tour. could you clarify? I was interested in the course, but I need these clarifications. thankful.

[@afsandrefrossardsignes6780]

@Eric Hanson great.

[@precippro]

What specific camera and lenses does Eric use in this example?

[@hughhou]

All SONY, and Zeiss Lens

[@GvRDesigns]

Great Video, where is Eric's Photogrammetry Course? Do you links to course?

[@hughhou]

It is still in progress. Will be out soon :)

[@ePreneurs]

Where's the photogrammetry course?

[@youssefabiaad1044]

The class link isn't valid

[@moderntimes4814]

Can you share 5 camera rig lens mm?

[@VR360LENSMANACADEMY]

Great. Is there any learning literature in web. Kindly let me know. Thanks for the video

[@hughhou]

We are making one

[@VR360LENSMANACADEMY]

@@hughhou nice. Waiting for

[@user-dy4qo3ln2f]

where can I find this course?

[@jmstory744]

where is the link for master class?

[@hughhou]

Still in production :(

[@eastudio-K]

what do you think of the quality of a Matterport Camera?

[@eastudio-K]

@Eric Hanson thank you! What would you recommend for architects. I typically scan and then use the 3D model to build off of

[@eastudio-K]

@Eric Hanson visualization and accuracy would be great, I suppose laser would be better in this case

[@quemorez1520]

Is there a new ETA for this Class?

[@hughhou]

Still working on it. Working on the big game and local team on football now :(

[@andreisheshenin198]

any news about the course ? +- that time expected ?

[@andreisheshenin198]

@Eric Hanson thx

[@Karol.M]

Any updates ?

[@user-eq6vs7tl7r]

Охренеть ребята вот это качество

[@nassiri1355]

Hello ,I appreciate your effort for making the video. but you must work on your voice especially the pitch. Keep the good work. Greetings.

[@DjRubenDias]

I consider it a dog waltz

[@Turbo_TechnoLogic]

Oh yes, of course. Stay at home, don't even move outside for anything, forget real life, move to the fake reality. Just enter the digital prison, that will be good for you in every possible way. We will protect you.

[@BenEncounters]

But how the hell could there be the waterfall in motion?!

[@BenEncounters]

@Eric Hanson Ok I see but in the process, how do you take the video? With the camera stationary? And how to you align it and integrate it with the 3D model?

[@BenEncounters]

@Eric Hanson oh ok thanks a lot for the explanations! I think it would make sense to have a whole video about photogrammetry for subjects in motion, either through textures or in combination with other techniques like volcap or light field cap. Also capturing fast so you could freeze moving subjects. I am very interested in capturing bustling streets, let’s say in Hong Kong for example with people moving and neon lights, windows. Do you think this is still too far off?

[@BenEncounters]

Any thoughts on this last part? I like the work of the artist Ruben Fro for example that goes somewhat in this direction

[@BenEncounters]

@Eric Hanson I read a bit about Ruben’s workflow. He uses a 360 camera for the capture so he can get a very fast capture of a bustling market for example. Then he runs a series of scripts on 360 frames before feeding them in the pro version of Metashape that can process 360. It gets a point cloud far from complete but perfect for the VFX. I tried a similar workflow, and got some cool results especially having people in it. I think I will continue explore this but I am definitely interested in realism in the future. But I really like human subjects in urban environments without having to do compositing with separate volcap.

[@Bantammenace1903]

what happened to this ?

[@hughhou]

AI is happening. We are evaluate NeRF and Photogrammetry and the new launch of bunch of software including new Meshroom, new Unreal workflow and etc. So take us new approach and new research to stay ahead of the game. So we are still working on it.

[@geosense_]

is the masterclass available yet?

[@hughhou]

Not yet. Eric has a busy semester and I have too many clients works :( But it is coming!