3D Gaussian Splatting Hadrian's Villa

[@bernardfrischer6326]

Bravo, Matt. Keep up the great work.

[@pangaeuspress]

Wonderfully well done! Keep it up: you'll answer a lot of unasked questions!

[@binchen-l9x]

At about six minutes and thirty-nine seconds, what software was used?Looking forward to your reply😊

[@MatthewBrennan]

Agisoft Metashape - it's an industry-standard photogrammetry software (formerly called Photoscan).

[@francescoluciani3397]

But you have exported camera position and sparse cloud in postshot from metashape?

[@MatthewBrennan]

yes.

[@brettcameratraveler]

Visiting these sites with lightweight AR glasses in about 5-10 years will potentially allow us to overlay 3D photorealistic reconstructions that are mixed in with the IRL ruins. AI virtual actors in period accurate clothes could interact with tourists answering their questions while in character. I used VorpX on AC Odyssey - Discovery Tour to get a preview of something like this using VR. Love what you are doing. Can you recommend any other photorealistic historical recreations done in 3D and/or VR? I have a XR immersive education lab and would like to share anything you might recommend with some of our history teachers.

[@MatthewBrennan]

The one that comes to mind first is Rome Reborn. Last time I saw it, they were adding 360-degree reconstruction images of a number of other sites too (Baalbek and Athens): www.flyoverzone.com/virtual-tours-2/ Would love to hear more about your lab! (I do research on using VR for teaching art history and archaeology).

[@brettcameratraveler]

@MatthewBrennan Thank you :) I tried a couple of these on Steam, and perhaps it was just the Steam version, but the trailer looked like it was roomscale 6dof but what you ended up with was more of a series of exported 360 renderings and not the larger program. Perhaps it's been added in the update you mentioned. As far as my space, it's located at a high school in Los Angeles and was originally built as a large green screen stage and editing bay to teach video production but I've been expanding it to include virtual production, real-time mocap, VR, etc to not only future proof the program but I've been careful to design/build it out in a way where all the tech can also be repurpoosed in a way to create and experience XR based immersive learning for other subjects such as Physics, History, Design/Animation, etc. I'm also in the middle of building a modular 3D CAVE system, so an entire class of 30 can have VR like experiences without the need for VR HMDs. It also doubles as a hybrid greenscreen/Volume stage. One of the things some of the students are learning at the moment is how to use g-splats to build virtual sets for their films which they will then shoot handheld with a tracked cameta on the stage with a actor using live composting with Unreal. We are in the testing phase with most of this and hope to have full projects next semester.

[@MatthewBrennan]

I was lucky to teach 2 art history classes using ~25 Quest 2 Headsets and VR applications I developed (Italian Renaissance art) in the fall of 2021. It's definitely the future of education!

[@MStrong95]

What software are you using for photogrammetry and gaussian splatting?

[@MatthewBrennan]

Metashape for camera alignment. The INRIA paper for train.py - repo-sam.inria.fr/fungraph/3d-gaussian-splatting/ And Unity to render.

[@brettcameratraveler]

@@MatthewBrennan Do you find it has a significant quality advantage over the latest version of the Luma AI g-splat tool?

[@MatthewBrennan]

Luma is likely using the same underlying algorithm with some tweaks on top. The main advantage comes in the more "customizable" alignment through metashape (i.e. using markers or GCP to help with initial camera estimations), and of course being able to render with Unity afterwards. There's also the added benefit of not giving cultural heritage data to corporations for free!