Demonstration how to 3D scan interior with camera for Gaussian Splatting

If you want to produce good quality 3D Gaussian Splatting model from interior space, this short demonstration simulates how you should 3D scan the place from three different heights and what kind of routes you can make in the room which has furnitures in it. The idea is to get the best possible coverage with pictures from different angles.
You can also check interactive demo of this room model in here:
bit.ly/ghostwa...
#gaussiansplatting #3dmodelling

[@the_derpler]

I would really love to be able to do this for my current apartment before I have to move away, so that I can re-visit in VR in the future.

[@HarshvardhanVarma]

As a VR/AR developer for the Quest, I love your work. Here's to the future of digital experiences :)

[@DaTruthHeals]

Hey man, any other subscribers or videos that you would recommend for 3d scanning and vr development?

[@tomward5293]

Great results. I tried scanning my living room yesterday with 239 photos and 300k steps training in postshot (using a DSLR in manual mode). The results were extremely good in many ways. However, I think what I'll do next time is try closer to 1k photos with much less training steps. I have avoided this so far as I've heard that too many photos can cause issues, and 300 is the recommend amount.

[@joannemagi]

Olli, you are certainly my angel to save my project. Thanks for your video!

[@hanskarlsson3778]

Very nice once again, Olli!

[@chacecampbell2697]

Super cool, thanks for sharing the info!

[@jimgunzel]

This is the best way to scan, its the same principle for photogrammetry interior scanning, take sharp photos high aperture no video

[@leono83]

Really nice video! About the capture method: Do you recommend using a 360 camera for capturing more data in each shot? how about the tripod or the person holding the camera in that situation?

[@Reykoil]

so cool, bravo! ❤

[@Ronin2079]

this is awesome! could you do a video on how you processed and stitched the videos together to get one splat?? pretty please??

[@robertglas]

Great video! I know from experience, those mirrors are a problem in real life though:) They make certain angles impossible without capturing yourself. I still have to figure out what better: just appear in the shots and mask yourself out later, or avoiding getting captured at all. Any experience? Same goes for shadows btw, depending on the scene it can be an even bigger problem.

[@47merce]

Damn Olli. That was real good.

[@mn04147]

this is really important

[@Mranshumansinghr]

I was waiting for a new video.

[@정상건-c6i]

The results are good, but please also post a video of the filming process!

[@OlliHuttunen78]

It is all there. If you watch the beginning of this video carefully you see all the images taken from different angles. You see what route the camera was moved in the room. All those 1128 rendered images was then imported to Postshot program and it makes that end result.

[@ppQmaister]

@@OlliHuttunen78 What was the resolution of these?

[@OlliHuttunen78]

1440 x 1080

[@alexiscureno]

Thank you big time! Now i have a better understanding on how to do interiors i was having some little issues but all clear now... this can also be applied into static objects, right? like statues, cars, etc.

[@AlessioRegal]

Great video!

[@zongshuowei766]

Great video tutorial! Do you mind I repost this video link on our website? It's a pretty common pain point for first time users and I think this will help people a lot.

[@OlliHuttunen78]

Sure! Be my guest. You can repost it.

[@HosniElmolla]

Amazing!

[@nathanarditti9793]

Nice !

[@dinoscheidt]

Thank you so much.

[@florianmanhardt9815]

Great work Olli, can u do a in death video how to use postshot?!

[@tommy-ke4ij]

You are my Gaussian Splatting Guru, Olli. May I know which kind of camera did you use in this scene and Iphone 15 pro max might be fixed for interior scanning?

[@OlliHuttunen78]

In this particular video, a real camera is not used, it is built in a 3D program and rendered from images of virtual cameras. As I mention at the end it is a simulation. But if I were to do a similar scan in a real interior, I could very well use an iPhone pro level camera. The wide angle lenses they have are very functional for such Gaussian Splatting scans.

[@khairulhadi1164]

was wondering how did meta hyperscape was made and stumbled upon this

[@sopranottt]

Awesome 💪🏼

[@sinanarts]

Thx Ollie perfect as always. What is the resolution for renders you suggest.? 1080p enough.? or more as minimum.?

[@OlliHuttunen78]

Image resolution I used in this was 1440x1080

[@svenskatabbar1519]

An other great video from you Olli. Did you process this splat by removing any unwanted artifacts or is this the result straight from postshot?

[@hollisatlarge]

Wicked cool animation! Great way to demonstrate capture positions. I'm still experimenting with finding the best quality splat that has a ply file under 500k (Spline's limit). Right now I'm working mainly on creating 3DGS aerial models that use about 200-400 images from 2-3 different heights as input into Postshot. I occasionally struggle to keep ply file size under 500k even after cropping and editing in Postshot / Supersplat. Do you do anything special to keep your ply file size down?

[@briandavis4866]

have you tried Playcanvas with a compressed 3DGsplat via SuperSplat (normally I get a 90% reduction in file size)

[@christian-schubert]

JEEZUS CHRIST, Olli! Never thought I'd ask for this, but do you sell courses or something where you go into greater detail of how to achieve this in a comparably fast and frictionless manner? Just starting out with photogrammetry etc. to potentially offer these services to realtors in the future. 'Scanned' a mug, imported the images into postshot (thanks for introducing me to that program!) and was BLOWN AWAY by the results! However, still getting LOADS of artefacts, reason possibly being that the background was too blurry - still trying to figure stuff out along the way

[@hollisatlarge]

May I recommend starting with Polycam or Luma. Polycam can even give you a professional looking floor plan in a matter of minutes. You can also edit, create custom flythroughs, and easily display results on a website.

[@christian-schubert]

Definitely gonna look into Polycam, thanks for the reminder! 👍👍 If I can figure out a quick and easy, hassle-free workflow, this might be a game changer (in real estate visualization and related businesses, fast turnaround times are KEY). Process time should hopefully not be too much of an issue on the RTX 4090 and 64 GB of RAM

[@hollisatlarge]

@@christian-schubert I’ve created some crazy cool real estate aerial models and my process for capturing, editing, and training can be completed very quickly. While I don’t do interiors, that process would take considerably more time acquiring the images. My process for creating a 3DGS aerial model of a property takes less than 3 hours. I find this fascinating since creating a high quality 3D aerial model was extremely cost prohibitive and of lower aesthetic quality less than a year ago. By the way Luma does a great job allowing the user to create custom fly through renders and their training algorithms are really good.

[@TomPIT1]

@@hollisatlarge Hi, we woould like to see your work, 3DGS? also those implemented in Spline. Any special reason why Spline and not UE? thanks.

[@chyrek.ambient]

I just Gaussian splatted in my pants 👖!!

[@UnrealPixelation22222]

😂 damn. 😆👌

[@dailele8370dai]

thanks for you

[@Moshugaani]

I wish someone would try using Gaussian Splatting in an actual game! It could work well in a "walking simulator" style story focused game.

[@eldragon225]

I am imagining a setup where you have a 3 cameras mounted on a dolly that you roll around the room to efficiently capture everything all at once.

[@OlliHuttunen78]

I have same kind of intrests to build that kind of scanning stick with three cameras. It would be cool.

[@eldragon225]

@@OlliHuttunen78 I saw your video on that, I own a real estate company and do all the photography and videography for said company. We do a Matterport 3-D tour for every listing, but I find it very limiting and not true 3-D as it relies heavily on panoramas. I would be very interested in exploring this concept further. Feel free to reach out if you every get closer to a concept that might work, I might be interested in collaborating.

[@bjornapostel248]

Nice! Thanks for that. Is it possible to create an 3d model in blender with this splat, add or connect more rooms and export the 3d model to glft so that I can use it in my virtual toure software?

[@mishamulyakaev7406]

Hi Olli, do you think it'a possible to build a 360 camera rig with (3) cameras each positioned at different heights? So instead of going around the space three times, you could do only one pass-through. Or do you think the other cameras will "see" eachother in the frame and it will mess-up the splat that is generated?

[@OlliHuttunen78]

Absolutely! I've been thinking about a similar solution. It could be implemented, for example, with three 360 cameras. When the cameras are placed exactly on top of each other, a large part of them is lost in the seam area, which inevitably occurs when the 360 image is stitched together. But the 360 image still has to be processed and disassembled afterwards, and that work has to be done with three different cameras. So even if you get a lot of coverage with one shot that way, there is still a lot of work in post-production before the images can be transferred to Gaussian Splatting training.

[@mishamulyakaev7406]

@@OlliHuttunen78 Thanks for your reply! Just to clarify, wouldn’t the post-production work be the same for one pass-through with three cameras vs three pass-throughs with one camera? Because the total amount of images would be the same. I already have one Insta360 RS-1inch, and I’m thinking if it’s worth it to buy two more 😅

[@Edensproject]

hey, there isnt any way to do the same thing on a MAC? any software that is equivalent to postshot?

[@OlliHuttunen78]

Unfortunately, there is currently no similar program for the Mac platform. It might be possible to get NeRF Studio to run on Mac Silicon processors. It runs through the browser and is a bit tricky to install, but in principle you could make it work on MacOS. Then there is this OpenSplat which should run on Mac. I have not tested it but here is interesting article about it: radiancefields.com/opensplat-3dgs-now-on-mac

[@sanzhang5091]

i only have one rtx4090 computer, postshot cloud complete the 1128&300k training? if its true, thats awsome!

[@punio4]

How does DoF impact 3D reconstruction? When using a virtual camera it's possible to have a perfectly sharp image, not much so when using a real one.

[@OlliHuttunen78]

Depth of field does is not good for GS training. Same goes motion blur. You should use as sharp images as you can get and wide angle is also useful. But no lens distortion.

[@360_SA]

Great video and tutorial. I wish there was a render way that takes a model into GS directly. Any coder here😂

[@BardCanning]

it's been 9 months... where are the gaussian splatting games? even short demos?

[@gunzshy]

Body Cam uses similar techniques : kzbin.info/www/bejne/r6WpXnSNgK-HgaM