photogrammetric alignment using Agisoft Metashape.
@aVTuser6 күн бұрын
@@MatthewBrennan thank you!
@goodman556811 күн бұрын
I couldn’t find in the description and credits at the end of the video whose music was used here. Could you tell?
@MatthewBrennan10 күн бұрын
Sorry: "Elgar - Serenade for Strings", added to the video description too!
@goodman556810 күн бұрын
@@MatthewBrennan thank you very much
@AlexViktor199713 күн бұрын
why not taking only keyframes from the pictures?
@MatthewBrennan13 күн бұрын
That’s cheating.
@zsigmondforianszabo469813 күн бұрын
11:26 bro uploaded the video in 4k but recorded the screen with an amazon doorbell camera 💀
@MatthewBrennan13 күн бұрын
😂 yep. Lesson learned. The renderings were 4K but my screen recording was 1080 🥲
@bluedeep804118 күн бұрын
If only these beautiful buildings existed today, it would have been amazing. It’s an unbelievable engineering. The talents and skills of the builders were astounding.
@user-vz5mp8hh2d23 күн бұрын
Of course we have to remember, that slaves were worked very hard,even to death for these beautiful palaces.
@grigtodАй бұрын
Amazing use case!
@falldog9Ай бұрын
Wow this is incredible work. Thank you.
@MatthewBrennanАй бұрын
Glad you liked it!
@JohnHutchinsonJPHАй бұрын
What type of 360 camera did you use?
@MatthewBrennanАй бұрын
Insta360 One R - I've had it for about 4 years and have mixed feelings about it - sometimes it's great, other times it will freeze and shut down for no reason - and to my eye the footage is decent. For the price it's a good little 360 camera.
@infectioussneeze9099Ай бұрын
what are your computer spec?
@MatthewBrennanАй бұрын
The 3DGS was trained on a cloud workstation instance with an A100 GPU. The video rendering and photogrammetry was done on a desktop with a Ryzen 9 3900X, 4070ti, and 32GB RAM.
@chumleykАй бұрын
Ok. Why did the psychedelic sky of the gaussian splat give me a panic attack? I'm going to call it a Splat Attack.
@FredGarcia-yt6teАй бұрын
What music?
@MatthewBrennan10 күн бұрын
"Elgar - Serenade for Strings"
@tamiopaulalezon9573Ай бұрын
What is your drone?
@MatthewBrennanАй бұрын
Mavic 2
@HeadPackАй бұрын
Very informative video. You are showing a textured model from photogrammetry in the end. How does one create that?
@MatthewBrennanАй бұрын
You need a photogrammetry software. In this case, I used Agisoft Metashape, but there are free/open-source options, such as COLMAP and VisualSFM
@HeadPackАй бұрын
@@MatthewBrennan Thank you very much for that information. Much appreciated.
@ryukisai99Ай бұрын
Thanks for the good video and for providing the nice dataset. What is the focal length of your drone's camera (full frame equivalent)?
@MatthewBrennanАй бұрын
35mm equivalent is ~28mm. It's a 1" CMOS 20mpx sensor (for still images). However this dataset uses 4k video.
@ryukisai99Ай бұрын
@@MatthewBrennan thanks for your answer. I'm trying to run your dataset using micmac photogrammetry. I'll let you know if I get good results!
@handlemoniumАй бұрын
Cool.....but where's the moon?
@MatthewBrennanАй бұрын
During totality the moon moves in front of the sun (it's the black "hole" with sunlight shining around it) - when it's not occluding the sun, it's not visible (because the light is coming from behind it)... Unfortunately, the exposure settings on the 360 camera don't make it possible to really see the moon occluding the sun because there is enough light to still overexpose that area - but the shift from full/partial sunlight to eclipse is still pretty dramatic.
@sommergreen3803Ай бұрын
THANK YOU SOOO MUCH FOR THIS
@michaelytterberg8941Ай бұрын
Wow!!!
@jimj2683Ай бұрын
Someone should turn Google Street View into 3d. It would be so nice to drive around and explore the world in a driving game.
@lifeunframed9154Ай бұрын
Is the photogrammetry done from VR footage?
@MatthewBrennanАй бұрын
No - the photogrammetry is a DJI mavic 2 and a Sony A7Rii. Although, as I was watching the 360 footage, I think I will try to digitize one of the grave markers using the spherical video (the one that I walk around completely).
@trollenz2 ай бұрын
Good old nodal stitch method, stunning results... Nothing beats that still 👏🏻👌🏻
@MatthewBrennan2 ай бұрын
Thank you! I was worried about ghosting on the greenhouse structure/mullions, but I must have had it dialed in perfectly :)
@trollenz2 ай бұрын
Haha, you definitely went on a challenge on that one, don't worry I've turned the stuff upside down all the way around... Flawless 😉 Sound atmosphere is also very immersive... I'm about to scan a very similar one... I'm concerned about the hours of deleting reflected points I'm gonna have to spend 😅
@estebantedesco13482 ай бұрын
god damn insane
@user-dv3pi8co2x2 ай бұрын
At about six minutes and thirty-nine seconds, what software was used?Looking forward to your reply😊
@MatthewBrennan2 ай бұрын
Agisoft Metashape - it's an industry-standard photogrammetry software (formerly called Photoscan).
@NOLNV12 ай бұрын
That's an amazingly beautiful rock formation, not that it's the topic of the video but just felt like mentioning it
@MatthewBrennan2 ай бұрын
It has an interesting backstory too! The legend goes that a utopian community wanted to hollow out the rock to use as a church - and even went so far as to begin chiseling a doorway (you can see the opening in the video/model).
@foolishonboards2 ай бұрын
do you still recommend this technique ? I just saw this video that uses a slightly different technique and I'm wondering which one to use: kzbin.info/www/bejne/goKxc4esnNGdd9k&ab_channel=TheNeRFGuru
@MatthewBrennan2 ай бұрын
360 imagery won't give you results like properly captured "photogrammetry"-style data - the typical 360 sensors are small, and you're cramming a lot of data into not-many-megapixels. If you absolutely have to use 360 data, good even scene lighting and a good 360 sensor are key, more than the processing technique.
@hammadwalid84282 ай бұрын
Dude, your video looks horrible, why do you upload that like this with 144p resolution being in "HD" or "4K"?
@careclean242 ай бұрын
Hi everyone, is it possible to digitize a vehicle so that it is displayed razor sharp with all of its flaws and scratches without using spray color?
@MatthewBrennan2 ай бұрын
You'd want to use LiDAR or structured light, or a combination of LiDAR and photogrammetry. I have digitized wrecked cars before using photogrammetry - and LiDAR is often used to document crash scenes.
@lukassarralde54392 ай бұрын
Hi Matthew. Great video explanation. Which drone did you use for this test? Do you have by any chance any more drone footage? Have you use the DJI Mavick 3 pro Cine for photogrammetry? Thanks.
@MatthewBrennan2 ай бұрын
I used a Mavic 2 for this model. I have used a number of different drones for photogrammetry in the past, but haven't tried the Mavic 3 yet, although I don't think the Cine model adds anything particularly useful for traditional photogrammetry.
@RiccaDiego2 ай бұрын
Hi! Amazing information! I think you can help me with some information. I have point clouds from a BLK360 scanner from leica. Do you know if it is possible to turn these point clouds into Gaussian Splatting? Thanks a lot!
@MatthewBrennan2 ай бұрын
no, probably not, because the Gaussian splatting is based on image data, not LiDAR data. You could use a photogrammetry program to align your LiDAR datasets to imagery, though.
@ishibaro2 ай бұрын
thank you very much for this video :D superb for future developments in archaeology. I am already checking NERF with Kiri Engine, but I loved to see how to do it with the tools you mentioned. Coool!
@user-ph7jh6oo5w2 ай бұрын
.. The building STyle in which were as a daughTer in The KinderGarden is called Villa i had age 5
@AlisonBLowndes3 ай бұрын
Hi Matt, are you testing with NV Omniverse? Great video!
@MatthewBrennan3 ай бұрын
No. I tried it about a year ago but didn't find it very compelling.
@handlemonium3 ай бұрын
I wonder how far one could get with enhanced texturing of the ground based on satellite and photosphere images from Google maps (like in MSFS 2020). Cuz otherwise you'd need to get approval to conduct a drone flight over the historical site to get that extra imagery and detail reference.
@MatthewBrennan3 ай бұрын
I’ve thought about screenshot-ing Google earth to create the rooftops/fill architecture, but the quality just isn’t high enough- I think what you’d want to do is get some reference materials for the paving/ground and model that by hand, then PBR texture it
@RolandHa233 ай бұрын
Where is the panorama sphere texture coming from that you used in the end?
@MatthewBrennan3 ай бұрын
It’s a panorama I took using a UAV directly above church rock.
@khairummaksudahoqueadeeba99113 ай бұрын
Hi Matthew! Thanks for this video. I'm new and a total noob to this field. I'm a Marketer and my line of work I'm having to learn a lot of these things including reality capture, photogrammetry, NeRFs, 3D GS, Digital Twin. Do you have videos that are educational about these aspects which would help a beginner like me to understand the basics?
@BunkerSquirrel3 ай бұрын
The splatter is really cool looking. Looks like a hallucination or a dream
@nekosan013 ай бұрын
how it accurate compare to epic realitycapture? You talking like old photogrammetry not exist and this is something new and something good, but how it's good? It's requires highend videocard! and result is not better than old photogrammetry what run on old PC just fine.
@MatthewBrennan2 ай бұрын
Not sure I understand what you're asking. NeRF/3DGS are completely different from photogrammetry, the only similarity is that they use the initial camera pose estimation. NeRF/3DGS at the moment (afaik) don't have a quantifiable accuracy and shouldn't be used for anything beyond visualization.
@vexnity4603 ай бұрын
I'd say, if your using reflective or translucent surfaces,i 100% recommend nerfs instead of photogrammatry, cuz it does it somuch better
@MatthewBrennan3 ай бұрын
I made another video explicitly comparing the two- the photogrammetry model actually turned out pretty well.
@16pxdesign3 ай бұрын
Well described ❤ Appreciate ❤
@Apollotwente3 ай бұрын
Hello Matthew, thank you very much for your response. I assume I need to create an mp4 file if I want to scan a gaussian splatter. What are the settings? I am really a novice in this. Previously I was doing an fps 30. Is it convenient to set fps60? Thanks in advance.
@MatthewBrennan3 ай бұрын
In my experience, still images (photographs) work much better than video! Follow good photogrammetric practice for capture, and then process as a 3DGS.
@Apollotwente3 ай бұрын
Great video, thank you. Could you advise me how to scan an object very sharply for gaussian splatting? As it happens, I can't get it sharp. The letters are not clear. I own an android (s22 samsung, nikon z50, insta 360 x3). Which one would be the most accurate? As I am using the texture for training purpose. Thanks in advance. Greetings, Sebas
@MatthewBrennan3 ай бұрын
The Nikon z50 would likely be the best (physical shutter + megapixels), although of course it depends on what lens you are using. In my experience, I get the best results using a high-resolution mirrorless camera (compared to an iphone or action camera). Of course - more data = longer processing times, so there is always a trade off or compromise.
@Zanaga23 ай бұрын
Is it possible combining multiple cameras to get a better quality and keep the 360 capturing workflow speed?
@MatthewBrennan3 ай бұрын
If you had multiple 360 cameras you could mount them vertically on a pole and move that through the scene, yes (getting numerous heights would be key). Another solution would be multiple mirrorless cameras mounted at 3 heights, so something like 12-15 cameras total, firing simultaneously as you moved through an environment.
@Zanaga23 ай бұрын
@MatthewBrennan oh, I forgot to specify, but I was thinking about regular cameras (non-360). My bad. But thanks for answering, I might try it one day for a long shot with no cuts.
@garryferrington8113 ай бұрын
Considering what little is left, this is primarily a work of imagination.
@MatthewBrennan3 ай бұрын
The remains of Hadrians villa are quite well preserved, and this is based on numerous archaeological monographs, as well as the input of various experts. No reconstruction can be 100%, but this is the best given what evidence is available.
@orkunsevengil3363 ай бұрын
What dhrone and camera you used? :)
@MatthewBrennan3 ай бұрын
DJI Mavic 2
@christianblinde3 ай бұрын
Nice stuff. Did you manage to get the 2000 images in one splat? If i try to use more than about 300 Images my system will kind of explode? Which tool are you using to show the pointcloud in the video? Thanks in advance.
@MatthewBrennan3 ай бұрын
Yes all 2k processed in one go, though I did downscale them to prevent running out of VRAM (40GB A100). The point cloud is just a screen-capture of the model in "Capturing Reality" (a photogrammetry software).
@joey_wittmann3 ай бұрын
Very nice, I think your screen cap settings were optimized for streaming just so you know, got a bit blocky even at 4k when u orbit around things. I usually use Indistinguishable and MKV for output settings in OBS.
@MatthewBrennan3 ай бұрын
Ooooh good point - I don't have much experience with OBS, I'll look into this. thanks!
@GrahamHarrisonAlways3 ай бұрын
Awesome stuff as usual. I'd love to see some of my favorite places point cloud embedded in acrylic by laser etching perhaps? Embedded in glass?
@MatthewBrennan3 ай бұрын
I've seen some cool examples of the glass/crystal interior laser-etching.... it seems to work well for objects - would be curious to see how a space looks.
@rajendrameena1503 ай бұрын
What is the point of photogrammetry if you had to sculpt manually, just photograph from 8-10 angle and prepare mesh from there and project textures from images. Why such time consuming photogrammetry work which need so much favorable condition and even fails at glossy and transparent surface.
@MatthewBrennan3 ай бұрын
Good question - the point would be if you wanted to get a mesh that was as close to the "real" object as possible - with hand modeling, you're almost always going to be approximating unless you are working from engineering or design drawings. Most of the photogrammetry I do is for cultural heritage/historic preservation purposes, where the digital model needs to be as exact as possible to the original, and often not of such "simple" objects as a cup - but instead complex organic forms like a sculpture of a human or animal (or both, like a centaur or faun!) form. In those cases, it is much faster and more accurate to use photogrammetry and clean up by hand, than to sculpt from scratch using reference. You will almost always have to do some manual editing or cleanup with photogrammetry, if you want a good "clean" mesh.