"Postshot Point Cloud Density Experiment" 3D Gaussian Splatting

Hello my friends on the internet. If you love 3D gaussian Splatting, stick around and get hypnotized by splats and floaters!
This experiment is to test how a dense point cloud affect 3D gaussian Splat training.
The idea is to use a dense point cloud to assist in converging splats faster. Will it work or will it be a huge waste of time? Let's find out my friends! Here we go!
The left side is a dense point cloud and right side is sparse.
Here is the training in realtime. You can see. The dense point cloud side converges faster. It is approximately one splat per point. The sparse side is blurrier. Look at the text Philtrust Bank and the pillar details!
This took less than 30 seconds. Normally without a dense point cloud, details starts to be clear much later depending on the scene.
Further training, will eventually even out both sides .
Splats, splats, splats are coming. Hey this is just a test. Chillax.. We gonna delete them later ok?
Hope you enjoy this experiment and see you next time!
Software: Adobe Lightroom, XNView, Reality Capture, Metashape Pro, Postshot
Edit: Davinci Resolve
Music: Suno.ai

[@CodyCha]

Who cares about Gaussian splatting when the closed captions jingle is this lit

[@DaveDFX]

Thank you!! Glad you enjoyed it

[@Mranshumansinghr]

Love the Song. Nerdy!!!

[@AaronCederberg]

This is the fantasticest of things

[@DaveDFX]

Thank you

[@egalegalegalegal]

Omg I love the song, which site did you use for it? ❤

[@DaveDFX]

Suno.ai is awesome. And thanks! Cool to learn some CG and dance!

[@torquebiker9959]

@@DaveDFX LOL, that's genious 🤣🤣

Nice video, but how do you put more points on your gaussian splatting ? Try it and stil have low point count. Thx

[@DaveDFX]

I used Metashape Pro or Reality Capture. to generate a denser point cloud..

@@DaveDFX Oki, thank you. I'll try it with Meshroom, I have only this one in my hand right now. I'll come back here if I have other questions ;). Thx again.

[@JorgeRodiles]

how did created the song? LOL??

[@DaveDFX]

i used Suno Ai for the song :) It's fun

[@alejandrocapra8654]

Nice!

[@DaveDFX]

Thank you! Cheers!

[@haoouyang8257]

Amazing! Can it change to 3d mesh and import to 3d software to do further editing?

[@DaveDFX]

As of now, it's only point cloud. There are open source research to mesh splats. github.com/francescofugazzi/3dgsconverter . github.com/Anttwo/SuGaR . If i need mesh, I would usually use the photogrammetry for now.

[@Nickfies]

Doesn't really matter because they have a point seeding strategy. Read the paper

[@DaveDFX]

This initialize faster cleaner with less floaters in Postshot (beta). Also I can get a fast visualization ( takes like a minute only ) so i can save out a PLY and do a camera previz while the project is training. In the past, I have to wait hours for large environments to get a good preview. Eventually the splats prunes depending on the spat density settings. Newer beta is much faster and use less VRAM.

[@heatflash184]

Good point​, I seemed to have been a bit salty haha@@DaveDFX

[@DaveDFX]

Salty is good. Better than sour haha.. it's all good.. there's a lot of experimentation and the software is evolving fast. Join the Postshot Discord if you are interested in Photogrammetry and 3d Splatting.

[@robertglas]

@@DaveDFX is the postshot discord still up? Can't seem to find it

[@JorgeRodiles]

LoL THE SONG!

[@DaveDFX]

Thank you! It's fun haha

[@artiexus]

I've never seen a tutorial that sang its voiceover, that's a nice touch! Anyway thanks for the experiment, I will try using denser point clouds in RC! I wish there was a way to automate cleaning up the glitchy splats, though. I've seen papers that figured out a way to do it but I guess it hasn't been implemented into software yet.

[@DaveDFX]

I may be the the pioneer of singing tutorials haha :) Thanks and enjoy. It's still a new tech and we are waiting for the apps to support this native. Postshot have manual clean up tool. Also tools like Supersplat >> playcanvas.com/supersplat/editor

[@gaussiansplatsss]

Can I open postshot and edit splats just what you do without a dedicated graphics card?

[@DaveDFX]

You will need a Nvidia GPU. Splats uses VRAM so the higher the better.

[@raulmacedo6634]

Amazing! How did you use the dense cloud in postshot ?what software did you use to generate it ?

[@DaveDFX]

In Reality Capture or Metashape. I'll make a tutorial on that.

[@kuyrem1]

@@DaveDFX yes please my lord 😀😀

[@shunleyzhang]

so, the dense one and the sparse one finally reach nearly same quality? the only benefit to use dense point cloud is it converges faster? and I find in the final part, editing floaters is extremely important😂

[@DaveDFX]

Yes . Dense is just faster and uses more memory. Both sides will self prune eventually depending on splat settings. I use this for quick preciz.floaters here cuz the data set was not that good in coverage.