Road map of Gaussian Splatting possibilities

  Рет қаралды 7,705

Olli Huttunen

Olli Huttunen

2 ай бұрын

Instead of just spinning the 3D model, I wanted to look ahead and think about how and where we can actually use these Gaussian Splatting models at the moment. I wanted to draw a road map about it. I also go through couple of apps for example the Scaniverse app for iPhone that can now generate Gaussian Splatting models locally on smart device.
Here is my interactive 3DGS road map:
bit.ly/3dgsroadmap
Map was implemented with Spline and you can also find it in community page where you can mix it:
app.spline.design/community/f...
Here is Ghost Wall FX experiment:
bit.ly/ghostwallfx
And here Ghost Wall Game experiment:
bit.ly/ghostwallgame
Jaewon Lee's repository for Gaussian Splatting papers
github.com/Lee-JaeWon/2024-Ar...
#gaussiansplatting #spline #postshot

Пікірлер: 70
@Olstman
@Olstman 23 күн бұрын
Brilliant! Thanks For such well organised roadmap in the world of Gaussian Splatting
@360socialms
@360socialms 2 ай бұрын
Excellent explanation !!, didactic and updated, which demonstrates research on the subject, a summary that cannot be found in other channels.
@Tactic3d
@Tactic3d 2 ай бұрын
Cannot Say better! Exact same thoughts
@360_SA
@360_SA 2 ай бұрын
Great job. Thank you for bringing the old way to see you, and the way you talk is amazing. I wish if you could show how you make the ghost room and by pressing g it goes to the normal room
@user-bg7ns2mb3z
@user-bg7ns2mb3z 2 ай бұрын
Ollie, I love your explanations and have followed your journey with Gaussian Splats since you started. Keep up the great work and coverage. Greatly appreciate your innovation and insight. Keep it coming!😄
@davidarhodes3d
@davidarhodes3d 2 ай бұрын
Great overview, Olli!
@RelicRenditions
@RelicRenditions 2 ай бұрын
Thank you for another great production. Well done, Olli.
@tosolini
@tosolini 2 ай бұрын
Bravo Olli for a great practical video about one of the hottest 3D tech of the moment
@AndreasMake
@AndreasMake 2 ай бұрын
Awesome Olli!!! Thanks for sharing your view on the practical applications and use-cases! 👌🙏
@badxstudio
@badxstudio 2 ай бұрын
Super informative brother
@OlliHuttunen78
@OlliHuttunen78 2 ай бұрын
Thanks a lot! I’m just watching your latest podcast with Winbush and EJ. Great episode!
@mat_deuh
@mat_deuh 2 ай бұрын
Thank you for this :)
@alpaykasal2902
@alpaykasal2902 2 ай бұрын
Great work Olli, your content never fails!
@christian-schubert
@christian-schubert 2 ай бұрын
WOW. This has probably been the most helpful KZbin video in quite a while. Gaussian Splatting has always been a sealed book for me (yes, that is entirely on me, I could've researched the material, it's clearly out there). This has the potential to revolutionize Real Estate visualization! Just gotta figure out a) sustainable workflows on non iOS devices b) a way to circumvent subscription models - I know, "ownership" is a term of a bygone era, but I hope there's at least a way to download and OWN your CREATIONS (i.e. freely integrate them into your own site on your own terms) Any chance you'll follow up with a detailed video on this? 😉 Thanks for sharing, again, this was REALLY insightful!
@ns194
@ns194 2 ай бұрын
Thanks for putting this together, Olli. I'm on this journey with you, deploying splats in an educational setting!
@imaginingPhysics
@imaginingPhysics 2 ай бұрын
Thanks for these videos. Keep them coming!
@hanskarlsson3778
@hanskarlsson3778 2 ай бұрын
Exactly what I was looking for!
@DaveDFX
@DaveDFX 2 ай бұрын
I'm using it in my VFX projects. Future is bright for 3DGS.
@AndresArosemena
@AndresArosemena Ай бұрын
I just watched your tests on your channel, very cool stuff. Have you shared somewhere else your vfx shots where you used this technique?
@DaveDFX
@DaveDFX Ай бұрын
@@AndresArosemena I'm on NDA for that project until I't released so I can't show anything. Will be using 3DGS and Photogrammetry for digital environmental work and in NukeX Compositing.
@AndresArosemena
@AndresArosemena Ай бұрын
@@DaveDFX looking forward to when you are aloud to share them!
@user-ig2hv3tr1i
@user-ig2hv3tr1i 2 ай бұрын
Great overview! Thanks
@andybrice2711
@andybrice2711 2 ай бұрын
Scaniverse is amazing. I consistently find it to outperform Polycam despite being free.
@DaveDFX
@DaveDFX 2 ай бұрын
Yes It's awesome ! No need to upload to cloud and the realtime points in the viewer when scanning helps a lot.
@andybrice2711
@andybrice2711 2 ай бұрын
​@@DaveDFX I've just tried the new Gaussian Splatting feature and it's incredible. And that's being processed *on a phone!*
@jeanm7115
@jeanm7115 2 ай бұрын
Great presentation. Thank you very much. Hopefully technology develops fast so we can use a proof version of such solutions. Personally I would be grateful when Blender can clean up the .Ply model coming out of Spotshot. I then add my lighting or other objects inside an interior model for further use in 3Dvista .Glb file. Thank you once more.
@surfkid1111
@surfkid1111 Ай бұрын
Very valuable video, thanks.
@brappineau4161
@brappineau4161 Ай бұрын
This is by far the most useful video out there when it comes to gaussian splats. I can't wait until I can convert to mesh environments to optimize for standalone viewing. Isolating movement for 4D recordings and pasting into those for playback.... this would be amazing for capturing loved ones & moments
@user-ho4ym2du2k
@user-ho4ym2du2k 2 ай бұрын
Thanks for overviewing the splatting world!
@remedytee
@remedytee 2 ай бұрын
Great overview! Much appreciated!
@grafpez
@grafpez 2 ай бұрын
I have a feeling 3DVista is going to implement Gaussian Splats hopefully soon down the track ;-) thanks for your fabulous contributions
@punio4
@punio4 2 ай бұрын
Amazing overview Olli. Hopefully I can get aboard all this before everyone else does :D
@XaviSerrat
@XaviSerrat 2 ай бұрын
great video as always, thanks for sharing your experiments and insights
@simonkennedy6116
@simonkennedy6116 2 ай бұрын
Thanks Olli, there are some things here I hadn't heard of
@CornuDev
@CornuDev 2 ай бұрын
Thank you for sharing
@stagrei8233
@stagrei8233 2 ай бұрын
Thanks for this insight
@irrealix
@irrealix Ай бұрын
We have released a cool plugin for After Effects to work with GS3D
@Zac33544
@Zac33544 2 ай бұрын
Hi Olli, great work as always! You were a big inspiration in my undergraduate dissertation on a comparative study between photogrammetry and Gaussian splatting, I’m curious to hear your ideas for Gaussian splatting in forensic science i.e. for use in police investigations and in courts.
@onvacation960
@onvacation960 2 ай бұрын
Great video! Just finished my thesis about 3DGS for Virtual Production and came to a similar conclusion. Use in VFX may be imminent. Note, that VP does refer to all real-time XR applications in the entertainment industry, not only LED wall ICVFX. A paper that has blown me away was the Gaussian Codec Avatars by Meta. Also a great prospect for future VP.
@user-dv3pi8co2x
@user-dv3pi8co2x 2 ай бұрын
I hope you can share more experiences related to 3DGS and virtual production
@kaxoxinho
@kaxoxinho 2 ай бұрын
Hi Olli! Amazing work! Btw INRIA is also adding VR support in their Github repo
@unn357
@unn357 2 ай бұрын
you can also edit the .ply file in blender
@buroachenbach703
@buroachenbach703 2 ай бұрын
Great video, Ali, would you consider making a spine tutorial for GS creators - I have played with it, but I feel I’ve not comprehended it completely. I’m sure there are a few tricks that you can teach us all with spine.
@tvguide4khv
@tvguide4khv 2 ай бұрын
Love your English :)) thanks for wrk!
@Leyverse
@Leyverse 2 ай бұрын
LOVE IT
@niks.3388
@niks.3388 2 ай бұрын
huge thx
@massonnicolas2339
@massonnicolas2339 2 ай бұрын
Amazing Thx a Lot 🤯
@bobbykingAiworld
@bobbykingAiworld Ай бұрын
That is real cool.
@boskobuha8523
@boskobuha8523 2 ай бұрын
Bravo!
@jayes5066
@jayes5066 2 ай бұрын
we need like an instagram for splatts. probably be best for VR/XR viewing.
@iainisbald
@iainisbald 27 күн бұрын
I wonder if you could create High Dynamic Range Gaussian Splats and use them in 3D modelling workflows to replace traditional HDRIs.
@sharpvidtube
@sharpvidtube 2 ай бұрын
I hope Scaniverse comes to android.
@madsvadsholt5324
@madsvadsholt5324 2 ай бұрын
Thanks for all your research! How far away do you think we are from animating splats?
@jac6350
@jac6350 21 күн бұрын
Do you think Spotshot will have a connection with others softwares like After Effects in the future: Da Vinci Resolve , The Foundry Nuke or Autodesk Flame ?
@Lucky-ui7dh
@Lucky-ui7dh 10 сағат бұрын
Is it worth it to learn Postshot over using Polycam? Can you tell a huge difference? Thanks Olli.
@OlliHuttunen78
@OlliHuttunen78 2 сағат бұрын
Polycam is easy and with it you can create certain quality of Gaussian Splatting models. With PostShot you see how the process go and you can train much better quality models because you are able to tweak the controls and train you model much further than the default setting that Polycam offers.
@beksf
@beksf 4 күн бұрын
i think you are missing the piece where the video output of lumia can be fed into stable diffusion to create AI videos
@brappineau4161
@brappineau4161 Ай бұрын
Also I noticed your UE5 character interacting with the car. Did you figure out mesh conversion?
@failerstone7100
@failerstone7100 Ай бұрын
I reached out to the team of Postshot. I asked there is any possibility to convert a e57, rcs, ryp ---> to a ply. They said thei are planning it in the future. Here is my question. Do you know anything to connect the gaussian splatting with a LIDAR Scanner. Normally you get an ugly Pointcloud where you dont really much see anything, but if you could combine these technologies, that would be insane. Do you know anything that is already advanced enough to process a e57 file to a nice 3D gaussian splat model? Thanks!
@KORTULSGAMEROOM
@KORTULSGAMEROOM 2 ай бұрын
Thx! How do you adjust Splat Scale in Spline for your models imported from Postshot? When I import the model in Spline from Postshot each splat is tiny, like a point, and the resulting shape is semi transparent. In Postshot there is a slider to adjust this called Splat Scale. In spline it is imported as 0.1 scale instead of 1.0 like in Postshot for me.
@KORTULSGAMEROOM
@KORTULSGAMEROOM 2 ай бұрын
Hm, this seems to be fixed if PLY is exported from new 0.3 Postshot instead of 0.28. However, splats look significantly better in Postshot still - in Spline now the individual splats seems too big resulting in flioating artifacts. I'll try retraining with a new version.
@sirens3237
@sirens3237 2 ай бұрын
Thanks Olli thats great, I know that Nvidia Omniverse has plans to add it. Dont have a timeline for that....
@whatisrokosbasilisk80
@whatisrokosbasilisk80 2 ай бұрын
What music did you use, it's a bop
@obvioustruth
@obvioustruth 2 ай бұрын
Excellent video 🙂👍
@kaiselone
@kaiselone 2 ай бұрын
I would need to use this technology in the fields of engineering and architecture. Being able to take measurements and work with it using CAD software. Does something like this exist?
@briandavis4866
@briandavis4866 2 ай бұрын
while the "splatting" isn't available, the pointcloud can be loaded in certain CAD/Modelling programs - I use CloudCompare to convert these to LAS points see loading in kzbin.info/www/bejne/nHTXgIiqiqiGo68
@kaiselone
@kaiselone 2 ай бұрын
@@briandavis4866 Thanks a lot!
@nitisharora41
@nitisharora41 19 күн бұрын
@jpjpomxyz2319
@jpjpomxyz2319 Ай бұрын
Please remove this painful background music. It is wortless, and ruins the quality of the video. Thank you.
@brettalexander.studio
@brettalexander.studio Ай бұрын
Calm down. 😂😂 Not nearly that serious.
My observations on Gaussian Splatting and 3D scanning
16:32
Olli Huttunen
Рет қаралды 21 М.
3D Gaussian Splatting! - Computerphile
17:40
Computerphile
Рет қаралды 114 М.
Is it Cake or Fake ? 🍰
00:53
A4
Рет қаралды 19 МЛН
Watermelon Cat?! 🙀 #cat #cute #kitten
00:56
Stocat
Рет қаралды 41 МЛН
Sprinting with More and More Money
00:29
MrBeast
Рет қаралды 185 МЛН
How to transform any 360-degree video into 3D (using photogrammetry)
14:24
6 Best Unreal Engine Plugin [FREE]
6:02
Boundless Bite
Рет қаралды 6 М.
[CVPR'24 Highlight] Gaussian Splatting SLAM
7:28
Dyson Robotics Laboratory at Imperial College
Рет қаралды 21 М.
Jonathan Blow on Z Buffer Rendering And World Space
20:30
Jonathan Blow Highlights
Рет қаралды 4,8 М.
Mind-Blowing 3D Gaussian Splatting On Your Phone!
14:22
Reality Check VR
Рет қаралды 8 М.
The Best 3D Scanner App for Android and iPhone in 2024 - KIRI Engine App Features Overview
10:44
3D Scanning Changed Again. NeRFs Are SO Back!
7:06
Creative Tech Digest
Рет қаралды 11 М.
Photogrammetry / NeRF / Gaussian Splatting comparison
23:30
Matthew Brennan
Рет қаралды 150 М.
i like you subscriber ♥️♥️ #trending #iphone #apple #iphonefold
0:14
Неразрушаемый смартфон
1:00
Status
Рет қаралды 1,3 МЛН