Generate Gaussian Splatting models on our own PC with Postshot!

Finally we have proper desktop software to generate and train 3D Gaussian Splatting models on our own computer. There is no need to send your images or scanning videos to cloud services. If you have decent RTX level graphics card you can make Splats and NeRF's on your PC with Postshot software. And it also works with After Effects!
Postshot is made by a Jawset company from Germany and you can download it from here:
www.jawset.com/
#gaussiansplatting #3dscanning #aftereffects

[@MrRuumi1]

Man I love that Olli really focuses on GS and not everything random. It makes your expertise in this matter that much deeper than any other youtube channel I've watched on this matter

[@kenoben007]

I was waiting for something like this, thanks for the video !

[@felipb.a7969]

I'm amazed by this software and want to install it when I get home 🙌🏼👍🏻

[@jonva13]

I am blown away. How have I missed the conversation on this topic? Great video.

[@akisey1]

Thanks a lot Olli for this video! I know what I'm going to do this evening.

[@Lucky-ui7dh]

Thanks Olli, I've been trying to make video edits using gaussian splats recently, so this is awesome. Right now I'm using Polycam -> UE5 -> Davinci Resolve, but i will check this out!

[@violentpixelation5486]

Top notch, as always. Thank you Olli! Greetings to Finland.

[@KyleNB]

Just came across your channel, love your work.

[@360Pros]

Thanks Olli, I've liked and subscribed :) Been experimenting with photogrammetry for about seven years and heard of neRF a few years ago. Now with the advancements of GS and development of tools like the one you're showcasing in this video, I'm ready to finally start experimenting with GS and neRF!

[@tribaltheadventurer]

Thank you for your consistently great work and contribution to the community Olli

[@gl.3d]

This software is amazing and very easy to use! It saved me a lot of work time. Thank you so much for your videos, they are helping me a lot!

[@jap6666]

Thank you for the tutorial! Question, does in teed to be a RTX Card? I have the 3070 ti and the Jawset crushes on start telling "No suitable display device found"

[@remedytee]

Thanks for sharing!

[@olofhaggren245]

Kitos Olli. once again you bring us geat value and insperation!1

[@Data-Fusion]

Thanks for the video, the new era of 3d models is aweson, i gonna to create a loot of things em medical care

[@Malakair]

Great video!

[@joperez1980]

Thank you Olli!!!

[@jorcher]

thanks man! that was very helpful. keep going! :)

[@robmulally]

This is very timely

[@nhentschelo]

thank you for your videos! :)

[@saemranian]

Wow, such good news 🎉❤

[@Kyus2001]

You should be able to embed hotspot within the render. Point and click advertisements.

[@BEARBROS]

Hi Olli, huge big up for the work you bring up on your channel! This software seems to be game changer for Gaussian Splatting but, i have a question : is there any possibility to convert the PLY you extract into a 3d mesh? Maybe with reality capture?

[@OlliHuttunen78]

Thank you. I doubt that a splat PLY file could easily be converted to a 3D mesh file. But it would be great and practical. And if it could still be done without uploading the file to the cloud service.

[@richyrooify]

Hey Olli great video! Do you know if Postshot works with 360 camera footage directly or do you still need to break the 360 footage down into single frames before import into Postshot?

[@OlliHuttunen78]

Postshot does not yet support 360 images. But there are several requests for it on postshot's discord. Perhaps Jascha who is the developer of this software will add this feature in it in the future.

[@richyrooify]

@@OlliHuttunen78 Great. Thanks for the update Olli! Much appreciated.....keep up making great and insightful vids:)

[@javitang1]

Thanks for the video.

[@dillonthomas5495]

THIS IS INCREDIBLE! I've been very closely watching the development of gaussian splats since I first heard about them late summer last year. I somehow missed this video (because I've seen your others). I'm aware of at least one dev working to capture volumes of actions, and exporting animated splats (it's actually volumetric video - or 6DOF video). Are you aware of any devs or tools/plugins that can take a series of videos from cameras arranged to capture a volume and able to export an animated splat that you can view in a vr headset? ALSO - are there any viewers that you're aware of that are available for public consumption to allow for viewing these static splats (much less viewing the animated ones)?

[@rou101]

Muchas gracias!

[@jortchi]

Hi!! Nice Video! One question, can I export a splat .ply using Postshot?

[@OlliHuttunen78]

Yes you can.

[@timo1949]

it can take Sora video as input and be used as text to 3D which is awesome

[@Deathbynature89]

Thankyou

[@gunzshy]

thanks so much. you are definitely one of my spatial gurus ...got any msg boards or discord channels that focus on this?

[@buroachenbach703]

Hinolli, Great Video. How long does the training take on your machine and are the results the same as with the older method? I mean quality wise. Does it provide a plug-in for AE or is there another kind of link between the Programms. Thanks… Kai

[@OlliHuttunen78]

If I let the training progress go to the 30K iterations, it can take from 25 minutes to 30 minutes. I have an RTX 3070 graphics card with 8Mb vram memory. So the time is practically the same as before with Inria's original source code. The After Effect plugin comes with the Postshot installation. It's very simple. You can launch the Postshot application through it.

[@buroachenbach703]

Hi Olli, Have you tried the latest version is 0.2? Did you have any problems with that. I download it today and I’m getting lots of crashes when loading image sequences. It only worked one out of 10 for me and then it crashed while doing the camera tracking. 😕

[@wrillywonka1320]

U should make a video on how to use it in after effects

[@felipb.a7969]

💯👏🏻👏🏻👏🏻😲🙌🏼👍🏻🍾🥂🌟🎉✨️thanks

[@niks.3388]

thankyou

[@trdavid567]

Is it possible to convert the gaussian splat to 3D mesh like obj or fbx ?

[@Waffle4569]

About how much VRAM does it use for a given resolution? Have you /when have you run into a VRAM limit?

[@user-sf1gl1hg4y]

Thanks a lot for the video Olli! I have to try it out, now the only thing missing is a webview that lets one upload and embed models on a website! is there already a solution for that?

[@OlliHuttunen78]

Yes. You should try Spline. In Spline editor you can import PLY file and create your own web viewer with that. And it is very easy to embed your web pages.

[@boskobuha8523]

I tried to generate 3dgs with postshot and I am not satisfied with the processing speed and the result. I used a recording of a path through the forest about 50 m long. I used the photos I took with the Pix4d photogrammetry software. I uploaded about 500 photos for processing. The spread was supposed to last 9 hours. I stopped the process.Later I only took 50 photos and I was done in 2 hours, but I got a huge cloud of points rather blurry. My cpu is i9 11th generation and gpu rtx 3070ti, RAM 64GB

[@idcrafter-cgi]

does it work on linux with proton and enabled NVAPI?

[@realzanark8914]

He did not send verification e-mail to register in Photoshot.

[@Aero3D]

Have you messed with Splat Density or MaxFeaturesPerFrame? Any data?

[@dronearon3085]

Tq bro ..i m testing now

[@boskobuha8523]

Bravoo!

[@johntwelve8763]

Unfortunately, that only seems to work nvidia GPUs.

[@ryansears3966]

Could you have put the text behind rhe bench in that After Effects scene?

[@mrksdsgn]

How big are the ply files on average?

[@OlliHuttunen78]

It varies a lot. Depending on if you let the training progress to the end up to the 30K iteration step, the PLY files can be over 900Mb, but if you calculate some single object from which you crop the environment off, the file size can be something more convenient than, for example, 25Mb.

[@pedromachado6253]

Hum... now we can use a bad rendering sequence with 260 frames, like your blender scene, and created a radiance virtual viewer in this software!

[@sircretos7780]

Question for you! How do you know if it is working/broken? Mine has been running 45 minutes and displays nothing.

[@gaussiansplatsss]

is the maximum image I can import is of total of 133 only? Can it be greater than that?

[@OlliHuttunen78]

Sure. You can import as many images you want. But it of course takes more time to process them. Check out my other videp where I explained this more detailed: kzbin.info/www/bejne/ppemi5iAfcudjNUsi=NYBmOa7HF6j4YQ63

[@Falkonar]

Can not figure out how to make textured FBX mesh at the end...

[@OlliHuttunen78]

Unfotunately you cannot do FBX model out from Gaussian Splatting models. GS models are like volume models. They are formed from point clouds. They are not surface models which are formed from polygons. FBX are surface models.

[@Falkonar]

@@OlliHuttunen78 But I've seen some scene in UE5 and they look like 3d scenes with textures. I export .ply to Blender 3.6 just nativley it's looks like points and then to c4d in alembic to create volume mesh. But do not understand how to transfer textures. As I understand there is no textures, but some plates (splats) maybe I can bake it somehow to UV ?

[@Falkonar]

but there is no UV... Unreal and Unity run it like ply format? Donwloading UE to check this out. I just trying to generate AI 360 images from AI tool ComfyUI and then make Nurf from it to get 3d model ... ))

[@OlliHuttunen78]

There is one way. If you make your model in Luma AI service. It will mainly now create a Gaussian Splatting model. But it generates also the surface model out from it. You can download it in GLP and open it in blender with textures. But it will loose all transparent and reflective qualities that you might have on your model. And the mesh structure is quite bad. It is very broken and might have lot if holes in it. But it is one way.

[@cemberendsen4297]

How can you import it into after effects? Don't see any option to do so

[@OlliHuttunen78]

Installation comes with the after effects plugin. Go check the effects in AE and search effect called postshot. Then you just load with it the .psth file that you have trained in Postshot program.

[@CameronCrichtonVFXArtist]

Is it possible to create web based interactive 3d scenes with Postshot as you would with Luma AI?

[@OlliHuttunen78]

Yes it is with Spline service. You can upload PLY file into spline and create your own web viewer with it. Of course it is not as simple to create as in Luma AI but you have much more control how users can rotate and watch your model and it is very simple to link or embed to your webpages.

[@dekahobby]

​@@OlliHuttunen78 do you have tutorial about self hosting splat with spline?

[@OlliHuttunen78]

@@dekahobbyPerhaps I could make a video about that process. It is good idea.

[@dekahobby]

@@OlliHuttunen78 many thanks...

[@waino84]

Is it possible to create 3D mesh from this point cloud?

[@OlliHuttunen78]

Not in Postshot but you should check out Kiri Engine app new feature where you are able to create mesh from Gaussian Splatting model.

[@ManishKumar-885]

can we import this in blender 3d software?

[@OlliHuttunen78]

Not very well. There is only one unofficial addon in github wich can read Gaussian Splatting PLY in Blender. It is very slow and runs with cycles engine.

[@tony3dartandmore231]

I've tried to install the Beta-Version of postshot; it crashed at the installation. I don't know why.... I've tried it many times, but it crashed...so sad...what am i doing wrong??

[@arunachalamselvaraj1391]

i faced the same problem, after that , i clean my c drive using ccleaner , all works well .

[@Sueko2009]

Doest work with AMD graphics card

[@eddiej.l.christian6754]

Can this be converted to meshes?

[@OlliHuttunen78]

No. Not at least with this program but Kiri engine has new feature that can convert Gaussian Splatting to mesh. Check that out.

[@eddiej.l.christian6754]

@@OlliHuttunen78 I bet Mesh Lab could convert these...

[@OlliHuttunen78]

​@@eddiej.l.christian6754 I'm not sure is Mesh Lab able to open Gaussian Splatting PLY files, but it is worth to try. Tell me if it possible.