Generate 3D from ANY Video! │Gaussian Splatting Tutorial w/ Postshot

[@RIKAAR_Ambient]

2:49 The Desktooooooppp :D Holy

[@Gorongirl]

9/10 videos don't give you the damn settings for optimal capture. Thank you for doing this right from the start!

[@bryanharrison3889]

Gaussian splatting is something that's been around for a hot minute already. Its just much better now than it was when it first hit the world.

[@derek2593]

Holy crap, this will work better than mirrors to trim the back of my neckline.

[@plorks445]

Great video. Very cool tech. It would be nice to see the geo without the texture on it as well. Texture can make the geo look more detailed than it really is.

[@adam1st-]

Dude, this is everything I've been looking for! Thank you for showing me this. God bless to you my friend!

[@flinfaraday1821]

You mean you have no abilities and looking for something to do everything for you?

[@adam1st-]

​@@flinfaraday1821 Precisely, and the exact reason why you're watching this video

[@1airdrummer]

I did NOT expect that voice to come from that face. lol Good stuff dude! Thanks for sharing!

[@johngate70]

me too.

[@doclee8755]

Don’t be racist.

[@johngate70]

@@doclee8755 Such narrow mindedness.

[@yablomas_]

@@doclee8755how were they being racist?

[@jozsefilyes3533]

Looking forward to Davinci Resolve version

[@N1ghtR1der666]

do you have a video on the process of going from a splat to a more standard model in blender?

[@adamfilipowicz9260]

how do I make a mesh from a splat?

[@MrMadvillan]

the whole point is that you don’t/can’t. that’s why it’s been around for a while but no one does anything with it. it’s the graphine of the cg world

[@iamsushi1056]

That’s coming with 4D splats

[@TacticsTechniquesandProcedures]

The meshes tend to be vert heavy with bad normals. Its not really useful for gaming as claimed unless you consider adding mesh fixing to your modelling workflow "good."

[@PatrickHoodDaniel]

Do you think this would work with existing city flyovers for a city model? I'm sure drone footage would be good, but I'm curious because there are so many lens distortions that may get this wrong. That brings up another question, lens, what mm in terns of macro vs fish eye or in between. Wonderful video!!

[@JustinCiriello]

Very nice. It would be really cool if we could involve this in a 3d printing workflow.

[@AlternativeCutsStudios]

It's not just about the 3D itself but how it is rendered. You can convert it to 3D or simply use photogrammetry, as they are the same in the initial stages. Gaussian splatting also estimates where the cameras are, just like photogrammetry does. However, the difference lies in how the final result is rendered. When you convert it to a regular 3D model, you lose all the features like dynamic reflections, transparency, etc.-basically everything that makes Gaussian splatting so great

[@fablewalls]

@@AlternativeCutsStudios Yes, I noticed this myself - however as a method to produce a 3D model that you could shrink wrap a mesh over to create an animatable model - I think it will be great.

[@iandvan8698]

Year after year that awesome Black Mixture dude with awesome voice helps me tremendously with technics, methods, explanations over and over again, thank you Black Mixture dude

[@radicant7283]

You didn't actually put a link in the description though

[@artmakesascene]

i'd love to see this used on older photos (or multiple photos) to recreate a place from 30 or even 60 years ago (or older) Thank you.

[@macrumpton]

A couple of questions: Is it possible to derive a 3d model from a splat, and is it possible to insert a 3d model into a splat?

[@MamadMoghadam93]

You made a nice video but why click baiting people with that thumbnail...

[@MamadMoghadam93]

@@iresineherb7 oh so gaussian splitting can give u that sort of topology? Or all the parts as separate mesh?

[@FritzHugo3]

Very impressiv!

[@RarendipityGames]

Educational and interesting, as usual. 👍 I'm curious about splats to meshes, and how they compare to photogrammetry. Any difference?

[@aldermediaproductions695]

I was wondering the same. My experience with photogrammetry has been extremely 'meh.' It literally can't even replicate a straight line. This process appears to be significantly better but of course I haven't tried it yet.

[@SimStig]

@@aldermediaproductions695did you try it, the preview was so misleading showing the car triangulated

[@malcolm341]

@Black Mixture Hi, can you tell me what phone you used to film the fire hydrant? The video quality looks really good, I'm not happy with my iphone 12 at 4k 60, the footage always looks really bad.

[@TorQueMoD]

Man, movies are going to be legit in another 10 years. Imagine studios filming an entire movie and then converting it into a 3D model and placing you in the movie with VR.

[@sonicsnake44]

That would be amazing.

[@maximumblackness]

@@TorQueMoD I love how you think 👍🏿

[@webinatic216]

I hope in 10 years we will have good movies. Don't care how they are made.

[@tommiemcswizzle1485]

10 years? This will be happening in 2

[@tommiemcswizzle1485]

@@webinatic216 Couldn't agree more.. even if production techniques change, story will always still be king

[@SteveHill68K]

Could this be used to scan a room instead of a single object?

[@Sandor3D]

gaussian splatting is a lot of fun but super experimental. I used it for a client music video but I will promise it is gonna give you headaches for sure. I used luma ai and UE5

[@MrCaesartheman]

dude thank you

[@zonoscopePictures]

Is the video posted somewhere? I’d like to see it!

[@SlyNine]

This was awesome.

[@ryancampbell9425]

Is there any way to get dimensional accuracy with this? or an easy/simple way at least?

[@phoenix-element]

I would definitely like to implement this on future projects. Sidenote: what is the intro song you used? from here 0:53 sounds like Finesto

[@bitmancer_]

It is Nvidia GPU only. Are there other alternative tools?

[@darrinholroyd8203]

Great video, could you 3d print them?

[@directorbinx]

I learned something today 👌🏾

[@paxwebb]

Postshot is Windows only??

[@ibi_sum]

hi! great video... but. how export with texture to sketchfab? o blender? i want share 3d model in my webiste...

[@ibi_sum]

i want create a file similar in lumalabs

[@BigAl444]

I have the Kiri Engine on my phone and it works the same way as this video. If you subscribe to the pro version, you can export meshes, PBR material sets and everything. You can use many features for free.

[@fablewalls]

Isn't Kiri Engine Chinese owned? I guess I'm just worried about having something like that on the same phone I have my banking app on. I have a separate Tablet with nothing attached - I guess I could put that alongside Scaniverse (I like Scaniverse as it keeps the processing local to my computer and doesn't send my data off to someone else's cloud storage and all that means for Ai "training")

[@SnakeTheCowboy]

Postshot does not work with GPUs pre RTX 2060, My GTX 1070 is out of list =(

[@KalkuehlUncut]

You should look into 4D Gaussian splatting. Its animated Gaussian spatting. Thats the future. But I dont think this will come for gaming anytime soon, because it takes a sh*t ton of space.

[@Demoocracy-c7r]

Great video intro, thanks.

[@benjones5799]

very cool, thanks

[@HavingCrumpets]

that delorean model was... special

[@mickeybowles9743]

Without any reading or research, can you make 3D from old videos?

[@mirkoheimburger3026]

Is there a way to "convert" gaussian splat to geometry? Maybe by doing a virtual photogrammetry within the gaussian scene? 🤔

[@biolinkstudios]

MATHS

[@A.eye_101]

ask chatgpt

[@workoholekhh7542]

I can not find post shot. That invitation is expired.

[@Theexplorographer]

Have you tried this with video game footage?

[@nunosousa154]

Hey, love the content, im having some difficulty installing the blender addon, is it compatible with blender 4.1?

[@BlackMixture]

Hey Nunosousa! It doesn't work on 4.1. Try downgrading to 4.0.0 and it should work there

[@AdrianoBla-g2l]

Marvelous Tech!

[@metascopeinitiatives2550]

Really cool.

[@Sven2157]

When this is imported into Blender, I assume it can be converted to a mesh, yes?

[@OlliHuttunen78]

Great video. Good results!

[@sephirothcloud3953]

Sadly there isn't any converter from guassian splatting to the classical mesh geometry, so the items can't move, limited to still life videos

[@AlternativeCutsStudios]

It's not just about the 3D itself but how it is rendered. You can convert it to 3D or simply use photogrammetry, as they are the same in the initial stages. Gaussian splatting also estimates where the cameras are, just like photogrammetry does. However, the difference lies in how the final result is rendered. When you convert it to a regular 3D model, you lose all the features like dynamic reflections, transparency, etc.-basically everything that makes Gaussian splatting so great

[@FrankYoutube-lz4mk]

I don't like the registration process, it even fails on my password (from the firefox password generator.) .. so I could not test ... It's a pity.

[@nm-com]

Is there an app that just stabelizes cameratracks in videos using a gaussian splatting algorithm?

[@fredrikfarkas]

This might bring some light to the jfk-recordings

[@Rick1234567S]

I don't suppose you can animate the characters. Looks like one mesh. Not useful for animation. Cool though. But what is it good for?

[@maximumblackness]

Dope Video!!!

[@BlackMixture]

Aye thanks!

[@ThatGuy_33]

Is it possible to export these splats as a standard 3d model.

[@verteyetfel]

am i right in thinking this is what lumalabs luma app does or is it nerfs?

[@tadpole3159]

Your car render on the thumbnail had a wireframe though...

[@hydzior]

Yay... photogrametry. It is like 10+ years on the market.

[@NandR]

Photogrammetry is similar but the difference with gaussian Splatting is using model training to fill in the blanks.

[@somename371]

Not the same thing

[@RaimarLunardi]

I mess with photogrammetry for about that time and it never looked so good!!

[@kingofnothing2260]

Can these be converted to mesh for or in blender?

[@williamcousert]

Is there any way to use this data with DaVinci Resolve Studio?

[@pixxmedia3698]

Is it possible to use 360 Videos?

[@efeozturk4364]

what's the difference between this and reality capture's import video option?

[@prehanramsamy6728]

LMFAO... I did not expect to see a person like you with a voice like that. 😅

[@vrguytokyo]

daaang..... things be getting scary for traditional photogrammetrists

[@tamilorejoseph4704]

How do u convert it to a mesh

[@metamuhamudnoah2856]

awesome

[@vanessaperaza2901]

hello will a RX5700 XT work with this? when i try to load Post spots it says Faild to load Nvidia Cuda driver?

[@arudanel5542]

You need a GeForce card, Cuda drivers are an nVidia thing.

[@MarkWazowski]

Doraemon stuff getting real

[@myxsys]

Wish you had actually shown the wireframe of the models produced with this method. I bet they are very messy and will require a lot of retopology to make it work in a pipeline

[@cbnewham5633]

Nice, but my understanding is that it's quite difficult to generate a 3D mesh from this - splats are not really 3D in the conventional sense. Photogrammetry still rules the roost on this (for now).

[@EROSNERdesign]

another great video

[@BlackMixture]

Thanks, glad you enjoyed it!

[@2thecurve]

Can you save image as obj

[@thehandleiwantedwasntavailable]

Small technical correction. The software is not ‘trained’. It performs analysis and provides a result.

[@drdca8263]

How is that a “technical correction”? Seems more like you having a personal objection to a word being used in a particular way. Which, you’re free to have, of course. I think it would be better if you described it as a preference though. That’s what I would prefer.

[@sasnad3]

This is photogrammetry. Videos are also in essence just pictures. 😂😂

[@BlueBeluga_]

No it's not, with photogrammetry you create a mesh and the project a texture onto that mesh. Gaussian splatting creates a coloured point cloud.

[@superfao]

"FAILED TO SELECT IMAGES" ...any idea?

[@Met9171]

Is it on mobile app

[@perseohernandez755]

WOW !

[@MysteryD]

"It runs super fast" Bro you're on a fu**ing RTX 4090, not sure that saying it runs fast is a fair thing to say lol

[@wernerhiemer406]

Too high demands on graphics card.

[@doclee8755]

My man…you’re allowed more than 3 folders on a desktop…just in case you were unsure. 😂

[@AutodeskFTW]

10 years from now we won’t be able to tell what’s real.

[@thesteammachine1282]

Problem is that gausian splatting cant be exported as polygons .(for now) So currently no use in games .( for now ) Make walking simulators great again haha .

[@大支爺]

It won't work when the target is in action. e.g. a moving cat.

[@MATGRAFIX01]

OMG... "Blade Runner" becomes reality.

[@SculptEon]

Don't see how to put it to good use, unless it can be made to 3d mesh

[@ahsookee]

It can

[@GerardMenvussa]

It's very impressive. But I'm not sure I understand the difference between this and photogrammetry :/

[@B.BAKDASH]

In photogrammetry, you can't capture reflective items.

[@Instant_Nerf]

Joke post ? You have seen Gaussian splats and photogrammetry side by side ?

[@rekad8181]

Photogrammetry is real geometry, using polygons. Splatting, uses blurry spots of the original image in 3d space, but there is no 3d polygons.

[@GerardMenvussa]

@@rekad8181 Thanks for the explanation.

[@modelenginerding6996]

I'm going to stop learning new 3D art techniques for a few years until the AI craziness settles a bit!

[@DavidG2P]

I'm trying to create a rough 3D model of a product, from a video shot on a trade fair. The model should be isolated from the background. Will that work?

[@piyman]

"How is it different from photogrammetry?"

[@wearefromserbia9714]

Wish it had support for AMD gpus

[@aaronjaggars]

No mesh

[@davidcapuzzo]

I wish this worked for mac

[@helpsus]

where's the topology? where's the polys? this is photogrammetry, good for fake card board cut out VFX but not for function and optimized models. I don't see this being used in videogames outside of non functional set dressing and skyboxes.

[@BlackMixture]

Great question! It's a little tricky to think about topology when it comes to 3d gaussians because it doesn't work in the same way traditional 3d rendering does. A combined approach would most likely be used in video games, similar to how we often represent different LODs or use bump/displacement maps on simpler topology. The benefit of these is also in their rendering speed, so in theory you can train a gaussian on a video game, then have certain elements benefit from the speed render boost.

[@helpsus]

@@BlackMixture Even LODs of meshes are just simplified geometry that can be written in pure code or computed using 3D CAD software, there's a computational cost and workflow to everything and 3d gaussian splats have to play by these same rules. Textures are often the biggest performer drainers at runtime after geometry, if you can't optimize this with shader logic in a technical artists workflow or through a command line with code like a graphics engineer would to get complete control over the design process in a traceable way like with polys it's just nice ultra realistic set dressing that's only good for one shot VFX and non interactive hero assets. This is unfortunately pretty similar to photogrammetry with artifacts and render layering issues galore, its also by design a pretty destructive workflow that leaves no customization or tweaking of anything. One of the benefits of doing render passes is to avoid this destructive workflow. This seems to be only really good for sampling real shit like photoscans are for PBR textures and single frame non customizable baked-in set dressing.

[@beziergrin]

Please never pronounce Gaussian like Gawshen

[@nathanaelcard]

Please never correct anyone's pronunciation

[@beziergrin]

@@nathanaelcard Don’t be a fool, properly pronouncing someone’s name is the least you could do out of simple respect

[@Traitorman..Proverbs26.11]

@@beziergrin Remember that when you reference München and København.

[@beziergrin]

@@Traitorman..Proverbs26.11 I will forgive people on “Llanfairpwllgwyngyllgogerychwyrndrobwllllantysiliogogogoch”

[@Traitorman..Proverbs26.11]

@@beziergrin Yep. That is a difficult one. It had a shorter name once, but tourism became important. And there is of course this one: Taumatawhakatangihangakoauauotamateapokaiwhenuakitanatahu

[@curtisnewton895]

this is blade runner....yet once you try it you get miserable results

[@philjohnson725]

Dude, you do not sound like you look....lol

[@jeanrenaudviers]

Adobe = Money Pump. NO

[@ahmedihsan1225]

nahh im a pirate

[@jeanrenaudviers]

@@ahmedihsan1225 Should I send this screenshot to Adobe ?

[@BenExell]

Lol this is just photogrammetry but with video. Which has been used to make assets for video games for a long while

[@hameddesign70]

why do people always rebranding successful stuff ? this is called photogrammetry and its around for years sir

[@gotmoresoul]

Because splatting sounds cooler

[@tiaan_va]

Why are you acting like this is a new thing. Gaussian splatting is photogrammetry and it has been around for absolute ages... Also most professional vfx artists won't use this ever, because they have 3D scanners they use to capture their scenes and it's much faster and more accurate

[@soma78]

The problem with 3D scanners is that they are for professionals, most 3D enthusiasts don't have (can't afford) that sort of gear in their mum's basement. But then again, whoever is pretending that gaussian splatting can be use in game dev is either delusional or a scammer. It cannot.

[@mahmoudm.s.dwaikat1482]

waste of time, capturing 3d model is not worth it because any complex model can take an hour or so to build, it is rather the material and lighting and bumps and textures and animation that takes all the days of work and require high skills

[@TNMPlayer]

?

[@TheGreatResist]

This actually depends on the artist's ability and preference. Some excell at modeling while others do better with all the rest.

[@Balabok]

Actually, this technique is quite valuable. As a VFX artist, a lot of my recent hero models came from photogrammetry programs like Photoscan. Which I've used to make the Danny Ambulance and the Porsche 550 Spyder slot car for Doom Patrol.

[@mrburns366]

Have you ever even heard of megascans and unreal engine?

[@guybrush3000]

what is this guy talking about? sounds like bullshit