Generate 3D from ANY Video! │Gaussian Splatting Tutorial w/ Postshot

[@derek2593]

Holy crap, this will work better than mirrors to trim the back of my neckline.

[@Gorongirl]

9/10 videos don't give you the damn settings for optimal capture. Thank you for doing this right from the start!

[@BlackMixture]

Right?! Thanks for letting me know you appreciate the settings for optimal capture. I almost didn't put it in because I thought people might find it too boring.

[@TorQueMoD]

Man, movies are going to be legit in another 10 years. Imagine studios filming an entire movie and then converting it into a 3D model and placing you in the movie with VR.

[@sonicsnake44]

That would be amazing.

[@maximumblackness]

@@TorQueMoD I love how you think 👍🏿

[@webinatic216]

I hope in 10 years we will have good movies. Don't care how they are made.

[@tommiemcswizzle1485]

10 years? This will be happening in 2

[@tommiemcswizzle1485]

@@webinatic216 Couldn't agree more.. even if production techniques change, story will always still be king

[@RIKAAR_Ambient]

2:49 The Desktooooooppp :D Holy

[@maciejgorski6981]

I have the entire desktop filled and my icons are smaller!!! :)

[@RIKAAR_Ambient]

😂😅​@@maciejgorski6981

[@adam1st-]

Dude, this is everything I've been looking for! Thank you for showing me this. God bless to you my friend!

[@flinfaraday1821]

You mean you have no abilities and looking for something to do everything for you?

[@adam1st-]

​@@flinfaraday1821 Precisely, and the exact reason why you're watching this video

[@bloupy57]

Thank you for your work and your video. I've been trying to do this for months, thank you so much!

[@BlackMixture]

Awesome glad it could help!

[@iandvan8698]

Year after year that awesome Black Mixture dude with awesome voice helps me tremendously with technics, methods, explanations over and over again, thank you Black Mixture dude

[@BlackMixture]

Haha thanks! Appreciate it your support 😁🔥

[@1airdrummer]

I did NOT expect that voice to come from that face. lol Good stuff dude! Thanks for sharing!

[@johngate70]

me too.

[@doclee8755]

Don’t be racist.

[@johngate70]

@@doclee8755 Such narrow mindedness.

[@yablomas_]

@@doclee8755how were they being racist?

[@lucinefilmsllc]

I swear I thought the same

[@adamfilipowicz9260]

how do I make a mesh from a splat?

[@MrMadvillan]

the whole point is that you don’t/can’t. that’s why it’s been around for a while but no one does anything with it. it’s the graphine of the cg world

[@iamsushi1056]

That’s coming with 4D splats

[@TacticsTechniquesandProcedures]

The meshes tend to be vert heavy with bad normals. Its not really useful for gaming as claimed unless you consider adding mesh fixing to your modelling workflow "good."

[@im_Polyhedrons]

nvidia has developed an ai tool that converts PointClouds to mesh, hopefully it'll become publicly available soon.

[@bryanharrison3889]

Gaussian splatting is something that's been around for a hot minute already. Its just much better now than it was when it first hit the world.

[@BlackMixture]

You're absolutely right. The technique has just gotten to the point where it is usable and there are thankfully plugins built to use gaussian splats in programs like After Effects, Blender, and Unreal Engine 5.

[@AndrewTSq]

it reminds me of NERF's I think it is called. Still amazing :O

[@PPekka]

It´s so cool that technology is evolving. I´m not that good at 3d modeling and I don´t have enough time to learn what I want to do. What I am waiting for is a tool that I can use to bring a 3d model of my own custom built car to Assetto Corsa and maybe in the future make my own racetracks. There are tools already to make it easier and this is definetly a step towards that. I wish in the future there will be software that I can just make a route in Google Maps and the software will use street view images to generate the 3d model. Or feed the software a video and gps data of a route I want modeled. Future is so cool.

[@N1ghtR1der666]

do you have a video on the process of going from a splat to a more standard model in blender?

[@plorks445]

Great video. Very cool tech. It would be nice to see the geo without the texture on it as well. Texture can make the geo look more detailed than it really is.

[@FritzHugo3]

Very impressiv!

[@claudiosettiart]

Thank you for the video! What project is that at 2:28 with the Apache Attack Helicopter?

[@peffken8834]

Thanks man!

[@jozsefilyes3533]

Looking forward to Davinci Resolve version

[@SlyNine]

This was awesome.

[@OlliHuttunen78]

Great video. Good results!

[@DJZofPCB]

as prep could you have dropped a white sheet under/around the hydrant and then recorded your clip? in order to block out and reduce the training of unwanted artifacts?

[@TheAkdzyn]

If you select the nerf options could you make meshes off it.

[@maximumblackness]

Dope Video!!!

[@BlackMixture]

Aye thanks!

[@AdrianoBla-g2l]

Marvelous Tech!

[@PatrickHoodDaniel]

Do you think this would work with existing city flyovers for a city model? I'm sure drone footage would be good, but I'm curious because there are so many lens distortions that may get this wrong. That brings up another question, lens, what mm in terns of macro vs fish eye or in between. Wonderful video!!

[@BlackMixture]

Yooo I actually did this with some old drone footage that was NOT intended for 3D gaussian splats and it came out awesome! I highly recommend this for city flyovers with drone footage. The lens wasn't a fisheye and was basic DJI drone.

[@PatrickHoodDaniel]

@@BlackMixture Nice!

[@RarendipityGames]

Educational and interesting, as usual. 👍 I'm curious about splats to meshes, and how they compare to photogrammetry. Any difference?

[@aldermediaproductions695]

I was wondering the same. My experience with photogrammetry has been extremely 'meh.' It literally can't even replicate a straight line. This process appears to be significantly better but of course I haven't tried it yet.

[@SimStig]

@@aldermediaproductions695did you try it, the preview was so misleading showing the car triangulated

[@merion297]

Cool! Any clue about a macOS version or similar application for M-series Macs?

[@JustinCiriello]

Very nice. It would be really cool if we could involve this in a 3d printing workflow.

[@AlternativeCutsStudios]

It's not just about the 3D itself but how it is rendered. You can convert it to 3D or simply use photogrammetry, as they are the same in the initial stages. Gaussian splatting also estimates where the cameras are, just like photogrammetry does. However, the difference lies in how the final result is rendered. When you convert it to a regular 3D model, you lose all the features like dynamic reflections, transparency, etc.-basically everything that makes Gaussian splatting so great

[@fablewalls]

@@AlternativeCutsStudios Yes, I noticed this myself - however as a method to produce a 3D model that you could shrink wrap a mesh over to create an animatable model - I think it will be great.

[@BigAl444]

I have the Kiri Engine on my phone and it works the same way as this video. If you subscribe to the pro version, you can export meshes, PBR material sets and everything. You can use many features for free.

[@fablewalls]

Isn't Kiri Engine Chinese owned? I guess I'm just worried about having something like that on the same phone I have my banking app on. I have a separate Tablet with nothing attached - I guess I could put that alongside Scaniverse (I like Scaniverse as it keeps the processing local to my computer and doesn't send my data off to someone else's cloud storage and all that means for Ai "training")

[@nativebikers]

Thanks!!

[@radicant7283]

You didn't actually put a link in the description though

[@darrinholroyd8203]

Great video, could you 3d print them?

[@Frank_Art]

Could you use the Gaussian as a texture, making a retopologized version in Blender?

[@kylespevak6781]

Couldn't you use a drone and scan your town?

[@ibi_sum]

hi! great video... but. how export with texture to sketchfab? o blender? i want share 3d model in my webiste...

[@ibi_sum]

i want create a file similar in lumalabs

[@SteveHill68K]

Could this be used to scan a room instead of a single object?

[@phoenix-element]

I would definitely like to implement this on future projects. Sidenote: what is the intro song you used? from here 0:53 sounds like Finesto

[@macrumpton]

A couple of questions: Is it possible to derive a 3d model from a splat, and is it possible to insert a 3d model into a splat?

[@HavingCrumpets]

that delorean model was... special

[@wemustcreateza]

I learned something today 👌🏾

[@omardrservant]

What's your recommended tool/software for generating 3D of actual cars?

[@mohammadhosseinnajafzadeh4066]

Can we use these 3D models in Maya or Blender? What is the output file format of this program?

[@sephirothcloud3953]

Sadly there isn't any converter from guassian splatting to the classical mesh geometry, so the items can't move, limited to still life videos

[@AlternativeCutsStudios]

It's not just about the 3D itself but how it is rendered. You can convert it to 3D or simply use photogrammetry, as they are the same in the initial stages. Gaussian splatting also estimates where the cameras are, just like photogrammetry does. However, the difference lies in how the final result is rendered. When you convert it to a regular 3D model, you lose all the features like dynamic reflections, transparency, etc.-basically everything that makes Gaussian splatting so great

[@benjones5799]

very cool, thanks

[@paxwebb]

Postshot is Windows only??

[@metascopeinitiatives2550]

Really cool.

[@DJZofPCB]

can you import a clip and images and train from that?

[@giri.goyo_yt]

Tyrone Clones Himself. Scary good. Thanks for a detailed tute!

[@ryancampbell9425]

Is there any way to get dimensional accuracy with this? or an easy/simple way at least?

[@C.I...]

Include a measuring stick somewhere in the scene.

[@vrguytokyo]

daaang..... things be getting scary for traditional photogrammetrists

[@mattjames4978]

Cool tech. 'Gauss' is to rhyme with Mouse. It is after a famous mathematician.

[@BlackMixture]

Thanks this will definitely help me remember it! I think I heard gaussian pronounced like gawshin years ago and it just stuck lol.

[@bj0ernaa]

What kind of computer are you running the training on, apart from the MONSTER GPU you got? :D

[@SnakeTheCowboy]

Postshot does not work with GPUs pre RTX 2060, My GTX 1070 is out of list =(

[@malcolm341]

@Black Mixture Hi, can you tell me what phone you used to film the fire hydrant? The video quality looks really good, I'm not happy with my iphone 12 at 4k 60, the footage always looks really bad.

[@workoholekhh7542]

I can not find post shot. That invitation is expired.

[@ThatGuy_33]

Is it possible to export these splats as a standard 3d model.

[@Demoocracy-c7r]

Great video intro, thanks.

[@artmakesascene]

i'd love to see this used on older photos (or multiple photos) to recreate a place from 30 or even 60 years ago (or older) Thank you.

[@bitmancer_]

It is Nvidia GPU only. Are there other alternative tools?

[@FrankYoutube-lz4mk]

I don't like the registration process, it even fails on my password (from the firefox password generator.) .. so I could not test ... It's a pity.

[@nm-com]

Is there an app that just stabelizes cameratracks in videos using a gaussian splatting algorithm?

[@MarkWazowski]

Doraemon stuff getting real

[@fredrikfarkas]

This might bring some light to the jfk-recordings

[@Sven2157]

When this is imported into Blender, I assume it can be converted to a mesh, yes?

[@KalkuehlUncut]

You should look into 4D Gaussian splatting. Its animated Gaussian spatting. Thats the future. But I dont think this will come for gaming anytime soon, because it takes a sh*t ton of space.

[@nunosousa154]

Hey, love the content, im having some difficulty installing the blender addon, is it compatible with blender 4.1?

[@BlackMixture]

Hey Nunosousa! It doesn't work on 4.1. Try downgrading to 4.0.0 and it should work there

[@mickeybowles9743]

Without any reading or research, can you make 3D from old videos?

[@mirkoheimburger3026]

Is there a way to "convert" gaussian splat to geometry? Maybe by doing a virtual photogrammetry within the gaussian scene? 🤔

[@biolinkstudios]

MATHS

[@A.eye_101]

ask chatgpt

[@williamcousert]

Is there any way to use this data with DaVinci Resolve Studio?

[@verteyetfel]

am i right in thinking this is what lumalabs luma app does or is it nerfs?

[@efeozturk4364]

what's the difference between this and reality capture's import video option?

[@Theexplorographer]

Have you tried this with video game footage?

[@tamilorejoseph4704]

How do u convert it to a mesh

[@vanessaperaza2901]

hello will a RX5700 XT work with this? when i try to load Post spots it says Faild to load Nvidia Cuda driver?

[@arudanel5542]

You need a GeForce card, Cuda drivers are an nVidia thing.

[@2thecurve]

Can you save image as obj

[@EROSNERdesign]

another great video

[@BlackMixture]

Thanks, glad you enjoyed it!

[@pixxmedia3698]

Is it possible to use 360 Videos?

[@kingofnothing2260]

Can these be converted to mesh for or in blender?

[@myxsys]

Wish you had actually shown the wireframe of the models produced with this method. I bet they are very messy and will require a lot of retopology to make it work in a pipeline

[@Sandor3D]

gaussian splatting is a lot of fun but super experimental. I used it for a client music video but I will promise it is gonna give you headaches for sure. I used luma ai and UE5

[@MrCaesartheman]

dude thank you

[@zonoscopePictures]

Is the video posted somewhere? I’d like to see it!

[@metamuhamudnoah2856]

awesome

[@tadpole3159]

Your car render on the thumbnail had a wireframe though...

[@prehanramsamy6728]

LMFAO... I did not expect to see a person like you with a voice like that. 😅

[@Rick1234567S]

I don't suppose you can animate the characters. Looks like one mesh. Not useful for animation. Cool though. But what is it good for?

[@MamadMoghadam93]

You made a nice video but why click baiting people with that thumbnail...

[@MamadMoghadam93]

@@iresineherb7 oh so gaussian splitting can give u that sort of topology? Or all the parts as separate mesh?

[@MATGRAFIX01]

OMG... "Blade Runner" becomes reality.

[@cbnewham5633]

Nice, but my understanding is that it's quite difficult to generate a 3D mesh from this - splats are not really 3D in the conventional sense. Photogrammetry still rules the roost on this (for now).

[@perseohernandez755]

WOW !

[@Met9171]

Is it on mobile app

[@thehandleiwantedwasntavailable]

Small technical correction. The software is not ‘trained’. It performs analysis and provides a result.

[@drdca8263]

How is that a “technical correction”? Seems more like you having a personal objection to a word being used in a particular way. Which, you’re free to have, of course. I think it would be better if you described it as a preference though. That’s what I would prefer.

[@hydzior]

Yay... photogrametry. It is like 10+ years on the market.

[@NandR]

Photogrammetry is similar but the difference with gaussian Splatting is using model training to fill in the blanks.

[@somename371]

Not the same thing

[@RaimarLunardi]

I mess with photogrammetry for about that time and it never looked so good!!

[@SculptEon]

Don't see how to put it to good use, unless it can be made to 3d mesh

[@ahsookee]

It can

[@wernerhiemer406]

Too high demands on graphics card.

[@superfao]

"FAILED TO SELECT IMAGES" ...any idea?

[@sasnad3]

This is photogrammetry. Videos are also in essence just pictures. 😂😂

[@BlueBeluga_]

No it's not, with photogrammetry you create a mesh and the project a texture onto that mesh. Gaussian splatting creates a coloured point cloud.

[@GerardMenvussa]

It's very impressive. But I'm not sure I understand the difference between this and photogrammetry :/

[@B.BAKDASH]

In photogrammetry, you can't capture reflective items.

[@Instant_Nerf]

Joke post ? You have seen Gaussian splats and photogrammetry side by side ?

[@rekad8181]

Photogrammetry is real geometry, using polygons. Splatting, uses blurry spots of the original image in 3d space, but there is no 3d polygons.

[@GerardMenvussa]

@@rekad8181 Thanks for the explanation.

[@doclee8755]

My man…you’re allowed more than 3 folders on a desktop…just in case you were unsure. 😂

[@大支爺]

It won't work when the target is in action. e.g. a moving cat.

[@modelenginerding6996]

I'm going to stop learning new 3D art techniques for a few years until the AI craziness settles a bit!

[@AutodeskFTW]

10 years from now we won’t be able to tell what’s real.

[@BrianLockett]

We literally say that every decade, and every single decade, our brains get acclimated to even the slightest differences between falsity and reality. For instance, even many older less-tech-savvy people now are starting to notice the "offness" of so-called AI-generated images. Same way we got acclimated to "Photoshopped" images. With enough exposure time to any technology, it still remains incredibly difficult to fool our brains with the uncanny because something is always "off." Maybe we'll get close enough where we just give up noticing, but simulation is as limited as what developers notice about how our humans senses detect reality--a interdisciplinary field of study that, in itself, is also still growing.

[@MysteryD]

"It runs super fast" Bro you're on a fu**ing RTX 4090, not sure that saying it runs fast is a fair thing to say lol