What is 3D Gaussian Splatting?

How does 3D Gaussian Splatting work? It's kinda complex but we are gonna break it down for you in 3 minutes.
3D Gaussian Splatting for Real-Time Radiance Field Rendering Paper:
repo-sam.inria.fr/fungraph/3d...
Shoutout to Maged for the Pyramids Drone footage
Shoutout to Jutsin for the Castell de Verdera Drone footage:
/ jaylpage
Join our discord server:
/ discord
If you wanna see us to do cool things follow us here too:
Instagram: / badxstudio
Twitter: / badxstudio
TikTok: / badxstudio
LinkedIn: / badxstudio
Bad Decisions Podcast 🎙️:
podcasters.spotify.com/pod/sh...
Our personal handles: (if you wanna stalk us)
/ farhad_sh
/ farazshababs
/ farhads__
/ farazshababi
/ farhadshababi
/ farazshababi
#3dgaussiansplatting #3dscan #gaussiansplatting #3d #3drender #nerf #unrealengine5 #unrealengine #blender3d #blender #drone #ai

[@yuxiang3147]

Gaussian splatting is truly amazing, definitely one of the best research works in computer vision this year

[@badxstudio]

totally agree.. one of the best papers release this year.

[@fnytnqsladcgqlefzcqxlzlcgj9220]

actually gaussian splatting has been around for about 8 years, it just wasnt called that, and it was back when a 1080ti was considered a strong gpu, before lots and lots of pipeline and processing breakthroughs

[@yuxiang3147]

@@fnytnqsladcgqlefzcqxlzlcgj9220 Yeah but the previous works only used 3D Gaussian kernels for volume rendering. The first one was called EWA volume splatting, published in 2001, which heavily inspired the recent Gaussian splatting paper. This technique has been around for more than 20 years, but the recent Gaussian splatting paper is the first work that uses 3D Gaussian splatting on novel view synthesis. It combines Gaussian splatting with structure from motion (an already very mature field) and hardware acceleration, and it works surprising well, which is why it's such an exciting work. and it is still much more novel than any of those NeRF papers that try to squeeze that 20% of performance increase from neural networks.

[@AdmMusicc]

Wow this is an insane amount of information that was delivered in such a small amount of time. Loved your passion for it as well and the animations throughout!

[@badxstudio]

Means a lot bro

[@domizoo]

Thank you for keeping it short yet super comprehensive! its 3 am rn for me and my exam is in 9 hours lol

[@twistedjourney]

You guys always continue to impress me with each video, the information, entertainment, value and production is top tier!

[@badxstudio]

Much appreciated brother

[@cryptoness2021]

Always entertaining and very, very informative content from you two.. I feel wiser and blessed to have stumbled across your channel. 😃

[@badxstudio]

That's awesome, thank you!

[@doomgb4994]

genuinely appreciate your two's enthusiasm and informative contents!

[@badxstudio]

Thanks for the love man. This comment means a lot and you know we are just going to keep goin!

[@SynaTek240]

Wow, very good 3 minute explanation. This is how explainers should be done, not a huge amount of useless prologue and also not too surface level, but actually explaining the intution behind the process, good job. I personally love math and CS so would've loved to see more in-depth coverage about the method, but that's what the paper is for and majority probably won't

[@badxstudio]

Thank you so much for this reasoning as to why the video is resonating with you! You know reading the paper ourselves we realised that a lot of people won't understand how this all works, so our goal was to simplify it as much as possible with visuals to ensure that almost anybody can understand it. We would have loved to go deeper, but were concerned that many beginners would be overwhelmed with the information overload.

[@OlliHuttunen78]

Very good guys! Very well done explaining video! Can't wait to see what kind of experiment you have had in Unreal with these gsplats.

[@badxstudio]

Thanks a ton! The UE experiment is coming out tomorrow and next we are gonna jump on a LED Wall to test these

[@eyedesyn]

Heck yeah thanks for the best, most down to earth explanation of what the heck Gaussian Splatting is! Not sure about the term "gsplat" tho lol. Thanks for making this and keep it up fellas!!

[@badxstudio]

Hahahahahahha Dude come on! Gplat is a perfectly fit acronym for it :D Lol thanks for the love brother

[@shelfrelated]

MAN, can't wait for you guys to use this method EVEN MORE in the future 🔥

[@badxstudio]

New video coming out tomorrow night too ;)

[@fahimjaowad8717]

wow the gaussians look like galaxies

[@badxstudio]

Right????

[@ScottSquires]

Well done. Good breakdown of the process. Thank you.

[@badxstudio]

Thank yoouuuu sir!! It's our pleasure :)

[@sebastians_]

The next Google Earth and Maps will be soo COOL

[@danielb.2873]

Guys what's your computer setup? Which CPU/GPU? How much RAM/VRAM? The docs say that 24 GB VRAM would be best, that's surely A LOT and 3x my current configuration

[@SSukram_]

They say that would be best because the most powerful GPUs on the consumer market have 24 GB, I would say 12gb is enough. You could do it with 8 but that might push it

[@onurerdurak]

Beautifully explained! And in 3 minutes! 🔥 Incredible work as always friends 🔥 I look forward to the tutorial 🙌🙌⚡️

[@badxstudio]

Thank you so much brother! Glad you enjoyed it

[@hallo_welt1111]

Exactly what I wanted to write, great explanation!

[@kevinsimpore2044]

I'm new here but the way this video was made is enough for me to subscribe 😂😂

[@chrisgardner7731]

Nice video, thank you guys!

[@ishaan863]

That was a VERY good explanation thanks!

[@JonathanWinbush]

Very well done fellas I'll definately be sharing this around! Did you guys see Polycam just announced they are doing splats now too

[@badxstudio]

Thank youuuu brother for always being supportive and sharing. Yeah just spoke to them and tested them last night. Have you played with it yet? It's HELLA fast to view and looks pretty good considering we are not the one training it.

[@OUTTHEMUDVISUAL]

AMAZING breakdown

[@badxstudio]

Thanks bro

[@Edilyon]

thank you guys for this very succinct but thorough expanation :D

[@badxstudio]

Our pleasure!

[@micbab-vg2mu]

great video - thank you!!!

[@badxstudio]

Glad you liked it!

[@micbab-vg2mu]

How powerful graphic card I need to run it on my own computer?@@badxstudio

[@eduardodiaz5459]

Best best best short explanation about this technology that I have seen.

[@umutcoskun4247]

Truely amazing. Its such an exciting time.

[@badxstudio]

100% agreed

[@sakru007]

favorite channel now 😍😍

[@badxstudio]

Haha we are honoured bro

[@r.m8146]

Damn, amazing video!!!!

[@badxstudio]

Thanks buddy

[@liampugh]

can't wait for y'alls Unreal Engine Gaussian Splatting video!

[@badxstudio]

The video is 90% ready. Coming out tomorrow at the same time :)

[@Villio.]

are your videos in HDR cause im getting off colors in 2k and i have sDR monitor just asking?

[@haikeye1425]

Welcome to our new UE plugin: "UEGaussianSplatting: 3D Gaussian Splatting Rendering Feature For UE"

[@moiz_lapse]

You made it too easy to understand. Keep such videos coming. Best wishes from your new subscriber :)

[@badxstudio]

Thank you so much brother

[@rafaelturang3514]

came here cause i know the world is changin so damn fast🦋

[@badxstudio]

Great choice hahaha..

[@patyfreenam860]

Great work as usual, keep it up guys! Is there an end 2 end tutorial?

[@badxstudio]

Thanks buddy… Coming soon ;)

[@jzwadlo]

If i hear that reverse gleam sound effect one more time... haha Annoying in what was otherwise an amazing video guys well done! Got all the info down to a very short video :)

[@KelownaAuctions]

That's the Lamplighter pub !! My late Uncle owned that place for 40 years and transformed it and the hotel.. Him and his brother had the steamclock rebuilt and its been kept up to this day!!

[@badxstudio]

Whaaaaaaaaaat????? What a coincidence!!!! I've been to the Lamplighter one time with friends had a great time there. How did you end up on this video btw? Good to meet you!

[@KelownaAuctions]

@badxstudio I've been following for a while, I'm working on getting moving with this technology for game and film applications... I was the guy who said for everyone to "give the hair a day off" I've been working in Film for over a decade and I see the shift happening.

[@mohamedelshafaie4299]

is it possible to have pyramids dataset?

[@taureanwooley]

How did gradients become radiance? And where did the .named extensions go if they were required. Asking for the year 2000

[@saforever7470]

Hey guys, when will you have a video explaining how to do this taking into consideration what quality settings we should have on an iPhone to get this done? I followed the Nerf Guru and got all the software working but after like an hour or more it was still sitting at 5% training so I gave up, it was just a little room so Im sure im doing something wrong? my gpu is an RTX 4000 8gb. Also a question that I cant seem to find an answer for, are we able to export this into Unreal, Sketchup? How?

[@badxstudio]

For sure, we will do a full breakdown of capture quality but please remember that all of these are experiments, just simple try and error. And, yes there is a plugin for Unreal Engine, check out our latest video

[@caliberpokwana8872]

Amazing art God give u more years from OG caliber Amun

[@badxstudio]

Thanks for always being there OG

[@hcsmk8388]

You guys are incredible!! Is this editable for VFX?

[@badxstudio]

love ya brother! Listen at the moment not really. You can either crop the scene with a bounding box or if you bring it to unreal using a plugin, you can edit the niagara particles (considering you know how). So at the moment it's only good for rendering it as is and testing with it. But you can bet your butt that it will be becoming a whole lot more useful overtime as more people work on it!

[@hcsmk8388]

@@badxstudio that's crazy, thank you so much guys

[@vfxboy2003]

Where I found Latest News about VFX industry ,Is there any website I only know about Artstation

[@pva5142]

are you able to use a Mac for this, or is it CUDA powered only?

[@badxstudio]

I believe its only Nvidia gpu at the moment

[@someoneedits]

aoh my god its awsome

[@badxstudio]

I knowwww

[@Andreas28]

You guys have to try gaussian splatting with a 360 Camera

[@MStreppelhoff]

Cant wait for the first Matrix :P Seriously...this is just great. I hope this technique will be in games the next years.

[@badxstudio]

I KNOW RIGHT!!

[@Ryderman2000]

So, does this mean you can create a 2D image wirh Ai and then render it in 3D with this Gsplatting technique?

[@NJILIKE]

How tomstart the app?😊

[@imaUFO672]

Is it possible to edit these gaussians or combine them with other gaussians from another shot? I’m going crazy over this tech

[@badxstudio]

There is crop tools in UE plugin and you can bring multiple gaussians into one scene. However we are at the very early stage so we believe there will be more customization tool coming soon

[@imaUFO672]

@@badxstudio Damn I can’t wait for this tech to progress, please keep uploading more and keep your channel active I already love all your videos you’ve uploaded so far

[@haikeye1425]

Nice.

[@angelsface200]

… you lost me after adaptive density control lol, but super exciting! I’d like to know more about the technical stuff - such as can this be implemented in multiple softwares today (like UE5), is there a huge learning curve to implement this, how much memory does this task take up/what components does a computer need to implement this, etc.

[@badxstudio]

yes there is a plugin for Unreal Engine, check out our latest video. For training it locally you need GPU with min 24gb VRAM

[@Krappenschittz]

Please make a tutorial video for creating a 3D scene using Gaussian Splatting and importing it into unreal engine and use Ultra Dynamic Sky with various other 3D objects in it.

[@badxstudio]

ok half of what you asked is already done and is coming out tomorrow.

[@charliegabs]

I need someone to answer this for me. Would it be possible to use this technology with sunken ships that are at the bottom of the sea? If yes, how?

[@badxstudio]

hmmmm maybe we should try to train an underwater object next

[@ADUuniverse]

When’s the tut coming?

[@badxstudio]

Next Week :)

[@GooseMcdonald]

Guys try the first matrix movie gun scene with neo

[@badxstudio]

OOOOOoooooooh shizzzz that's a good idea! WILL TRY

[@polygonz3113]

Minimum GPU RAM necessary?

[@badxstudio]

24gb Vram to train. BUT polycam just announced their Gaussian Splatting tool which trains on their end. New video on that coming this weekend!

[@polygonz3113]

Good to hear I look forward to it.. @@badxstudio

[@nondisclourse]

Imagine how many pictures a video will generate, so when i understand the principe of gaussian splatting correctly, so i guess an only object will have 1000 pictures.

[@d0ugparker]

Excellent video. At 1:44, _ellipsoid_ is pronounced (ell - ip' - soid,) with the accent on the 2nd syllable. Regards.

[@badxstudio]

Thanks for that G!

[@julienblanchon6082]

Could be fun if you publish your .ply somewhere so we can try out

[@badxstudio]

If you want it, we can share it on our discord alongside all the other models. Just tag us there

[@julienblanchon6082]

Ho nice a Discord server. Yes I've tag you@@badxstudio

[@iamr0b0tx]

This is me, and now in 3D 0-

[@L3nny666]

hm interesting, but i can't think of many usecases for this. 1) you can't model the stuff yourself, it only seems to work with stuff that's already there 2) these are static scenes, no change of lighting, texture animation or anything alse... 3) so not really usable for games

[@Hexapoda.Resident]

The GSplats, *giggles*, do you boys know how to find it?

[@ausgefuuchst]

Explained very nice, short, clear and to the point. A bit too much overacting maybe.

[@angelsface200]

Maybe they’ll finally start on GTA 6

[@badxstudio]

hahahah

[@AlexTuduran]

The 3D representation of a Gaussian is not an ellipsoid. Otherwise, you would see elipsoids overlapping each other in the rendering. Instead, what you see is shapes that fade nicely one into another. Why is that? If you think of the Gaussian function in 1D as being what you've shown in the video (which is correct), in 3D is being used to describe opacity in all 3 dimensions. That is, from the center of a 3D Gaussian to it's extent, the opacity follows a half Gaussian function. In the case of an ellipsoid, this function would be a rectangular (it ends abruptly, creating a surface). 3D Gaussians don't have a surface because their density / opacity is described by, well.. a Gaussian function. That makes them fit for conveying the idea of volumes, as they blend nicely one into another. Then you may ask "Why the Gaussian function precisely?". Glad you asked. The Gaussian function has some important properties. The convolution between two Gaussians results in a Gaussian. Multiple convolutions between rectangles (or any other function really) converge to a Gaussian function. That makes them perfectly fit for blending, yielding the smoothest possible result. The smoothest possible blur is - you guessed it - a Gaussian blur. That is, regardless of the blurring kernel of your choice when blurring an image, it eventually approximate the Gaussian blur. That is a direct consequence of the convolution property, as blurring is actually a convolution between a clear image and a certain kernel and since convolution between almost any kernels eventually converge to a Gaussian kernel, the blurring does as well. In short, think of a 3D Gaussian as being more like a cloud in which the deeper you go, the more dense / opaque it becomes and if you'll try to plot the density, a Gaussian function will emerge (half of it). Hope that makes sense.

[@deepakminz1332]

make tutorial step by step for splatting

[@badxstudio]

For sure!! Will happen

[@DronkenDrenthen]

what i wanna know is what AI tool this guy used to give him that long grey hair in some shots.

[@badxstudio]

hahahhaha GeneticGPT

[@tanjidatanfi4300]

Plzz make a tutorial about how to distract concentration from ur crush 😂I'm almost in the last stage with 0% self-respect😪

[@badxstudio]

hahaha! You want a tutorial for that?? :D :D Maybe your crush needs to do another livestream like before hahahah! Thanks Tanjida

[@YahiyaJasem]

first :))

[@badxstudio]

Yahiya our bro. GOAT

[@raij]

Catalonia? It surely looks like Spain to me

[@wahadjh]

واقعا خیلی بد انگلیسی صحبت می‌کنید. خب مگه مجبورتون کردن؟ واقعا متوجه‌ش نمیشم

[@mr.x6619]

Hysterical appearance does not help learning. Chill the f out

[@matbeedotcom]

Nobody hits the GSplat quite like you two

[@badxstudio]

Hahahhaha made us lol :D