How AI Photogrammetry Is Changing 3D Forever

Thanks to Babbel for sponsoring today's video. Go to strms.net/babb... to get up to 60% off! #ad
Intro Clip by Arata Fukoe
[Twitter] Ar...
Instant-NGP
[My Video] • NVIDIA Just Made AI Ph...
[Project Page] nvlabs.github....
[Paper] nvlabs.github....
[Code] github.com/NVl...
LERF
[Paper] arxiv.org/abs/...
[Project Page] www.lerf.io/
[Code] github.com/ker...
[NeRF Studio Page] docs.nerf.stud...
MixNeRF
[Paper] arxiv.org/abs/...
[Project Page] shawn615.githu...
[Code] github.com/sha...
Zip-NeRF
[Paper] arxiv.org/abs/...
[Project Page] jonbarron.info...
F2-NeRF
[Paper] arxiv.org/abs/...
[Project Page] totoro97.githu...
[Code] github.com/tot...
Block-NeRF
[My Video] • NeRF With Style Transf...
[Paper] arxiv.org/abs/...
[Project Page] waymo.com/rese...
BungeeNeRF
[My Video] • NeRF Is Gonna Be The F...
[Paper] arxiv.org/abs/...
[Project Page] city-super.git...
[Code] github.com/cit...
GridNeRF
[Paper] arxiv.org/abs/...
[Project Page] city-super.git...
[Code]
NSFF
[My Video] • 3D Video Stabilization...
[Paper] arxiv.org/abs/...
[Project Page] www.cs.cornell...
[Code] github.com/zhe...
ReLight My NeRF
[Paper] arxiv.org/abs/...
[Project Page] eyecan-ai.gith...
MSNeRF
[Paper] arxiv.org/abs/...
[Project Page] zx-yin.github....
[Code] github.com/ZX-...
Nerfbusters
[Paper] arxiv.org/abs/...
[Project Page] ethanweber.me/...
[Code] github.com/eth...
Instruct 3D-to-3D
[Paper] arxiv.org/abs/...
[Project Page] sony.github.io...
InstructPix2Pix
[Paper] arxiv.org/abs/...
[Project Page] www.timothybro...
[Code] github.com/tim...
3D Video Loops from Asynchronous Input
[Paper] arxiv.org/abs/...
[Project Page] limacv.github....
[Code] github.com/lim...
DyNeRF
[Paper] arxiv.org/abs/...
[Project Page] neural-3d-vide...
NeRFPlayer
[Paper] arxiv.org/pdf/...
[Project Page] lsongx.github....
[NeRF Studio] Available
HyperReel
[Paper] arxiv.org/abs/...
[Project Page] hyperreel.gith...
[Code] github.com/fac...
Patch-based 3D Natural Scene Generation from a Single Example
[Paper] arxiv.org/abs/...
[Project Page] weiyuli.xyz/Sin...
[Code] github.com/wyy...
DreamFusion
[Paper] arxiv.org/abs/...
[Project Page] dreamfusion3d....
ProlificDreamer
[Paper] arxiv.org/abs/...
[Project Page] ml.cs.tsinghua...
[Code] github.com/thu...
HiFA
[Paper] arxiv.org/abs/...
[Project Page] hifa-team.gith...
[Code] github.com/HiF...
Neuralangelo
[Paper] research.nvidi...
[Project Page] research.nvidi...
Luma Labs AI (Not Luma AI Labs oops)
[Web] lumalabs.ai/
[App Store] apps.apple.com...
This video is supported by the kind Patrons & KZbin Members:
🙏Andrew Lescelius, Alex J, Chris LeDoux, Alex Maurice, Tony Jimenez, Panther Modern, Jake Disco, Demilson Quintao, Shuhong Chen, Hongbo Men, happi nyuu nyaa, Carol Lo, Mose Sakashita, Miguel, Bandera, Gennaro Schiano, gunwoo, Ravid Freedman, Mert Seftali, Mrityunjay, Richárd Nagyfi, Timo Steiner, Henrik G Sundt, projectAnthony, Brigham Hall, Kyle Hudson, Kalila, Jef Come, Jvari Williams, Tien Tien
[Discord] / discord
[Twitter] / bycloudai
[Patreon] / bycloud
[Music 1] Skies - Slipstream
[Music 2] Celery Fields - Slipstream
[Profile & Banner Art] / pygm7

[@bycloudAI]

Go to strms.net/babbel_bycloudai to get up to 60% off! #ad and I am also thinking to do a 100K Q&A, feel free to ask me questions here or on my Discord's special Q&A channel! discord.gg/NhJZGtH

[@MorbiusBlueBalls]

congrats on 100k subs!

[@AndrewBrownK]

it feels like the 90s again.... everything moving so fast, a true inflection point in history. Then, the spread of the internet. Now, this stuff. Arbitrary content generation will be spontaneous and nearly free.... the world will be distinctly different before and after.

[@Garbanzobear]

True that, things have skyrocketed to the point that no one can truly keep up. It's exciting but also concerning, like how social media blew up and changed society, both for better and worse. Are we Icarus flying into the sun, or if it's like opening Pandoras box and unleashing endless opportunity.

[@terraguy996]

so true

[@mmmuck]

It's free for now but not for long

[@tuna1867]

@@mmmuck open source is always free

[@XecularOfficial]

@@tuna1867 That's why companies like ChatGPT are trying to sell AI as a service instead of as a program. They are working to cull open source unfortunately

[@EddieBurke]

I asked some guy to make a colab for nerf when the first paper came out, it was barley functional but when it worked, wow it worked. Now its easy as shit

[@KalkuehlGaming]

I cant believe it. VR Movies are even closer than I expected. Imagine a full blown movie that doesnt look "rendered" and you sit in the middle and can look around. Mixing nerf with real time cgi might be the real deal.

[@throwawayaccount759]

This will be revolutionary to AR and home assistant robots when they become mainstream

[@plokki456]

As a phd student, I really liked this video since it made me discover many papers that I hadn't heard of and it gives a very good overview of the current state of the art in the field. However, it's a bit depressing to see this crazy amount of competition. If it looks like a rush from an outsider's point of view, imagine what it's like from a researcher/phd student's point of view!

[@nicholash1278]

do you feel depressed you didn't invent some of this stuff yourself?

[@plokki456]

@@nicholash1278 not really since research is about finding new ways to do thing, so there is always something new to be tried. As mentioned in the video, some papers are published with just a few week intervals and yet improve on the state of the art by a wide margin. Having your hard work made obsolete just after you've published, or worse, before you publish, that's the depressing part. It hasn't happened to me yet but I'm sure that feeling is shared among all researchers and PhD students.

[@yiboliang8338]

@@nicholash1278 PhD Students feel depressed when they realize what they are doing is so crap compared to state of the art, and may never be better than it. Pretty desparate if you choose the wrong subject and not talented enough.

[@jimj2683]

Generative 3d nerf that is trained on tonnes of images and real world 3d data is the holy grail. It will be used to improve all the detail in stuff like Google Earth. It will be so good that it could even be used in GTA 7 with the entire planet in high detail (streamed like MSFS2020 of course).

[@SMmania123]

This tech is advancing so fast these days 😅

[@Y0UT0PIA]

Following your channel has been a real journey - thinking and writing about NNs has completely taken over my life over the past two years, and without your videos there are so many developments that I would probably have missed. (Also: Oh boy, so 3d artists were just one or two years behind in terms of significant aspects of their work becoming automatable compared to 2d. I honestly thought there was gonna be a bit more of a grace period than that.)

[@notram249]

your definitely not a 3d artist

[@TheDragonshunter]

This + Unreal 5. Oh boy indie devs are eating well

[@nicholash1278]

nah, they are going out of business because there will be too much competition bringing forward games that all look incredible. I think ai will be the death of indie games, because the market will become over-statured with games featuring this ai content. It's kind of depressing.

[@QuincyIsCrispy]

@@nicholash1278 Best possible outcome, as it won't be indie devs that die because of this, it'll be aibros who think just because their game looks good, that it is good who will.

[@nicholash1278]

@@QuincyIsCrispy AI bro is such a stupid term tbh

[@QuincyIsCrispy]

@@nicholash1278 Perfect fit for them then

[@Xenotork]

basically this has the potential allow AI to become more sentient of their surroundings on a dynamic basis, being able to virtually map an entire space and identify any object scanned within it with high fidelity. It will also allow for AR to use this same data to create highly realistic and lifelike environments.

[@darkandblue4118]

My favorite nerf is RAW nerf. Idk if other nerf techniques can do this to but they have shown that it can change brightness, fov, focus and more.

[@tja9212]

we are coming to the point that was described in 70s scifi, where a machine can do anything creative but you need operators which are educated, cultivated and have a big mental horizon to handle what the ai gives them. otherwise we will probably spiral downwards a slide of low effort and superifical stuff.

[@QuincyIsCrispy]

lol

[@GL-GildedLining]

_Good lawd,_ this is moving so quickly! I love how much of this is open-source, rather than being locked up in ivory towers.

[@nahkaimurrao4966]

THIS IS AWESOME, I UNDERSTOOD SOME OF THE WORDS YOU SAID 🌟🌟🌟

[@user-tk1jj1cp9x4]

This is a really terrific video. Thanks for making this.

[@lucao9059]

boy this is a bit scary, I was very much excited when the first img generative tool came out. But now I feel like we are bulding hands, eyes, nose and ultimately a real functioning brain to AI

[@d34bru]

i want the camera of bladerunner... having a video, stop a frame, then rotate, zoom... play XD Just a photograph would be awesome too... bladerunner (1st one)

[@トユキ個人]

I LOVE your videos! Thank you for the hard work!

[@voEovove]

What a time to be alive!

[@alexandruneag4845]

I don't understand why this AI tech is so underated compared to Chat GPT and even Dalle 2?😮‍💨 This thing is game changing!

[@graphics_travelers]

@@kmouratidis Yeah, because people don't play video games and 3D is really scarce.

[@based-p2b]

6:43 I think you meant depressed

[@ninjatogo]

Nice video. At this point I think I enjoy your content slightly more than 2 minute papers for the added memes 😅

[@creator-link]

Also he talks about the paper unlike two minute papers And also slightly less annoying

[@games528]

Also he makes videos of papers that are not 6 months old already.

[@32rq]

The thumbnail isn't doing this video justice. I skipped over it twice, but I'm glad the algorithm was insistent.

[@phil.d6449]

I see this technology been used in movies, games,... Like a real 3D without glasses

[@yosha_ykt]

Thanks for the videos! Bycloud

[@xZerse]

Thanks for the video! What paper/video does the source video from 0:32 - 0:40 come from?

[@electronamstudios]

With the 3D CLIP stuff it would be interesting to see if it has any effects in forensics where you could scan a house and search for common "bad items" and see if you missed anything or anything else could be inspected.

[@fireaza]

Now the A.I are coming to spoil our Where's Waldo books! Where will it end?!

[@millthor]

You are awesome! thanks for all those great news!

[@NiffirgkcaJ]

Oh my goodness! The tech in RoboCop is becoming real in front of my own eyes!

[@qualia765]

what a day to be alive!

[@eggman28]

Awesome video ! BTW, it's Unreal Engine that Luma has a plugin currently for, not Unity :-)

[@liam10000888]

This is gonna be awesome for games. Holy crap

[@GMaldonado79]

Freeze,Rotate,Zoom,Focus,Enhance is becoming a reality 😳

[@ryanfav]

I would be curious where the limits of this tech is, I've got Terapixel scale image sets of a town from a few different angles, would be interesting if that is enough to model most of the town in 1 shot, (Shot for panoramas, but data is still data)

[@ang_oose]

wow this is a lot of progress... nice video by the way

[@darkandblue4118]

Future videos would need to be made in hours if the research keeps accelerating

[@homeyworkey]

which ai tubers do you watch? i used to watch 2 min papers but the guy is slow and repeats his previous videos content like way too much i just watch ai explained and u u remind me of a combination of fireship + 2min papers good job bruv keep it up

[@tatianaes3354]

*SINCE Apple* has a powerful “neural engine” (most powerful in any consumer SoC/CPU), I guess the company might use similar machine learning techniques to convert many 2D assets into stereo images for its new headset. The issue, though, the headset is too pricey for this to make an impact for any significant number of people.

[@monad_tcp]

Its not more powerful than the RTX on any nVidia. It might be more powerful in mobile SoCs. But I don't know about the new Hexagon from Qualcomm, not too far behind.

[@tatianaes3354]

@@monad_tcp As I mentioned, we are talking about SoCs/CPUs, not GPUs. (That said, Apple’s solution is faster than what most GPUs have for this, too.)

[@monad_tcp]

@@tatianaes3354 how is their solution faster if you can't use it and the hardware is optimized for their specific model ? Ive spent some time reverse engineering it and I call those claims bullshit.

[@tatianaes3354]

@@monad_tcp What you can not use? Apple has CoreML API and other ways to use Neural Engine. There is nothing faster in consumer world in SoCs/CPUs.

[@arminhejazian5306]

Very good content man, keep it going

[@harsh9558]

This tbis is so amazing 🔥🔥

[@Terminator550]

Which software are people using to create LERF images? I would like to use it with motion control to create anime

[@USBEN.]

This is FOOKIN EPIC!

[@Zeak6464]

I would love to see example of how to do this like a tutorial or something

[@worselipreading860]

Great video!

[@mistavoid]

imagine the procedural generation games could accomplish with more advanced versions of this.

[@kentjensen4504]

Jokes aside. Very good idea. I hate tech videos that waste energy on being dynamic and funny.

[@Narblo]

"Look what they have to do to mimic a fraction of our power" - human brain imagination.

[@wisemonkeys4511]

Love your work byCloudAI

[@ProgZ]

8:03 : Really looks like an iron throne from game of thrones, I see no difference

[@ONDANOTA]

but can 2 nerf objects collide with each other?

[@TerryThayer]

I hope they come up with a way to 3d print images from text to image prompts. That would be cool😊

[@kwhodabest]

Hey! Do you have your script for this video? Thanks

[@canyoupleaserunfast]

❤❤❤ I love your videos. Thank you very much!

[@Karasus3D]

Can anyone answer this question for me can you use this to make into a 3d printable mesh model?

[@UpRisingCake]

take a picture in a haunted house then tell it to find the ghost

[@CMDF08]

Your videos are great and very informative! It would be great if you spoke a bit slower at times.

[@lowqchannel]

any ai that can map flat area to correct scale such as road section

[@DavidBoura]

No easy Android app such as the one from Luma Labs AI?

[@brushrunner]

So which one is easiest to implement in Blender, and also free?

[@トユキ個人]

8:03 Didn't watch game of thrones but that throne doesn't look iron to me

[@Guedez1]

OUTDATED, it's 103k subs now

[@timothyclemson]

One day, the video will never end... 🤯

[@dsfs17987]

all those solved captchas man...

[@lolibozi]

Thanks for the videos, always interesting.

[@Blastmaster321]

This is incredible

[@culpritdesign]

Great video! More nerf!

[@AB-wf8ek]

Language models are the msg of machine learning

[@oliverdive9759]

Some day, someone, after maybe 🤔 7 years will come back to this video and will laugh 😂 at the quality of this ai🤖

[@alphasiera1757]

Imaging watching 3d movies using apple vision pro

[@heckensteiner4713]

It's NeRF or nothin'!

[@Zonca2]

Ok, but how are we on the waifu front?

[@daffertube]

just think of the memes...

[@loadsheddingzim]

Everything ia revolutionary

[@tapu_]

This could be used to cheat on where's Waldo books

[@slackstation]

This is ironic to have babbel as the sponsor as language learning is being attacked from both sides by LLM. One side, LLMs are excellent teachers so the need for a dedicated curriculum app is reduced and LLMs are excellent translators so that over time the need to learn another language will be reduced.

[@injectionAI]

holy crap

[@nicholash1278]

wow... just went I thought being a 3d artist would be safe from ai. Looks like I need to drop out of college (I am studying 3d) and pick a different field. Maybe construction worker.

[@tabby842]

i need this

[@635574]

The neurovolution is here

[@RoyerAdames]

Nice

[@N1ghtR1der666]

updated local nerf tutorial please

[@marshallodom1388]

I'm still just trying to identify boundaries grrrrr I WILL rule the world, if everyone could just slow down a bit please.

[@suhas2250]

nice comments🙂

[@contentfreeGPT5-py6uv]

YEAH P

[@deckruler3802]

Cyberpunk 2077 stuff

[@clockpock6143]

is nice

[@stevengreidinger8295]

Of course. Only a fool wouldn't add "Dino-Regularization." So obvious...

[@eee1200]

I dont get it but cool

[@undefined879]

This is dystopian

[@lostgarbage4055]

Nerf and entirety of 3d is redudant. Nobody will (thankfully) need to do all that complex math in their head to position a cube near other cube, and write shaders for it (i mean - who is it even marketed to, harvard geniuses?). In the future every single piece of media you`ll see will be text2video or text2image (or thought2stuff). 3d is a useless 80s fads that's gonna die down same way xbox Kinect did.

[@tonywang7933]

How I can feel so behind on everything on daily basis while trying so hard to learn new things daily at the same time

[@jurandfantom]

Thank you for (As always) great and informative videos :) happy to be your sub and watch each single video since "AI Converts Cartoon Characters To Real Life [Pixel2Style2Pixel]" :]

[@Irv.GuidoYT]

How can you use this tech to scan 3D figures to Autocad and Solidworks ? 😳😳😳😳 @bycloud

[@renanleao5553]

:)

[@sikliztailbunch]

this technology in combination with the the new apple vision and we will soon be able to buy and sell braindances on the dark web :-D

[@ewaf88]

I could understand obe wird yoy were saying No explainatuon of terms , just verbsl garbage

[@TR-707]

I hate content like this. Interesting topic and just some dude reading chatgpt summaries of articles with some memes throw in. No links nothing useful just links to ads and pinned comment for some stupid products.

[@bulieme]

Early