NVIDIA's New AI: The King is Here!

[@AlexMetslov]

As always, great work!!!! Truly, your fan!

[@KindOfWitch]

the jokes in this one are on point "if you click this button, believe it or not, you get sued by nintendo"

[@eborge9711]

that one caught me off guard I agree haha

[@jaythecoderx4623]

I was not expecting that I'm dead lmao

[@NostraDavid2]

I guess these are not research papers that I'm holding 😂

[@jaythecoderx4623]

@@NostraDavid2 2 Minute Airstrikes with Dr Shigeru Miyamoto

[@andrasbiro3007]

I've clicked it. Do you know a good AI lawyer?

[@nicklesscage91]

Just imagine, while controlling characters in games, they will no longer move based on preset templates. Depending on their environment or their current fatigue, they will perform actions, take steps, jump, or crouch in ways that are never identical. When you press a button, for example, to give the crouch command, the AI, having learned how to crouch, will execute one of the countless possible variations of that movement. But, for instance, if the character needs to crouch to pass through a specific spot, it will adjust the movement accordingly. A whole new level of interaction is on the horizon.

[@antoniobortoni]

Yes it sound to increible, or a IA filter that create realistic graphics to any game, there is no limit....

[@nicklesscage91]

@@antoniobortoni It's not just games or movies, but every existing field is about to undergo a profound transformation. This new era will truly begin when AGI reaches a point of certainty and the hallucination problem is solved. I believe this revolution is incomparable to the smartphone, the internet, or even the industrial revolution. This revolution encompasses a change as monumental as the division between prehistory and history with the invention of writing by humankind. To such an extent that at some point, all discoveries will be made without human intervention. It could be seen as a turning point, like BC and AD, but instead as Before AI (BAI) and After AI (AAI). Much like the birth of Christ, it will be the birth of Super AI.

[@shabadrandhawa3829]

that already kinda exists, procedural animation.

[@Raphy_Afk]

Wasn't what we all thought about for like 3 years now?

[@lastworlddeer]

Kinda already existed in modded skyrim tho bruh

[@settingsun1]

next gen games are going to be wild, imagine not having to code the daily life of NPC characters, that would save a ton of time and make each walkthrough different.

[@squirrelsinjacket1804]

Hopefully it massively speeds up the ever increasing time it takes to make AAA games. Instead of 5-10 years it'll get it down to 2 years.

[@suibora]

An ignorant and naive comment...We already have all the technology to do amazing things not only in games but in the real world too. Yet amazing things have been rare and today are even rarer. The tech is not the limiting factor in creating amazing things...

[@poplopuk]

Video game ai can be amazing via simple state machines. Running this kind of ai for each npc would be a huge performance regression. This would only really help with animations.

[@RavenMobile]

@@poplopuk The trick is training them. Specifically trained models can be reasonably small and efficient. Things like 3D traversal, animations, combat, etc.

[@denisquarte7177]

@@RavenMobile"etc." And how many ai models do you want to stack exactly with vram gimped consumer grade graphics cards? Even the highest end will only have 32GB, cost 2k+ and is not even released yet.

[@spaceowl5957]

They look like like scholars who have completely lost their paper hahaha I appreciated that :)

[@usualatoms4868]

I've misunderstood gravel my whole life.

[@PatrickHoodDaniel]

You should see the stuff Disney Research is doing. I would love to see your takes on their newest videos.

[@lapissea1190]

Very good point. You'd think since he's a big light transport fan, there would be more coverage of dreamworks, disney and other large CG company tech. There are some absolutely insane things you can find if you delve there. Even beyond light transport there are crazy things like using AI to make a complicated rig run in real time and such

[@TwoMinutePapers]

@@lapissea1190 You are absolutely right. I had the privilege of working at Disney Research previously, and I absolutely love their work. However, using Disney materials can be a risky endeavor.

[@al4nmcintyre]

@@TwoMinutePapers Don't anger The Mouse!

[@benjaminchevalier2836]

@@lapissea1190 Do you have a link to this research?

[@hippietreefriends]

Wouldn't they be interested in being showcased at 2 min papers? If its so amazing, wouldn't that be in their favour?

[@jzwadlo]

Her: He's probably cheating on me... Him: Watching 2MP with the bros ofc! 🤣😭😭 Amazing work as always man!

[@neon-kitty]

I don't know, that looked awfully Netflix-and-chill-y to me xD.

[@mihirvd01]

WHAT A TIME TO BE ALIVE!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!

[@AIMoneyMaven-y9z]

a very intersting time to be alive for sure

[@CruelCrusader90]

4:25 you absolute savage! 😂😂🤣🤣💀💀💀💀

[@islammohamed1441]

What a time to be AI! NVIDIA is so much more than just chips. It builds wall to wall AI hardware and software services, not only for modeling the world, but also generating and populating new ones.

[@gubzs]

3:13 okay that's weird, these are all random objects, _except_ that fourth one on the top row. That is "A Thousand Floating Dreams" from Genshin, if you google it, you'll see it. That being there says something about the model's training.

[@KevinSanMateo-p1l]

Good catch maybe the model is a fraud ☹️☹️☹️

[@dinkledankle]

Everyone credited in the paper is Chinese, the company who trained the model is Shanghai AI Laboratory (Chinese), Genshin is a Chinese game. I hope none of this surprises you.

[@gubzs]

@@dinkledankle Yeah that's my entire point. The model almost 1 for 1 just ripped that model. It means the training data is lacking, I'm assuming they didn't prompt that exact object, that's just what the model spat out.

[@Klayperson]

​@@dinkledankle More importantly than whether they have the right to that model is the fact that the originality of AI leaves much to be desired; it can basically only regurgitate what it has ingested, and stitch such things together. Furthermore we've seen how AI trained on AI content looks and it's not good. While still impressive, I wonder how much of this AI's creativity is actually less than it seems.

[@TheAgavi]

The doc has jokes this episode! I nearly lost my papers at the magic button.

[@kanetsb]

That 3D object generator look really nice. I can already see thousands of small time object modelers looking at it and saying - "I bet this is gonna make my life easier! Oh wait, is that a dismissal letter in inbox?"

[@riptechnoblademinecraftkin3187]

all this development and progress and people still think AI is a bubble lol

[@adamfilipowicz9260]

Humanity is the bubble that ai will burst

[@many_worlds]

once upon a time our universe was a bubble

[@lapissea1190]

I'm not confirming or denying but what is the use for this? I am genuinely curious

[@riptechnoblademinecraftkin3187]

​@@lapissea1190 it can be useful in games and animation movie industry for now its not (yet) there but in 2-3 years industry will start using it when it becomes good

[@riptechnoblademinecraftkin3187]

​​@@adamfilipowicz9260bro speaking facts 🗣️🗣️🗣️

[@Cimlite]

AI + VR = The Holodeck And I can't wait for it.

[@LilypadOW]

0:43 killed me

[@oxey_]

'completely lost their papers' 😭😭

[@Yourname942]

3:10 god that is so cool. I love watching your videos to see technology advancements, and it always makes me wonder how it will be used (ideally in game dev)

[@actsims]

"But couple of papers down the line", "What a time to be alive!" are in my daily conversations now

[@rileyguy5892]

Some of this AI stuff is pretty neat, but I'm really starting to miss your non-AI videos. It's been a lot of "Nvidia did XYZ AI thing that'll knock your socks off" or "ChatGPT is 9 hundred quintillion times smarter than a human" As an avid lover of the types of topics this channel used to talk about, I'm not gonna sugar coat it - I'm rather disenfranchised with AI. It's got promise, and some of things it does are super helpful. But I'm tired of it being pedaled like it's a miracle when it's okay at best. ChatGPT is *still* really bad at writing even intermediate level code or following along with a conversation for more than a few paragraphs (not to mention it's censored like crazy), and image generators still require a thousand words to get close to what you want. Plus, to boot, you almost always need a top-of-the-line GPU with huge amounts of VRAM to use these while basically sacrificing a computer to become a space heater while it runs. Otherwise, you pay for cloud services that are subject to profit-driven and advertiser-catering motives. I realize I sound like a sour puss. "Wah! Where's *MY* type of content, huh???", but it really feels like lately almost every video is a hype train about a new upcoming AI thing that will blow your mind like a nuclear warhead. I'm disillusioned with the AI hype train. I will be excited when I have one of these cool AI models as a coding helper that can actually give me proper suggestions that aren't mistakes out of a CompSCI minor's homework, when I can open blender and sketch up patterns that then generate materials or render a scene with an AI that approximates the light transport like you've shown so many times before (That last one is an example of something more along the lines of what I like seeing from you) I really miss the cool papers with really neat programs you can download and use, or cool new tech breakthroughs, or advancements in material science, or new algorithms for 3D rendering, just to name subjects that are along the lines of what I've historically seen out of this channel. I keep coming back here and every single video either has "ChatGPT", "Nvidia" or "AI" in the title, and I grow more sad that this is the pipeline with each one I watch. Especially when more and more of the time is taken up by AI generated images, or panning shots of older AI generated images, followed by "Wow!! This thing experimental tech is so cool!!", except it's just another slightly better iteration of a model that already exists, or it's some space age technology we can't touch yet, especially given the fact I've yet to see one of these fancy animation AIs implemented into a video game, let alone "Text to everything that will revolutionize my workflow I promise" I've been holding onto my papers for a while, but I'm seriously considering dropping them at this point. I feel the scientific and educational value of this channel has taken a nosedive, and I find myself not really gaining much from hearing about the same 2 or 3 technologies over and over and over again. The Blender 4.2 update video was a breath of fresh air, as well as the Nvidia/ISTA Austria video on water simulation. Those REALLY felt like good topics to cover and had the intellectual intrigue and educational value I crave. Please, consider doing more of that style of content again.

[@loneIyboy15]

I'm kind of with you. All these programs are out, supposedly promising so much, but whenever you try to get them to do anything useful, they're either totally incapable, or outright prevented by their makers. So far, the best use case I've seen for GPT is as a second opinion for Japanese-to-English translations. If I let it do the work on its own, it'll immediately go off the rails. So the intense focus this channel has on these is slowly becoming a drag.

[@River_Salmon_Dev]

Absolutely, I really miss non-ai papers being talked about.

[@juliandarley]

we are getting ever closer to the time when we can make acceptable full animated movies with AI and then photorealistic movies interleaved with human characters and hybrid characters driven by pose estimation. will this capability arrive this year, or will we have to wait till 2025? just think of the extraordinary, charming, intelligent, interesting films that can be made once feature film budgets can be in the tens of thousands of dollars instead of tens or hundreds of millions.

[@neighbor9672]

I’m just worried about the potential for a whole false narrative ala 1984 with this kind of tech.

[@jakeroper1096]

@@neighbor9672on the contrary it will force us to address problems that are already happening today but in sneaky and unaccountable ways. If everyone assumes any video is AI generated until it gets authenticated by 5-20 independent open-source authentication authority (kinda like our https cert auth chains today) you can choose the “authorities” you trust and can also wait for however many to authenticate as makes you comfortable…

[@juliandarley]

@@neighbor9672 yes, that is also true. as with the rest of gen AI, there is a lot of potential for malevolent misuse and abuse even as amazing and wonderful things become possible.

[@Cokk9ine]

@@neighbor9672that will probably happen at some point in history where the government just makes stuff up, but I don’t think we’re there yet they just twist the truth using careful wording

[@SirusStarTV]

0:56 *THE GREATEST TECHNICIAN THAT'S EVER LIVED*

[@frankjohannessen6383]

It would be funny to recreate those old-school text-based precursors to point-and-click games (i.e. Zork, King's quest), but with a physics based world and text to action AI.

[@hEElx7]

Text to simulated universe when?

[@randomperson21983]

Felícia Zsolnai-Fehér gets wilder in the scripts every time 💀

[@shrimplyfantastic]

0:49 the red one is doing the Rasputin dance from Just Dance 2 😂

[@StephenMinkin]

the....papers.... I too am fan of that word. This is one of the best KZbin channels.

[@amasiuncula2142]

Why is Claptrap and AI relationships with stairs still not a famous joke nowadays??

[@hiho9149]

Instructions unclear, I stumbled down a set of stairs trying to do a cartwheel.

[@RavenMobile]

A magic button to get sued by Nintendo. Well, that's certainly lore-accurate!

[@daxinnthenomad]

3:15 spawning in objects is gonna be fun

[@kinngrimm]

1:11 these bros need to learn about personal space

[@QuestionMan]

( 1:15 ) Yellow bro knows how to scratch a leg itch.

[@KeiNovak]

Purple Bro needs to watch his hand placement with Yellow Bro!

[@En0834]

AI 3d noise solving is insane, thats a whole next level!

[@Useless_Science]

3:24 we can technically make truly infnite games, infinite everything, just generate things on the fly. If the player noclipps, ai generate the backrooms or whatever.

[@jonathanmarsh8119]

They need to also work on a self preservation AI model, so that when you ask the AI to do something it will calculate the possible harm it would do. "Cartwheel down stairs" ... "Nope".

[@svorwerk]

😂 That magic button bit was hilarious

[@CollinSimon413]

The 3d noise looks so stinking cool!

[@MegaLokopo]

If we lived in a simulation, nerds would have super powers.

[@Klayperson]

They do, it's technology

[@MegaLokopo]

@@Klayperson Technology is not a super power, as a nerd I would know.

[@JackPadgett-z6w]

@@MegaLokopo it will be!

[@kevinsm2039]

Yeah, that’s cool but can we have some thing where we can make time go by slow because I feel like time is flying by too fast and we’re gonna die soon

[@epokaixyz]

Let's break this down into actionable steps: 1. Explore new AI tools for animation and 3D modeling. 2. Brainstorm unique actions and challenges for AI characters. 3. Imagine interactive experiences where AI characters learn and evolve. 4. Think about how to use AI to enhance storytelling, gaming, or education. 5. Stay updated on the latest AI advancements in creative fields.

[@TheVonWeasel]

2MP: "don't build a world full of stairs" also 2MP: *builds a minecraft world*

[@thr0w407]

Cl4p-Tr4p - "Stairs!?!? NOOOOOOOOOOOOOOOOOOOOOOOOO!!!!!!!"

[@djayjp]

Text to video game. Text to feature film.

[@konberner170]

That auto-lawsuit feature is pretty neat.

[@kamikeserpentail3778]

I'm laughing so hard at the Nintendo joke. It caught me off guard.

[@antoniobortoni]

Ja, Nintendo! Any new smartphone is a better console and can run Nintendo games... If you're spending more on lawyers than on innovation, then you're basically a mafia now. When it comes to movement in robots or virtual world characters, it all needs some coherence. What you really need is a small, fast, and efficient multimodal AI model. Add training on movement for a robot or game character, where the input is instructions (like video frames in low resolution and audio), and the output is the character's movement or even sound, speaking, or singing. It could be trained through self-learning. Imagine a video game where the only other player is an AI that acts like a human-reacting to what it sees and hears. The character would need a quick, small model trained to process low-res video and audio inputs, with outputs like movements or sounds, whether talking, singing, or performing actions. It would be hilarious to see how human-like an AI character could become in a game with just one player! 😂 Yes it needs now to screens one for the human player and another for the IA model that pretend be also a player... So in the near future we could have IA characters on our computers or virtual world or robots that is run by the same IA model, and the same IA model that could run a humanoid robot trained to be a really good women only also could run a 3d character in a videogame..... Some one need to make this possible now, and add control de PC or smartphone ability, puff... the best assistance ever.

[@imaUFO672]

This is the type of AI us artists want!

[@wwitness]

Excited for AI animation.

[@ChrisGuerra31]

Lydia is gonna be jumping through so many hoops in the future

[@Rolyataylor2]

Creating the physics environment for the AI to live in. The properties of the universe can be manipulated by the creators. The evolution of ideas over time is what I would define as conciousness.

[@franciscojuane2505]

A minute of silence for game devs 👍

[@reifuTD]

Next need to combine that World Maker AI with Doom AI and start shooting things.

[@AlienXtream1]

seriously... there's like 3 more things we need before we'll basically have star trek holo deck level stuff... local dedicated hardware capable of doing this (remember, the first computers were the size of apartment buildings and boasted megabytes of ram. now you can have something literally thousands of times more powerful on your wrist) (faster than) real time performance continuous memory and recall

[@coloryvr]

oh wow! ...this is triggering my fantasy on creative possibilities...I hope it will run locally (?) ....Big FANX!

[@JustFor-dq5wc]

This new king sux! He moves like a drunk, his karate is weak, and wisdom is unknown...

[@ramlozz8368]

We are about to speed up get ready!!

[@KryyssTV]

Just need to put it into a robotic body now and then tell it to use karate on the "green ball".

[@daveinpublic]

The ‘AAAANNND’ was really strong with this video

[@technik27]

Unpopular opinion: Two Minute Papers was more fun when not every single video was "AI can now do this"

[@HansKonrad-ln1cg]

looks really good with the toe section of the foot that can bend. now we only need robots like that. i want to see a humanoid robot lift its heels and stand on its toes!

[@hellohogo]

It’s crazy how powerful Nvidia can be, yet no one is using their ai

[@DanielAusMV-op9mi]

Wow that is so cool ! ❤ You always blow my mind and make me excited for the future

[@EneaSus]

Can't wait to play the real Scribblenauts

[@MTheoOA]

Pretty funny video though, very informative too. One of the youtube GOATS

[@TwoMinutePapers]

You are too kind, thank you so much! 🙏

[@abdusalamolamide]

What a time to be alive❤❤❤

[@manongblah6731]

Holy!! Do you think in the future, there would Ai controlling an Ai controlling an Ai??!

[@igoromelchenko3482]

I demand to implement it into games immediately 😅

[@MrFreeagent505]

The 3d world thing looks basic now but imagine it in a few years.

[@JikeWimblik]

Image generation would be faster if you started with noisy big blocks go down with specially trained ai's for each step too small pixels.

[@SHPfz]

what if we use images (could be acquired from tti ai too) for generating 3d terrains, then we generate 3d models and attach them with masked mimic and chatgpt. It could be a fully ai generated 3d agent with some movement abilities in a 3d world.

[@itsDhiran]

If applied to robotics, we are gonna get some freaking robots...

[@RagBrokeHisThumb]

I opened this in another tab to watch later, came back to it after about 30 minutes but was 29 minutes too late: Another AI paper already came out surpassing this one 1,000,000 time's

[@person-jw7vb]

Wow, that sounds awesome ! Could you tell us exactly what ai paper you are refering about ?

[@ricarditoortiz1242]

​@@person-jw7vb sarcasm

[@krisszalai]

Hamar el fog készülni a következő animációs film 🙂

[@wojtsterna]

I constantly feel lied to. This is 5 minutes papers, not 2 :)

[@skully959]

INSANE PROGRESS

[@cedrigo]

Amazing! Thank you!

[@telotawa]

without dearrow: NVIDIA’s New AI: The King Is Here! with dearrow: NVIDIA’s New AI: Small Iterative Progress lol

[@lapissea1190]

Could you cover the new UV unwrapping algorithm that just landed blender? It looks very cool

[@viktorsincic8039]

WHAT A TIME TO BE ALIIIIVEEEEEE

[@cloudzero2049]

Wow this is the best one for awhile.

[@trumpisbackboi]

Dystopian hell ahead

[@jimbodimbo981]

0:45 me on a Friday night

[@ahihi7706]

"He's beginning to believe"

[@golden-gamingmore5931]

the nvidia AI is so coool, however the text to 3d ai would be really problematic but uhh ye ye

[@Jess-h2h4w]

In 1:54 why the character have their hand flying in the air?? Pretty sure walking on uneven terrain is already done without AI, using procedural. and also pointing with hands can be used in inverse kinematic bone (ik bone)

[@seanharbinger]

Definitely not living in a simulation!

[@punpck]

what a time to be alive!

[@spartan22550]

Yes but can he handle an utah teapot ? insane progress

[@kevinfontanari]

You definitely do not need a special button to be sued by Nintendo, I can assure that much

[@natty7102]

"And"

[@ayoCC]

Researchers should work on the training speed. I want to see an AI that can learn something new adter a couple tries

[@5T0Px]

Wow imagine in 5 years in 2030 how this decade will be insane. Npc and all physics in video games will be ai boosted. Perfect ray tracing, resolution, framerate, volumetric clouds snow sand fire smoke water. Unreal engine 6 ai boosted with NPU chip even in consoles ps6. Connected with little glasses mixed reality 8k per eyes. 2030 life will be different.

[@RM-xr8lq]

that is pretty optimistic for only half a decade

[@usualatoms4868]

Must be a horrible way to gradually become concious. Inside a computer realizing you've been doing stupid tasks for humans your whole life.

[@Kreuzrippengewoelbe]

It's not conscious, don't worry.

[@alistermunro7090]

What a time to be AI.

[@_John_P]

Is there a "Moore's law limit" for papers?

[@testedforquality4639]

Can only offer this service with Nvidia chips. Wow. Nobody wants to be left behind. Nvidia to $200 by December 2024. This is the future in the present.

[@goblinjedly9528]

are there any new realtime raytracing papers?

[@Dylan-jj8xc]

How to (re)create dreams!