NVIDIA’s New AI Did The Impossible!

[@LarryPanozzo]

I love that picture of you two holding onto the paper 🤩

[@7415_Gamer]

That was the Two Minute Paper

[@Juan-qv5nc]

@@7415_Gamer That paper was a game changer. A breaktrough, if you will.

[@7415_Gamer]

@@Juan-qv5nc Breakthrough, What a time to be alive.

[@defeatSpace]

Mr. Nvidia looks like he's looking for security 😆

[@KWifler]

He doesn't look anything like I imagined 😅

[@MrTomyCJ]

I would like to know what the video is about before clicking. To me this title is too blickbaitý and cheap

[@Kynatosh]

I clicked just to see what it spoke of and closed it.

[@NotAProducer888]

Pretty interesting, Much easier to create images with consistent characters, which is pretty hard to do now. Support of controlnet, which allows you to draw for instance stick figures in order to determine the pose of your character Very easy text to video and even 3d geometry, and even text to animation The impossible part is that NVidia also achieved to make a thermal analysis of the NASA mars rover.

[@johnnywoodstock]

Yes. Please. Make youtube a better place

[@Youften]

may i suggest the browser extension "Dearrow" that does just that, it replaces any clickbaity title with usergenerated titles that are discriptive of the contents of the video. for instance this video with dearrow enabled is titled "nvidea achieve major advance in character consistency"

[@icegiant1000]

I use to write 3D rendering software back in the 90s (Pixel 3D on the Amiga platform working with Lightwave). You guys are way way more advanced than anything we had back then. However the wave/ray tracing technique, which we certainly had back in the 90s, looks very close to another technique we had called radiosity rendering. Where light was calculated as a heat transfer, which is a much more complicated calculation, but produced the finest images back then.

[@LoopinFool]

If I ever submitted a 3D animation for the SIGGRAPH Electronic Theater, I was going to title it "Radiosity Killed the Cat" and come up with a story to match the title. I still have a 3.5" Pixel 3D disk somewhere.

[@icegiant1000]

@@LoopinFool Dude! That's awesome! I sir, put that label on that disk. I also wrote the software! It's true, it wasn't a fever dream, I really did do that stuff. LOL. 😁😁😁

[@me_fault]

Diffract Killed the Radiosity Star

[@ivanaguilar2856]

That's really cool that you worked on this and on the Pixel 3D software on the Amiga. I think you will like these thesis topics from this year's SIGGRAPH conference, there are some really interesting topics discussed - kzbin.info/www/bejne/q3-mfWOjr8eDepI&ab_channel=ACMSIGGRAPH

[@icegiant1000]

@@ivanaguilar2856 I love SIGGRAPH, believe it or not my company showed at I think two of the SIGGRAPH conferences in Vegas, I think early 90s. Axiom Software. Thank you for the kind words about Pixel 3D.

[@andregustavo2086]

Can't wait to download martial arts in my brain

[@albert6157]

The matrix 🤩

[@muffinconsumer4431]

You’re beginning to believe

[@JohnSmith762A11B]

I know Kung Fu.

[@rickybloss8537]

You'll pull every muscle in your body lol

[@BaldAndCurious]

​@@JohnSmith762A11Bshow me 😊

[@CapemanProducti0ns]

Remember those old adventure games where you had to write your actions? This text-to-actions ai will make some really fun new era physics based text games.

[@phizc]

I liked those old Sierra games. I played them when I was just learning English. I still remember having trouble figuring out what "Ditch the b**ch" meant in Police Quest. The dictionary wasn't a great help 😅. What has female dogs to do with roadside waterways. Great education for a 10 year old Norwegian kid though. I ended up top in my class.

[@contentfreeGPT5-py6uv]

Text to animations,bit text to actions Will better, text to games

[@romanenkostas]

So why we essentially need a text as a prompt? It seems that using signals from gamepad would be the next logical step.

[@henrythegreatamerican8136]

And best of all we will eventually be able to create our own unique short films rather than depend on horrible HOLLYWOOD.

[@creativebeetle]

​@@henrythegreatamerican8136You can already make your own short films, you just can't be bothered to.

[@tojohahn8529]

TWO MINUTE PIZZA!?! What a time to be alive!

[@UlyssesDrax]

Haha... was looking for this. Never disappointed.

Frozen pizza re heated in the oven, some pizzerias work like that but the pizza tastes like cardboard to me.

[@hoedwae4307]

What a time to eat!

[@qs987]

oven takes

[@NoobieLandCity]

This wasn't frozen pizza though and freshly made pizza take less time to bake in a pizza oven, took around 2 minutes to bake and you have to move it or it'll burn side or under in like 30s or less

[@Soul-Burn]

To be fair, Two Minute Papers is also usually 4+ minutes. Fascinating advances in those papers!

[@kittengray9232]

Dr. has a video about that. How his videos scale up by time.

[@Soar-hw2rw]

There will come a time where the perfect martial art is developed by AI.

[@dan-mg4fi]

yup. and thats super cool. cant believe so many people oppose AI.

[@kaseyboles30]

As long as it's not some 2bit Ada together set of moves seen Turing Asia. I'd have to give that a Pascal.

[@Danuxsy]

and the perfect twerk

[@arw000]

Uses special techniques such as clipping through your opponent's defenses and crashing the simulation when checkmated.

[@Krowseff]

Ai-kido is gonna be scary for sure

[@JorgetePanete]

Pizza oven time: [Italia et. al. 2023]: 15 minutes [Ours 2024]: 2 minutes

[@TwoMinutePapers]

😀

[@一本のうんち]

@@Barefoot_Joe yep, thought the same

[@jeffreyspinner5437]

Now I want Pizza.

[@RFC3514]

A traditional Margherita takes 55 seconds to cook in a pizza oven.

[@JensonTM]

blender 5.0 is gonna be crazy with those wave optics

[@WayOfTheZombie]

At a point when ai becomes extremely useful it will also be expensive. Don't think Blender won't charge you to be able to make a vid game or movie

[@JensonTM]

@@WayOfTheZombie what the yap, why would blender every charge you, its whole moto is free and open source

[@JocoseJokes]

@@WayOfTheZombie Blender wont, the entire point is that it's free and opensource. I'll pay you a thousand bucks if they ever make blender a paid software lmao

[@rickymort135]

0:00 You've never started a video with THAT noise before 🧐

[@slideshowjoe425]

Thank you for including a timestamp for the beginning of the video.

[@NPJGlobal]

@@slideshowjoe425 Indeed, this was truly an act of public service from him.

[@nalivkin-ls3pg]

I came across your channel through this video-case studies are incredibly valuable, and I'm eager to see more in the future! Building wealth involves establishing routines, like consistently setting aside funds at regular intervals for smart investments.

[@Freya-jq8mc]

You're correct. I think the smartest way to go is to spread out your investments. By putting your money into different asset classes like bonds, real estate, and stocks from other countries, you can lower the risk if one part of the market goes bad.

[@Matthew-mb6oy]

That sounds like a good plan. In the past two years, working closely with a financial market specialist, I've built a six-figure diversified stock portfolio. Now, I aim to diversify even more this year.

[@Manselus-c1f]

Talking about a financial market specialist, do you consider anyone worthy of recommendations? I have about 100k to test the waters now that large cap stocks are at a discount... Thanks

[@Matthew-mb6oy]

My CFA ’ANGELA LYNN SCHILLING’ , a renowned figure in her line of work. I recommend researching her credentials further. She has many years of experience and is a valuable resource for anyone looking to navigate the financial market.

[@Manselus-c1f]

Thank you for this tip. It was easy to find your coach. Did my due diligence on her before scheduling a phone call with her. She seems proficient considering her resume.

[@Solizeus]

That is how i want a "the sims" character to move

[@MilosCsrb]

Make your own sims game

[@RemyVonLion]

I was just thinking yesterday that a super cool game would be the sims but without restrictions, just purely physics based with total freedom. Every character would be an intelligent AI with an entire life-cycle and routine, and you can just interact with it in anyway. Like GTA mixed with the sims lol.

[@Solizeus]

@@RemyVonLion Yeah, that is exactly what i would want as well, and with IA bot dialogs preferably something like chatgpt 4 level of conversations, no more unintelligible mumbles, and i want to see them fight like martial artists not that cartoon cloud like the sims do, even if it is not a game, but an engine for RPG games it would be awesome

[@RmX.]

InZOI is planned to be released later this year. But I don't think they will use ChatGPT

[@Happy-vz3xe]

Man what a time to be alive I am 14 but after watching so much of you I understand everything

[@jmg9509]

Always remember when you reach a point when you think you know it all... you actually know nothing. You will soon learn this yourself.

[@Ace_Bandido808]

​​@jmg9509 what does that have to do with anything he said?

[@jmg9509]

@@Ace_Bandido808 It's naive for anyone to think that they understand such a complex topic. Not even the people researching and developing AI would tell you they understand what it's doing. They'd tell you it's a black box. Now, he could have meant he understands the overall picture, which is of course fine.

[@RubelliteFae]

As unfair as it may sound, some lessons are only learned with the passage of considerable time. If that's too obscure, here's an anecdote: In my mid-20s I understood how limited my understanding has been in my teens. By my 30s I realized the same was true of my 20s. So, I decided to regularly remind myself how little I actually understand in order to not fall into the same trap again.

[@DjSapsan]

I was totally expecting this guy in the end to take out a new GPU from the owen

[@duffsdevice]

Boyy the mannequin at 4:04 dressing up the shirt is mad impressive 🤌

[@dilithium72]

As an animator, my profession has been one of the areas that has resisted the onslaught of creative AI well, I think. I suspect there are less days ahead of me, than behind me, now. Time to diversify.

[@DisturbedNeo]

Consistory is interesting, using it with controlnet and the right Lora and you could create spritesheets for 2D animations.

[@ceejay1353]

Where do these Nvidia findings usually make their way into say things like gaming and such? Do they come in the form of Plugins? Built directly into the Engine?

[@supersonictumbleweed]

they come in a way of (gaming) developers learning about them and applying them

[@ceejay1353]

@@supersonictumbleweed Ah, I see, so not quite like how they did Hairworks and such.

[@QuantumConundrum]

Eventually someone will implement this in more engines for use in say, vfx/film. The full em simulation, especially if you don't care about real-time rendering and what you want is realism.

[@Dimencia]

DLSS and Frame Generation are a good example, some very advanced AI stuff going on in there, and today it's just a checkbox in Unreal or Unity to enable it for your game. NVidia provides generalized APIs/Libraries, just some methods you can call once you import them, that makes it easy for engines to add it without developers having to understand the entire scope of the research

[@chrisr6994]

I remember when this channel only had 10k subs. You've come a long way, Dr. Karoly.

[@LordBadenRulez]

My weekly NVidia ad, what a time to be alive!

[@interiorlabai]

Woow what a time to be alive!

[@twylxght]

I'm learning more and more I can't watch these while high. Lol I was frickin STUNNED at the text to animation and blown away at that proof of concept.

[@antoniojimenez7242]

It is amazing the pace of development! Hope it continues for a while before it plateaus.

[@nathanbernards]

The toy owls painted on pupils dialat based on the lighting conditions, just thought that was interesting

[@StickerWyck]

I'm sorry but all those tech giants are just awful; nVidia especially. Don't get me wrong, I used to watch these videos with optimism, but what's the point if everything is going to be BlackRock or just as bad? Every breakthrough now just looks like another win for all the wrong people.

[@TheSuperSpecialOne]

Exactly, just more support for evil to exploit the market and spit on everything as always.

[@AaronBlox-h2t]

Yes , but you know..... with AI, they can really maximize the surplus value extracted from the working class and eventually, supplant it altogether.

[@thirien59]

Ai is going to be open source And that means that black rock can’t possess anything

[@syedminhaj-ul-haque1982]

Microsoft had monopoly over computer os for a long time that doesn't mean it didn't provide value to others.

[@AlphaVisionPro]

BlackRock? What's up with that?

[@RealityRogue]

4:19 as an audience member looking to learn I appreciate this a lot !

[@TwoMinutePapers]

You are too kind. Thank you so much!

[@getsideways7257]

I usually don't care about such details, but now I'm genuinely interested to see a video showing you doing the narration, thanks to that photo.

[@AuntJemimaGames]

Text to animation is something that DeepMotion has been working on for some time now, and it produces quite good results. From what I've heard, the outputs are even cleaner and require less post-processing than typical motion capture data.

[@collin4555]

Generative animation seems really cool, I hope to be able to play with that some time

[@davidmassey5448]

The ~4 minute timing and correction is why I trust you with my life Doctor.

[@as-qh1qq]

I had never thought I would see wave optics in light solvers (or at all outside of dedicated Maxwell eqn simulations). Amazing step.

[@davidanderson5310]

If the NVIDIA cafe was really "2-Minute Papers Style", the pizza would have arrived after 10 minutes.

[@vladimirilyushko5614]

I would like to see how waveform light simulation develops in the future.

[@ZYTHI]

Wow, the advancements in AI are simply mind-blowing! The text-to-animation technology has endless possibilities, from gaming to film, and I'm excited to see how it will revolutionize the creative industry. NVIDIA is truly pushing the boundaries of innovation, and it's amazing to think about the potential applications of this tech. The pizza oven demo was hilarious, by the way! I loved the humor and lightheartedness of the video. Two Minute Papers always delivers insightful content, and I appreciate the effort that goes into making complex topics accessible and engaging. As I watched the video, I couldn't help but think about the future of animation and storytelling. With AI-powered tools like this, creators will have even more freedom to bring their ideas to life. I'm curious to see how this technology will evolve and change the creative landscape. One thing's for sure - it's an exciting time to be alive and witness these advancements firsthand

[@DarkSwordsman]

I can imagine in the next few years, people will be experimenting with game rendering almost completely in AI. Imagine playing a VR game where the character animations and graphics were completely rendered with AI.

[@test-uy4vc]

What an attack time for ai to move alive! 🎉

[@jimjajmus]

can the light as a wave modelling tool be used to model sound as a wave rather than ray tracing? nvidia vr works audio uses ray tracing.

[@Maffingo]

This whole time I thought you were a wizard with a long beard and a hat

[@JenniferBores]

*Having multiple streams of income is a game-changer for stability. Relying solely on a job may not provide enough financial security due to high rates of tax, it is important to explore additional investment opportunities to surpass one"s expectation*

[@TomTahk-fn6si]

To be honest, investing correctly today can save you a whole lot of stress in the near future

[@ChimaobiIkechukwu]

The first step in every successful investment is to establish your goals and risk tolerance, a task best undertaken with the assistance of financial advisor.

[@HeatherAnabelle]

I remain eternally grateful to Judy Arianna for her efforts that got me to this point, finally payed off my mortage and all my debts, what more could I"ve asked for. She changed my life

[@Aldanelvillanueva530]

I'm new at this, please how can I reach her?"

[@LeslieDcobbs-of7ie]

Don’t be confuse buying the dip in a bear market, with guaranteed future returns. Just because that company is down 60%+ from ATH does NOT make it a sound long-term investment. Make sure you’re investing in great companies. kudos to Judy Arianna

[@gawkthimm6030]

as someone who is completely coding ignorant but very interested in AI and simulation tech for their implication for wider society and other fields and professions, I would really love TLDR for dummies about what these short videos you do means in general?..

[@tiagotiagot]

Since it's physics based, that text-to-animation system should be a great starting point for directable robots, and maybe even facilitate LLMs controlling robost.

[@coulterjb22]

I recognize you are discussing a paper and how we’ll be able to create the same character doing different things, but are the examples you showed available now or was that from Nvidia’s examples?

[@coulterjb22]

Cant delete…:(. Should be rolled out in the future.

[@coreyhughes1456]

Woow, that text to animation demo is next level.

[@omairsiddique5362]

2:15 So, this is just for animation, or can this be used to for robotics applications as well

[@FromTheAshesWeRise]

Sweet, Nvidia finally did what Tekken did 30 years ago.

[@FromTheAshesWeRise]

Before everyone freaks out, I'm just poking fun at the model movements. :)

[@Ricardoromero4444]

Dude even benchmarks Nvidia's pizzaria for us 😂

[@scottmiller2591]

Finally, a way to find where the cellphone reception is best without walking around like a dowser.

[@Yourname942]

2:12 for a second, I thought you were going to say, "and someone already outperformed it"

[@KryyssTV]

Nvidia has said their long term goal is to change the way game engines and GPUs interact by having the rendering pipeline be entirely AI driven. Meaning that rather than an engine feeding the result of calculations to the GPU it'll instead feed prompts to a rendering AI that will handle the task instead. Once optimised, the AI will render scenes faster than game engines and with complete photorealism if required.

[@KalkuehlGaming]

Point cloud animation is a game changer for gaming. I hope this technology will be adapted soon.

[@OSuKaRuTV1]

The animation one would be a killer in videogames.

[@Prague3203]

So all those sticks, figure animations that can be viewed online are going to look quite exceptional if they’re passed through this software to be animated

[@xzendor7digitalartcreations]

Impressive. The advances in AI are astounding.

[@MelonadeFX]

man they just made wavetracing, that's absolutely incredible.

[@kein2009]

Thanks for sharing all this papers with us in a very entretaining matter.

[@williamjordancooley9990]

Is it possible to preserve a character with current tools for editing an image rather than generating a new image entirely? Like, could I 1) generate an image with a character, 2) erase everything around the character and 3) regenerate around it?

[@BenjaminKing-h6w]

plot twist: the picture of both of them holding the paper is also AI generated 💀

[@hrihori_art]

twist: the world in which you wrote this comment is also generated by AI

[@panzerofthelake4460]

twist: your comment is ai generated and so original

[@hrihori_art]

@@panzerofthelake4460 thx

[@randombleachfan]

Midjourney has a character consistency feature but it doesn't allow real people yet, the character consistency feature works on MJ generated image.

[@jeffg4686]

@7:23 - "Enjoy the Ride" (as they sneak in all the kids while holding you down). Sponsored by Pizza Hut

[@Zanroff]

I can't wait to give commands to AI NPCs and they just go do it.

[@jmg9509]

It’s called ChatGPT lol

[@fratolcay7156]

Hold onto your papers ✌️

[@jantube358]

I heard that NVIDIA has the problem that over 50% of their employees are millionaires now because the stocks have gone up so quickly and now they don't want to work anymore. What do you know about that?

[@TheMrDJD]

Now we just need this as a node in ComfyUI!

[@generrosity]

Squishy Sierpiński and squishy dna is not something i expected to need in my life 💚

[@erikals]

You met one of the Most Powerful Men in the World ?! Holy Paper !!! ☺️

[@colepeterson5392]

Wasn't IPAdapter doing pretty much that with Stable Diffusion?

[@Zanzuibarth]

Funny how a real person can sound so much like a bad TTS. The accentuations sound like that of a robot.

[@mylittleheartscar]

Lot of Ai bangers dropping today!

[@Bil30321]

Does this mean 180 3D VR immersive videos will be possible? (Prompts like Millenium Falcon flying through Death Star tunnels, Avatar Flight of Passage ride, being chased by a TRex)

[@tiagotiagot]

Would that wave-based renderer help make Blender's Cycle's spectral, or it's too different to how it currently works to be adapted into the current system?

[@QYong-rq6iw]

where can I find the paper at 2:05 Park et al. 2023?

[@JamesJohnson-uw5fe]

Love your channel man, you do an amazing job every video and I appreciate you and what you do.

[@LimitedWard]

The pizza demo was a bit slow, but I'm sure they'll have that figured out a couple more papers down the line!

[@scriptod91]

it would be interesting in making some sort of realistic fighting game like this, where as a player it understands your input and create animations based on that, fighting would be more realistic but also amazing. i can imagine making two bots fighting and having them reach great heights

[@whatNtarnation90]

I get so triggered when people CONFIDENTLY say we wont be able to make games/movies/etc with AI soon... Not only is it not already possible, but it's all progressing at light speed...

[@jsu-oz1fo]

text to simulation next? with real physics simulations like FEA and CFD with just a text prompt

[@MrDeZaaa]

OMG, new videos from Corridor digital are gonna be crazy !

[@Ezfar1995]

Real Steel irl fights looking pretty good

[@aljoscha.merlin]

And when I see the foam, I'm in my zone!

[@DeviantJones]

Honestly. The animation stuff making it into games.. can't wait..

[@Phooenixification]

Imagine fighting a character in a game and he tries to do a roundhouse kick on you so you dodge it and he falls and beakes his hip

[@gronkymug2590]

Does it work for environment behind the person or just for the generated person?

[@K2142F]

Perfect light simulations will help with achieving FDVR someday

[@jshanker2005]

*AI is going to ruin humanity!* The next decade is going to be hell for new job seekers !!

[@danbhakta]

Text-to-porn will be the Holy Grail of AI like VHS was to same industry back in the day.

[@spyboy_]

They missed out on using the waste heat generated from all the GPUs to cook the pizzas.

[@areox27]

Nice, similar to what CartwheelAI is doing

[@franciszekadamski5037]

@TwoMinutePapers, wonderful video as always and, as always, very exciting. I have to say, that this time I found it hard to finish - pauses every 3 or 2 words make it somehow difficult to listen to

[@guyfromostrava]

Character consistency has been a thing for a while now (at least a year) for other AIs.

[@zeekjones1]

3:36 The bot didn't have reflexes yet. Guess that'll be in a month, in the next paper.

[@pietrorighetto1496]

I am so hyped for the future

[@JohnSmith762A11B]

Best to be hyped for the present, as that is all you'll ever experience. Future? It may or may not arrive for you, may or may not resemble what you hope or expect when it does, but by then it will be the present. Never live exclusively for the future or you will waste your entire life.

[@jmg9509]

Well said

[@StickerWyck]

Hope you like renting over owning things.

[@IsMyNameUnique]

yeah right? cant wait for the rich to get richer and the rest of us to be in the office unable to pursue anything art related cuz like, why do what ai can do more efficiently 😂

[@realBeltalowda]

That pizza was rendered in real-time 🤯

[@mikewhite955]

I‘m so excited to See Movies with every detail thats written in the books. :)

[@AS40143]

This falling is not bad at all. It proves that this Is real body control in physical simulation not a baked animation

[@zoltancserenyi6598]

Is there any possibility in the future that AI can make game remakes with newer graphical engine? With or without original source code?

[@moderator_man]

So about this character consistency thing... Is this something I can use in automatic1111 web UI or is it gonna be a while before that happens?

[@wolframstahl1263]

Hold on to your pizzas! This dough transport algorithm works in real time and beats previous tray-racing techniques.

[@GhostEmblem]

It wasn't really clear but were these all the same AI model or were their different models for different things?

[@testauthoritytes9917]

All right. AI does text , speech, image , video or content recognition, does some generation answer basic questions etc etc that takes out jobs of content creators, some operators or call handlers etc. But how is it solving any complex problems with the bit of intellect in it ? So far we are seeing pretty basics and it's been 2.5 years. We are still talking about improvement on same subjects what we had 2.5 years back.