RDR2 with ultra-realistic graphics Gen-3 video to video Runway ML Artificial intelligence

Red Dead Redemption 2 with ultra-realistic graphics Gen-3 video to video Runway ML Artificial Intelligence AI
RDR2 REIMAGINED BY AI
AI OVERLAY
AI OVERLAYS
GAME TO VÍDEO
intelligence #rdr2 #rdr2online #ai #runway #runwayai #artificialintelligence

[@SOUNDTRICK]

This AI technology does not yet have as a reference the real geometry of the game or other more accurate game information data, everything is based on the final frame delivered by the game, there is still much to evolve, this is just the beginning. THE FUTURE OF DLSS

[@Romeo615Videos]

prompt looks amazing.... week after next ill have time to work on a photoreal prompt this good. Looks great bro I know the time it takes to make these keep up the good work this will pay off just keep at it.... looks great!!

[@jjj515]

Can you make a video on how you make these type of videos please?

[@Romeo615Videos]

@@jjj515 yea im working on the right prompts then ill help everyone I found some really insane settings now i have to text em but check my page you'll see some

[@kozyisback]

Maybe next time you could do some cutscenes with Aurther? I'm sure we'd all love to see how he'd look!

[@iSpart2299]

how do you make it

[@RogueAI]

It's crazy to think our ancestors went their entire lives with little change, and we get a major tech advance near monthly now. Feels like we're at the tail end of the singularity and about to blast off

[@MrGTAmodsgerman]

Idk how young your parents or what ever are, but my one grew up in a time where they had to take the same bath for the whole family just about 20 years after world war 2, lived in a country that was devided into two, lived the reunion, saw the technology shift of 50's cars up till now with they own eyes, saw TV's becoming affordable and in color coming up, saw the internet coming up with all the Computers at home in general and still are being part of the current world.

[@burkanx5546]

@@MrGTAmodsgerman So your parents were born sometime around the 1950s in East or West Germany?

[@Pasha_Shkaf]

Were basically gods for them now

[@undermind0657]

Runway has no actual reference of game geometry. It's making results based on existing reference. otherwise it couldn't generate a video with such fidelity of its own.

[@MrGTAmodsgerman]

@@burkanx5546 50s yes, but no, later went to Germany.

[@dummykeir1717]

Ray-Tracing in videogame? Nah that's so old school, now we AI-Tracing

[@ScottPowersArt]

AI AI CAPTAIN!

[@ChairudinjarotDjarot]

AIien Tracing 😂

[@gu9838]

for sure! this is gonna be a real thing in a few years i bet!

[@Tylersimpson01]

Feel like some of the game shots look better than the AI shots. Like the waterfall. Credit to how amazing RDR2 looks.

[@UFOgamers]

I think It's because he specifies in his prompt that it is a western… So the AI apply some weird Hollywood filter from old movies.

[@Rocka7038]

​@@UFOgamersno it's because RDR 2 just looks better

[@xxe2]

😂​@@Rocka7038

[@cessposter]

​@@Rocka7038yea who the fuck could have possibly thought an entire fucking game studio is better at art direction than some random fucking guy

[@fedyx1544]

​@@UFOgamers I think ai just sucks at waterfalls

[@JustATanneriteDummy]

Once this is live rendered its over. Advanced game/feature design will be so much more attainable with less visual rendering needed for GPUs and devs will be able to focus on creating more for you to do and less on more for you to look at. I see this is a major win for gaming.

[@Daniel__Nobre]

We are still quite far from the computational power that will allows us to have a real time AI interpretative layer, but damn does this feel like a peek into the future indeed. And when that happens, I completely agree that it will be a big win for devs given the focus can shift from putting so many resources for creating a visual skeleton of a game and more on the underlying complexity (which will most likely also have a lot managed by AI systems - meaning you won’t be just seeing an hyper realistic world, but you’ll be interacting with a very realist behavioural one as well..)

[@TechThroughHistory]

@@Daniel__Nobre Who says we need more computational power for real time AI overlays? I could see this being automated in the cloud and you download it as a texture pack for the game you choose to play. These videos are a nice tech demo though as you saw, some of the shots looked worse off without the game's graphics. I believe we cannot allow AI to do all the heavy lifting. I used to believe AI would be able to do everything, though it's mankind's touch that will still be the main driver behind innovation.

[@MarioSantoro-ig5qh]

It might take awhile still because Nvidia wants to milk every dollar they can from ray tracing/path tracing first.

[@ethandudash1073]

That'll be the day when the matrix actually becomes possible... I'd play around in there just as long as I don't get stuck in there

[@Daniel__Nobre]

@@TechThroughHistory This kind of AI processes usually require quite a bit of computational power, let alone doing it in real time. But indeed, like you mentioned, maybe it could be rendered on a server farm somewhere and streamed to our devices. Yet, I think it would take setups that are probably not worth yet, business wise, due to the costs associated with them.

[@syberpunk]

0:32 The game looks way better lol.

[@SynthLizard8]

The AI looks like a live-action movie.

[@bibio2001]

assassination in game now is literaly gore video 💀💀💀💀

[@MasteroChieftan]

Nvidia will fogure out how to do this in real time and with greater accuracy. This is the future of graphics tech.

[@HofEE52]

The first game where the ai stuff is not better. Rdr2 is a masterpiece.

[@boi9842]

The AI version is better though

[@playcloudpluspc]

Tone down the saturation and make the colours more faithful to the original and the AI would be better all the time. The character models are so much more realistic.

[@flouserschird]

I never imagined as a kid this was possible and now here we are.

[@AquDrIFT]

Tbh at this point I won't be surprised if by 2050 we could literally import our consciousness in a game. Like, a chip or something, induce a trance, and then simulate an entire universe, in our brains.

[@estertreier2779]

​@@AquDrIFT Elin Musk has a plan with microchips.

[@MrAmbience1]

I'm excited to see how it will change games in the future 😯

[@herald1953]

can you do LA Noire? i am curious how the AI interpret the faces in that game

[@jcm2789]

Good idea ❤

[@heksen800]

Imagine this tech in about a year or more. This is going to be insane!

[@rombofn]

Yeah this is truly next gen NOT the next gen bullshit that we have now

[@pece9164]

😂ps5 is not ready for this))

[@jonascwynar453]

Even if current DLSS has similar downsides to this type of render, specifically reduced definition , it still brings in my opinion more immersion, as we also never experience perfect vision in real life. That’s why noise and high contrast with blurry elements in movies/ photography, or impressionists painting techniques usually deliver a stronger result. The only thing that would need adjustments’d be around depth perception and the general result would overshadow the small uncanny artefacts this model produces. Can’t wait for Nvidia to eventually do it. In the meantime thanks so much for making us dream this is insane !

[@taicunmusic]

Omg OMG OMG, now imagine combining this (generating the game in real time) plus adding AI NPCs with GPT4 advance voice mode, and also an AI which lets them live realistic lifes. And all of this will be possible in like 2026, I can't even believe that this will actually exist, I don't know how gaming could get any better than that

[@pkfreak93]

You could also just go outside.

[@UnitedDiscord]

POV: You ate a bunch of cheese and played RDR2 before bed.

[@Wott786]

Real

[@KOHENT93]

Yoooo

[@masteryoda9629]

Those hands with beer look so creepy! I have heard that the most hardest is to make hands for AI. Is that true? Like AI can't understand how our hands are moving properly))) it's always strange. Anyway thank you for doing that. So cool! 😮

[@bucadstutorial]

I m totally supporting this channel

[@Coltara]

Try Kingdom Come Deliverance next 🔥

[@berastis4431]

Now these animations feel much more real then gta v

[@MrEleman]

This won't happen in real time for a long time yet. At least they gave us realistic face generation for starters.

[@czefix]

!Remind me in 5 years 😀

[@rombofn]

Hahahah “for a long time” thats the same thing that people said a year ago about Video Generators in general and here we are a year later

[@MrEleman]

@@rombofn It takes a lot of time and power in kilowatts to process 15 seconds of video from a game. Do you want 60 times a second to process each frame at 500 watts? That's not gonna happen for a very long time. Certainly not on the PS6 generation, and not even on PS7

[@MakerTributeFan]

@@MrEleman When GPT4 was launch, it needed 40x more compute than today model (with same quality). So no, at this rate in 2-3 years from now this model quality will be in real-time. But the best model in 2-3 years wont be in real-time, but it will be in 4-6 years. Etc.

[@MrEleman]

@@MakerTributeFan This is about the text model. Changing video data in real time is a matter of many years.

[@xcviij7045]

I'm excited for real-time AI video filters so I can play RDR2 and other games realistically both on my TV and in VR.

[@Ceeed100]

Ohhhh new prompts? Nice :D Great results. I bet we get this in realtime in the next 5 years at max ^^

[@handsafter]

this shows that you don't need overdramatic graphics for pure realism

[@lemonaut1]

Holy shit i had no idea RDR2 will age this poorly, this makes it look like complete shit. Great work!

[@jerobyarts5654]

So, the key to a realistic look is active downlight and subsurface scattering

[@Mr-Prasguerman]

The future doesn't look so bad...

[@VincentStevenStudio]

This will revolutionize Game development. Game developers will be able to focus more on Game mechanics, animation, and story telling and just let Ai take care of the graphics.

[@patrickalmeida8856]

3:05 This is what I think when someone say something about graphic improvements, this is almost like when we improvement from the PS2 to PS3

[@SillyTubereal]

This is how it looked back in 2018

[@Brahvim]

It still looks the same! And... frankly, it is better than the AI-generated version, because the AI's re-imagination clearly lacks feel. E.g. How it missed reflections and foamy-white parts in the water at 3:07. It _does mess up sometimes_ since it doesn't know how the 1899 world looked. In another video on RDR2 in this series from SOUNDTRICK, the AI drew some boxes in a drawer from the game, as phones in transparent plastic cases 😅

[@AnthonyDutter]

If games would look that realistic i would actually think twoce before killing any NPC 😳 That's amazing

[@JuanFranciscoSanda]

2:28 This? This is incredible. I have never seen such potential for hiperrealistic graphics before. It looks straight out of a movie.

[@spidermankey1398]

The developers are like gods who give such a good lighting to match the theme of game

[@Namster05]

You're on to something big, man Give it couple of years, and we're gonna have real-time AI processing in videogames Btw, do Space Marine 2 ples

[@randywilliams208]

(assuming realtime generative AI is possible in the near future) if we had more games that focused on physics and mechanics (two things severely lacking from games of the last decade, just compare gta4 to V, it was actually a DOWNGRADE), we could have a game with a very basic or simplistic template that gives AI cues as to the scene (time of day, weather, environment, colors, etc.) so there can be more consistency and direction... the generative AI will be a post-processing overlay... it will even be able to anticipate movement and make certain animations and gameplay have a very vivid, dreamlike appearance... this is dope.

[@zuzuzaza98]

This feels like we are traveling back in time

[@1x93cm]

some of the OG game shots look better because the colors aren't super saturated.

[@edgarrios3927]

Greece from Assassin's Creed Odyssey please

[@studio1988.]

3:10 this was like movie very realistic

[@TheBestJudje]

Note: Thanks to the meticulous work Rockstar Games put into the smoothness and realism of animations and the physics in this game, after AI processing, the video truly looks cinematic. It appears much more realistic compared to other games, where characters are constantly twitching.

[@MsSemen23]

No way someone at a big gaming studio is not making a technology similar to this. I'm pretty sure we will see something like it in a couple of years.

[@Elburion]

Please convert the Original Deus Ex game if you can

[@RJKhey]

Oooh now that would be interesting!

[@deus_nsf]

Revision since it has more props and general map detail as a base reference for the AI. But yes, that would be amazing!

[@Elburion]

@deus_nsf good idea, that was my main worry is the environments might be too bare to work with

[@Babajagrarox]

Developers did such an amazing job with this game even AI is not brining much to the table and even making it worse at times

[@jamesgordley5000]

The AI actually handles lighting a lot *less* realistically in most of these scenes compared to the original game.

[@joshuasarmiento9138]

This is exciting if developers find a way to use ai as an video game graphics

[@Crackracket]

I hate how Arthur has uncircumcised fingers 1:32

[@boogiemeister9581]

First example of this where the ai looks less realistic

[@lancetschirhart7676]

This would be more impressive for a game that didn’t already look amazing. Took me a while to figure out which version was the game and which was the ai

[@gass_buitar]

The AI makes the sky look british all the time for some reason. Conclusion: AI is british

[@OldkidLivegen]

Modern video games geometry is detailed enough to match reality but the color palette is still completely off

[@CarlMahnke]

Imagine that you only need to roughly block out your map with primitives and all the little details will be done by AI.

[@Shep01]

The game was a masterpiece. I buy it again remaster3s like this.

[@intheair1987]

If a company wants to, they can already achieve west world in VR

[@itsFETO]

It's so odd that as good as RDR2 looks being arguably still one of the best looking games in modern gaming, compared to the hyper real ai, it's still pretty off as far as making things look actually real. The way our brains receive the ai is much more believable than a top of the line AAA game. I wonder if they implemented any ai to the visuals of gta 6

[@Mittzys]

This is only possible due to how information dense RDR2s visuals already are. This shalln't change how games are made.

[@Project1nol]

No, it pretty much created everything from scratch, taking very little from the original frame. Look at older games with this technology, like half life. They look as good.

[@Mittzys]

@@Project1nol But the AI hallucinates tons of stuff. Lighthouses become stone towers, pipes on walls become screens, computer terminals become trash cans. No artistic control.

[@Mittzys]

@@Project1nol Distant people turn into tree trunks... Signs completely vanish... Clouds stick to the screen... These are all things I'm seeing immediately

[@milkyJuman]

Maybe it will. Rn it's generating based on the final rendered image from the game. If it gets access to the depth channel, geometry channel etc. it could be more coherent. Something similar was done with GTA 5. The video's at 2 Minute Papers

[@czefix]

Kingdom Come next?

[@daveit1337]

That comparison shows how the animations are not so realistic

[@rombofn]

Yes because this is only Video to Video it doesn’t alter the physics and animations (yet)

[@Skvodo]

This technology appeared only a few months ago. Just imagine how the graphics could improve in the next few years.

[@corvoattano3760]

Hey I love your videos. Could you please make one with Far Cry 3? :)

[@KalelVital]

I wouldn't really like a super AI realistic Game. I'd like to know what effort is and the difference between prompting.

[@mmmarshalruska]

Тот редкий случай, когда графика в игре лучше реализма

[@overused6632]

Why are ppl pushing A.I. thumbs down trash

[@mfs353]

this is the new frontier and goal for graphics in games. I'm sure nvidia is already looking into how to achieve this in real time game rendering

[@kleber1983]

And this is how we find out how far the games from today are from true realism...lol

[@Red_Dead_Entertainment]

Looks great But gen 3 i still very expensive imo

[@claire001savefile5]

We will be long gone or old af before we get graphics like this.

[@sukhoisu-33flankerd71]

The artists who worked thousands of hours to create a beautiful and stylistic, yet photo-real world watching all their effort pressed through a mindless algorithm and churned out into a souless mess: 🙁

[@FVMods]

Don't forget that AI takes existing data from others in training to achieve this. It looks like a colossal ripoff, and i blame people for hyping it up if it bothers them. It's like, you don't have to capitalize on and eat everything you're fed...

[@SgtSlapmaster]

Haha. Yeah it’s going to create a lot of debate in the long run. An interesting compromise might be for developers to create low-detail ‘scaffolding’ and then they themselves train an AI to replace the rendering with something more bespoke and fitting with their vision. It would still be soulless to an extent but perhaps closer to the likes of DLSS (which imparts little to no artistic directions) versus something completely free-reign, and that gives different players of the same game an equivalent experience. Putting a more positive twist on the usual talk of replacing jobs, if done right maybe (hopefully) it could lead to better balance in studios rather than people having to kill themselves delivering a game like RDR2, which was infamous for its brutal development. Wild times ahead.

[@veterandecanus3814]

bro ffs, they probably dont care, they do it for money

[@SgtSlapmaster]

@@FVMods A counter-point to this is that it doesn’t have to be stolen. It is possible to create libraries of material for an AI to consume where you trace everything going in, and I suspect this might be the route huge publishers take, similar to how they share game engines across studios.

[@deus_nsf]

I agree with you, I wouldn't use this for modern games with good art, however for retro gaming this could be amazing.

[@MrWharf-sp4ci]

I feel comfort watching ai generated videos idunno why

[@jackmills7758]

this is what rdr3 could look like

[@Edge12513]

Hey question how does it process the video once recorded. Or can you play while watching this?

[@LeMaleExceptionnel]

That sheep got a Netflix adaptation

[@GIJosep]

Just waiting for West World to become a real thing.

[@gsjunior8668]

This thing blows my mind. Can you do it with Silent hill 1 (psx) ?

[@ro-animation]

So this is a glimpse in why we might get tottaly lost in future Digital Worlds..it will be indishtingushable..

[@VarDenSar]

MORE of RDR2!

[@dembow1492]

Fifa and PES games should use this for players faces

[@batman_2004]

This is the future!

[@luke.rayman]

For me the game looks better on most of these shots than the AI stuff. 😄

[@TurboLight]

Good art direction can do wonders

[@ehomen9310]

Please try to reimagine Teardown. I realy want to see how AI will handle the destriction of the wolrd

[@mgf001]

Are they making a sequel of Mad Dog Mccree?

[@igkinatsu]

In some shots the game looks better and others the ai looks really realistic

[@strangemagic8865]

Si Rockstar Albacete hiciera el remake sería más o menos así

[@yusufa5429]

Once this run on real time, like Real Time Ray Tracing, Games will be undisguisable from real life.

[@VibratingDonkey420]

Imagine when this becomes real time rendering, insane!

[@ChairudinjarotDjarot]

This Ai call Alien Technology 2077 😂

[@victoribarra3963]

Someone should do Battlefield 1 or Battlefield 5. Or call of duty. See how trippy they get

[@TurboMega-x8x]

What program is used to modify games like this? because I would like to play some games

[@deus_nsf]

I don't suppose this has any chance of being real time right? How much time to render a frame?

[@rombofn]

Its not but it will be, this is the path we will take in gaming to have another golden age of gaming again, we have stagnated the past 5 years

[@deus_nsf]

​@@rombofn I mean, ray tracing is cool and all, but I still think Crysis 2007 looks good lol. So yeah, it's safe to say that the market definitely waited for consoles to catch up. Aaaaand they'll be left behind again 😂

[@notaspy8902]

Good thing am on PC ​@@deus_nsf

[@dutchmangolinde5469]

The ai makes the game look like you installed a 4k reshade remastered enhanced texture graphics mod

[@FactsWithActs]

Unreal

[@kd6gs]

Cool but video game graphics are there to escape the real world.

[@MALOK003]

Try a battlefield 4 and do the seige of shanghai map where the skyscraper collapses

[@aaroncortez8347]

A great april fools video make this into a rdr2 graphics mod pc gameplay 4k ultra 😂

[@callumcunningham83]

The game looks miles better

[@cathy-zeta5331]

Looks way tooo plastic and wrong coloured (saturation)... I don't like it. And, Gen-3 produces too many weird things, especially with the eyes in movement. I can't spent my money on this AI, they have to improve massively before I do that.

[@leofernandez-arias8833]

What is the prompt? How do you do it with Gen 3?

[@goodvibestv5380]

Can you do BodyCam or GTA V in first person mode, or Black Ops Zombies

[@Mittzys]

Why? Not needed. Especially on bodycam, that game looks photoreal already

[@arielsalatan8968]

If AI Is This Good and Implemented Raytrace is No More Performance is Ok With This

[@thegoodsherman]

Now i cant play any game anymore😢😂

[@rohitssharmilee7498]

For me game is still better than Ai enhanced video. AI video feels weird not real

[@jaymac7203]

This is incredible 😲