Bully with ultra-realistic graphics using Gen-3 video to video Runway ML Artificial intelligence

[@SOUNDTRICK]

This AI technology does not yet have as a reference the real geometry of the game or other more accurate game information data, everything is based on the final frame delivered by the game, there is still much to evolve, this is just the beginning. THE FUTURE OF DLSS

[@hamzakhalil-gs7oc]

please Hell let loose, WWE 2K24, Beamng drive, Garry's mod and call of duty world ar war cutscenes with this AI

[@nomad7317]

Yes, i had always been thinking about this

[@nomad7317]

DLSS could use AI to generate frames. These could be even better than ray tracing or path tracing!

[@aeternatenebrae]

@@hamzakhalil-gs7ocbeamng especially

[@ethankline5336]

Wow!! The matrix demo, the stanley parable, or portal would all look awesome with his filter over them

[@MrJooze]

3:21 Baby Hopkins

[@kushy2508]

boss baby vibes

[@brandonchong4025]

My thoughts exactly

[@danilanik8]

Baby ventriloquist

[@deaeth1411]

0:23 In game: 😠 AI Made: ☺

[@justaneditygangstar]

In game A total b A jerk and angry In ai A total b Sly and cocky egotist

[@oui2611]

it looks like a baby's head in a teenagers body lol

[@zussman_]

​@@oui2611ai cant decide teenagers since it thinks they are children

[@Kindaoff10]

@@oui2611 nah, it's just like all woman using facial filters nowadays

[@phntm5700]

1:55 crazy that it knew the tile was a reflective surface and the reflections are so good

[@Resumindofilmeseséries-s9q]

O que acredito que acontece é que a I.A pega imagens reais e transfere pra o vídeo, por isso é tão realista, praticamente perfeito.

[@Nikotheleepic]

​@@Resumindofilmeseséries-s9qnot exactly the ai actually conceptualizes visual information and then uses it to interpret what something ought to look like, it's training just forms the patterns in it's brain that allows it to realize how to visualize something with input stimuli

[@neiko9251]

So basically we’ve reached the end of graphical fidelity..this is it. Graphics cannot go past this point. If Bully looked like this in game I’d be floored.

[@MartinOReilly-mb4um]

Maybe now they can concentrate on actual good gameplay for new upcoming games.

[@Skrenja]

This is still not 100% on point to matching reality.

[@DJSoundProfessor]

This is how I imagined games would look like in the future when I was a kid

[@taicunmusic]

Well, 2 or 3 more years and it'll be how games will look

[@younmefrien]

Hush, give it 20 yrs​@@taicunmusic

[@nijario9690]

Only if we get some crazy breakthrough

[@Grooviness]

so, like shit?

[@BrunexGamerYT]

Imagine one day they create an AI that renders games like this in real time, it will be amazing.

[@deepnx]

Yes and im totally ok with the janky artifacts, id love to replay old games AI version... i believe that should not take more than 10 years.

[@MattCarter1999]

They have already did it with Doom. Tech has long way to go, but it is still damn impressive.

[@AImeriia]

@@deepnx Mark my words, it will be here within 3 years.

[@thereturntobloodynights]

hope not

[@DhanushkaVibeVentures]

Imagine one day humans are being used for game

[@supermegabenji1026]

The janky animations feel like a real life Stop motion video. It literally feels like those Adult Swim bumpers with the outside going Day to night very fast. Plus, I love Bully. Thank you for doing my favourite Rockstar game ever.

[@db3577]

sheldon throwing up cripsign 0:55

[@-betagames-]

Next The last of us 2 or god of war

[@-betagames-]

@kenneth7239 100%

[@braiand_md]

The closest thing we get for BULLY 2 😪

[@CowboyBoomBoomSlim]

As an artist, I’m learning a lot from these AI-enhanced videos. Especially with games that already look incredible and realistic to me, like RDR2. It’s crazy how tweaking reflections, lighting, and small details can make an already stunning design look even more real. Not saying realism is always the goal, but it definitely helps when designing props or scenes.

[@MartinOReilly-mb4um]

It's mostly about getting the light right, and the AI is great on that, although it still has to learn many other things we human artists can do easy.

[@devanshujoeldhali2334]

Bully: Toddler's edition

[@Dvdpatriota]

The best part for me is, without a doubt l, the strangeness of seeing animations that your brain is already used to in a new "look". It would be cool to see this in Silent Hill.

[@MartinOReilly-mb4um]

Probably horrific, since it would actually look real.

[@Samb467]

Pretty cool

[@hasanylmaz4681]

It's the future but it's very close

[@theloner6063]

Future= VR

[@danielpudge7600]

I'm 22 I probably gonna be so old if there made this look so realistic properly up to ps11 xbox five 😊😁🤣

[@isla2202]

Bro was learning to walk when this game came out

[@kelbinhow]

Few things I noticed after watching quite a few of these videos: Good things: 1 - Faces are done really detailed 2 - Sceneries are AWESOME 3 - Lighting behaves very well, specially reflexes Bad things: 1 - Animations are janky and creates a lot of artifacts and it seems it doesn't remember how it created some things so it tries to recreate it, which causes different outcomes, ie, a piece of clothing can change colors or textures, a hairstyle can also change, small objects can appear, disappear, then reappear as an entirely different one, etc. 2 - It still struggles a lot with hands LOL 3 - Sometimes it can remove or change entirely an artistic choice, ie, when the character artist makes a mage with a cool wizard hat, the AI can make that hat become a normal hood, or in this case we have Algie, who has an open shorts, making his underwear visible, but the AI makes a normal pants, as well as change his round glasses to square ones, or even the scenery, that despite doing it incredibly and awesomely well, it can change a few artistic choices such as removing the vines from the wall, or changing the window frame or the handrail, etc 4 - It bugs the hell out of HUDs, so the AI NEED to have internal information from the game so it skips the HUD 5 - Doesn't do well with texts, banners, boards, whatever written stuff, it keeps changing the characters to weird symbols 6 - Despite doing really good faces, it still struggles to animate it in a conversation... it can naturally move the body around, but the faces remain either stationary or with weird mouth movements

[@viniciusribeiro7803]

Imagining playing this game with an AI filter just like this in the future

[@danil_anoshin]

I was very impressed with how the clothes react to the player's movements, crumple where necessary, this is the future, since they still can't make realistic clothes in games

[@СергейЛисицын-ч2с]

In fact they can

[@Chad123-g3d]

​@@СергейЛисицын-ч2сNO

[@paraje3d]

Some day, the videogames looks like that realism. I hope in this life 🙏.

[@hanh7395]

1:15 crazy it knows where to cast the shadow 1:47 even reflections god damn

[@bestmind-tm2me]

That feels like classic game that tries to put real life textures to 3d models

[@mykytashcherbyna]

Try to do GTA San Andreas cutscenes without HUD, subtitles, etc.

[@TheRogueMonk]

lmao THIS IS THE BEST APPLICATION seeing all these funny interactions by real people

[@fedyx1544]

I'm genuinely surprised by how good the animations look with the filter, with GTA 4 they look terribly unrealistic and out of place with the filter but here some of them look very good

[@silverspear5596]

Cannot wait to play Battlefield 2: Modern Combat with these in the future

[@Brad-dx9fd]

The potential of this is so nuts when you think about how this will affect game development in the future. Artists can develop a PS2 quality asset in minutes. Even less if you're using AI to develop the assets as well. I understand why this makes people nervous, but setting, storytelling, mission design, mechanics, etc. will be the focus for future games. If AI can make sure the final product looks next gen, we will finally go back to 1 - 2 year(or less) development cycles, instead of waiting 5-10 years for a game to release. Bully assets look like paper models and the AI is making it look photo realistic. It's so strange too, because it does look janky, but not uncanny valley IMO. When it's working, it just look 1:1 IRL.

[@davidsentanu7836]

Yeah, I just realised that somehow it does not hit the uncanny valley. But why? Even Disney's level of CGI goes uncanny valley when they try to make it realistic (Star Wars.) My guess would be the janky animation is so far from reality it looks like they are actors deliberately doing exaggerated motions, so my brain does not feel tricked. Maybe.

[@aiacc2aiacc2]

This is so crazy bro and thanks for your work this was such a interesting video

[@ДиДи-м3ю]

I would like to see some old anime (the ones that are drawn realistically) in this format

[@berserkguts6212]

Silent hill 2 remake comes in a few days and looks already insane cannot imagine how this will be in like 10 years!

[@tlzin4499]

Ai is going to be good in like 3 or 4 years, so there is no graphics better than that and we finally reach reality

[@mccraftingtablelmao6204]

texture look weird but the lighting, shadow, reflection are amazing, cant wait to see what will it look in 5 more year

[@rickandelon9374]

in 20-30 years, 50% of all the games will be AI rendered so that they will look as realistic as real life.

[@xitcix8360]

@@rickandelon9374 I promise you, it won't take nearly that long. I give it a couple years

[@Radioactive-Cactus]

SOUNDTRICK I had a dream someone did this AI remaster stuff with anime, and it was totally awesome. Just throwing it out there.

[@davidsentanu7836]

The minimap turns into random stuffs is wild.

[@offbeatscratcher]

This is crazy. I need games to look like this.

[@Hathathorne]

These show how we imagined a game looked like in our imaginations

[@greypsyche5255]

Awww Jimmy is so cute, he reminds me of Aang from Avatar

[@PhilBraxton]

Awesome to see this as a Bully stan

[@consterus]

I want to see The Simpsons reimagined or South Park 😄

[@AKMohanad3487]

0:54 Hi It’s me Sheldon

[@pablogonzales6194]

it's better than other a.i. reimagined stuff ;-)

[@Chad123-g3d]

I'm never playing games again until they make them look like this

[@HashNaKeD]

If the ai could fix the jank animations it would be perfect

[@docnom]

I think more frames will fix it

[@soursesource]

I think it looks more funny that way.

[@gg1648]

Or keep it. I rather like it and prefer it for nostalgic reasons.

[@HAM-TV]

Caillou like you've never seen him before...

[@worstusername22]

Rockstar needs to give Bully a bit of Remastering love. PS2 version on PS5 is stupid when theyre all about the PRO graphics

[@AlmiranteLobo]

This is absolutely crazy!! keep doing more games please!!

[@bnrid8086]

the walking dead game would be dope, especially the final scene of season 1

[@AzoiStudio]

The Walking Dead TellTale Games! Absolutely!

[@reyy86]

Yes please

[@mshoney9301]

and life is strange

[@pch_mechanika]

now imagine a plugin i.e. for source based game engines that adds the AI into rendering pipeline with object refferences... HL1 and HL2 remastered again this time by AI...

[@chekkop]

Present times no longer feel present.

[@MartinOReilly-mb4um]

Not only does the AI try to make the models realistic, but it will also add animations where it believes they should be, like the kid's blinking eyes where the original has none for instance. 0:59 This would save Devs a lot of work.

[@Delberx]

Oh man, I'd love to see death stranding. Especially some scenes across the mountain.

[@Raygohaha]

Jimmy looks like Aang from that one bad Avatar movie

[@ScottThePisces]

I think we'll get to this point in graphics and they'll purposely tone down the realism for games like GTA.

[@Brad-dx9fd]

They probably won't be able to. Another less capable dev would make their version of GTA with assets that are much easier for a smaller dev to create. The AI clearly doesn't need current level GTA visuals to do this. Rockstar used to develop GTA with much smaller teams over the course of a year or two. Rockstar would eventually get beat by some indie devs. Everyone will have to go this route when it gets to this point, unless your goal is an animated style, but even then, games like Overwatch or DBZ would still benefit from this tech if it could add more polish to their games.

[@talita6362]

Jimmy Hopkins looks so cute 🥰

[@rolf2825]

La rompe, bien ahi los videos que haces

[@geppuboy2263]

NGL, this is amazing

[@bargundabal]

Этой игре нужен настоящий ремейк))

[@dueleus]

Can you do Escape From Tarkov or Forever Winter? Its gotta look amazing

[@Justguy363]

Then Detroit become human AI generated

[@onlyyoucanstopevil9024]

0:23 The filter remember me POSTAL 2 npc interaction

[@samgenia4245]

I wonder how rockstar is reacting to these new ai graphic enhancer videos after dedicating millions of dollars and a decade to making ultra realistic graphics for gta 6

[@TayRich93]

Jimmy looking like a baby n shhi😂

[@NoahtheGameplayer]

This look so good and Funny at the Same time Lol

[@mrzzz492]

Woww tq bro dream become true

[@aristideregnier4883]

You should do a round 2 for this one! Could be done better with better models

[@davideghirelli4453]

the consistency is the main issue of ai, a difficult one to solve

[@FiveX1]

actually insane, i wanna play :p

[@Bl_ckMatt]

tbh is graphics were this tier. Ill be impressed

[@SkateTube]

If I upload any skateboarding video game - EA skate 3 footage to runway ML 3, it just crops the video and when I try to use real or realism, it outputs generation error. It cannot yet do it on these types of games?

[@heggy_69]

This looks impressive but in really worried that this will lead to even more of a graphics over good games problem. Like we already have mouthbreathers whining about framerates on a console with absolutely no games lol

[@aiacc2aiacc2]

Please do more ps2 games, i think they'll be best for the tmie being since there so much more flatness to work with, Smackdown HCTP Or one of those old simpsons games or something upscaled would go crazy

[@rustyesh]

Assassin's Creed 1 or 2 please!

[@umloucoaleatorio7713]

👁️👄👁️ WHOOOAAA

[@giovannigiordano3674]

Gaddamit he is not bald he has a very shirt buzzcut but the game graphics makes him look bald

[@Mista_Cassla]

This is wild

[@ilan442]

Super cool

[@folchanskiy9346]

Sheldon looks so cursed.

[@NoahtheGameplayer]

0:54 LOL

[@rennmaxbeta]

They'd never allow this because of the realistic children

[@jcrocky]

0:23 Lola Lombardi looks like a little girl.

[@samjudge1240]

Awesome this.

[@umloucoaleatorio7713]

Manhunt gameplay vídeo with this ☠️☠️☠️

[@rousseeni]

awesome

[@iurylembrancas4312]

quando eu estiver idoso com certeza vou continuar jogando videogames haha

[@01ASTRALICE]

Starfield next please! Incluiding New Atlantis city.

[@jcrocky]

3:13 it looks kinda like a hotel

[@OkSid300]

Looks promising, but AI is still far away from doing stuff like that. I believe it took unbelievable amount of resources even for this short video.

[@metamind095]

Please try "Tron 2.0"...results should be fairly interesting haha.

[@Xandagli]

What would the Outlast game be like with runway gen 3?

[@JohnKerrashVirgo]

OMG Do Quake 1 next 😮

[@Dr.W.Krueger]

I love how the model has no clue of what to make out of the UI elements.

[@mejust5348]

We have been waiting too long

[@fokoji666]

❤❤❤

[@edmitry]

This gives me some kind of childish delight!

[@CrownKing2499]

Mafia 2 and Hitman Absolution pleaseeee :)

[@BIPOLAR_NEMESIS]

This should be a filter in extra settings after beating the game

[@twinberwolves4231]

Looks intriguing.

[@OmniFlare6000]

The fact that the description say GTA V 💀

[@zussman_]

Nope it doesnt

[@OmniFlare6000]

@@zussman_ I mean the KZbin btw

[@NickArrowPumpkin]

I absolutely admired by AI's ability to create pretty correct reflections and shadow. Please try to find game and place that can trigger AI to generate reflection of character in windows, glasscases or actual mirrors that don't work in actual game!

[@vladbej959]

I prefer the og look. Not sure why this hypes everyone up. Trying to look like the real world takes you out of the game experience the way developers intended imo. It’s less immersive. Still very cool to watch as a movie.

[@Spoon97]

"Nuateste schooool"

[@KellyBeeSan]

Unreal Engine 6 leaked footage looks HELLA INSANE 😱 But seriously though, I'm getting Shaun the Sheep or one of those clay animation films vibes here for some reason. 😂

[@rebinarifdawody2383]

typical if with gta 6 could used with ai.