AI Actors for Game Worlds

This video is a paid promotion for Inworld, apply for early access to the Origins demo that I was playing in this video here: bit.ly/inworldorigins-2kliksp...
In this video I study, challenge and see how far I can push the AI-driven characters in the Inworld Detective demo. You can communicate with them via microphone, they respond with generated voices, and if you can finally stop getting distracted by the endless possibilities you might even be able to solve a crime.
0:00 - Overview of the tech
6:52 - Boring NPC vs interesting one
8:43 - Goals VS improvisation
12:18 - The name challenge
13:37 - Linking this up to NPC actions
16:16 - Endless unseen islands
20:57 - Playing on, after the demo had ended

[@DruidEnjoyer]

6:56 "Describe your personality in 26 words" - Upset, frustrated, scared, negative. "That was 4 words, Josh.." - ....So? You got owned there. He doesn't give a fuck. He's not boring, he just has completely given up on life.

[@telefrag.]

Very realistic factory worker indeed, I'm impressed.

[@0Blueaura]

@@telefrag. sad

[@sanjamac]

He just like me

[@Demmrir]

I mean, people who give up on life ARE boring, though?

[@Blox117]

@@telefrag. ironic since they are replacing factory workers

[@Summanis]

"I find it hard to come up with convincing lies on the spot" Charisma is no longer a stat on screen, its a honed skill

[@TheDiner50]

No. The Charisma stat can still exist. Just think about it. There are real humans that get away with the most bad lies ever. And yet some barely get a chance to tell a half truth before being pinned as evil itself. Like if the AI is good enough it can force itself out of a conversation or bluff and eat a really obvious lie just based on your charisma stat in the game. Your dead Jim. And the NPC just strait up die due to huffing some charisma pills so your stat is 13 out of 10 max level. Stacking effects etc. And if you have a low charisma stat the AI can make up a story to prove that your lying even how hard you try. It is going to be very unbelievable but also funny? Idk. Like even without charisma stats or whatever. Some really BS stuff can happen unless holding the AI hands heavily. Find it hard to believe fully AI driven NPC dialog is going to work for most games. And the ones fully AI? They are going to be hard to do right. Might end up creating really funny broken situations. But also just strait up underdeveloped and as oblivious as normal NPC's. Almost even worse.

[@JT-ev8sd]

I'm actually very excited about this. For example having to actually learn how to sound intimidating or to haggle down prices in the post apocalyptic world of fallout 4 would be fascinating. Especially if your voice tone could play a part.

[@Summanis]

@@JT-ev8sd it's a terrifying concept, gamers with social skills

[@JT-ev8sd]

@@Summanis dang this is giving me nightmares. Imagine a large part of the population suddenly gaining the skills and experience to emotionally manipulate people into doing what they want. A sudden surge of gamers finessing themselves into places of power and influence like the congress. Makes me shudder and a bit proud lol.

[@a_wild_Kirillian]

@@Summanis, that's TTRPGs players for ya. Have a look GURPS' Basic Set and tell me you don't fear a person who basically memorized it and can improvise a different world =)

[@monkeyperson9392]

5:50 in the future when you are unsure if the other person is an AI, just ask if they can describe the current situation as a poem

[@TheBigchekka]

THIS!!!!

[@danieleverett902]

Bullet proof ;)

[@willguggn2]

A friend and I were actually pretty skilled at doing just that in seventh to eighth grade or so. You could be talking to a kid with too much time at their hands and weird hobbies. :>

[@someguy9175]

@@willguggn2 close enough. pumps shotgun*

[@lucjanl1262]

Or ask them to pirate a video game, they would rather die than pirate anything

[@durchfaII]

Josh is actually the most realistic character on this tech demo, that's how 99.95% of factory workers feel about their job

[@SnakeBush]

It was so legit

[@alexandrep4913]

So?

[@crediblesalamander8056]

It's almost scary how good this is, considering it's just a demo and it's still basically the first generation. Add something like ElevenLabs's emotive and realistic voices and improve the delay a bit and it's almost ready to be used in a AAA game.

[@Sopel997]

or add some ummms and yyyyhs to cover the delay

[@antonhelsgaun]

​@@Sopel997the ummm city where everyone is super unsure of everything

[@fluttzkrieg4392]

@Tomasz Sobczyk It's like the police radio woman in GTA V.

[@VargVikernes1488]

Now add some loverslab content on top and you've got the perfect game

[@oldvlognewtricks]

@@Sopel997 Time taken to wind up their idle activities? “Hey - Janice! Can you turn down the jukebox so I can yell at this bozo? I can’t hear myself scream in here!”

[@korysovec]

Just imagine that someday an ingame NPC starts begging you to not turn off the game, so they can live.

[@leucome]

They can already do that. You just need to include in their profile that they are scared of being turned off.

[@Vysair]

@Render Wire no need for that. They are already doing that

[@jordanfry2899]

Thinking about this makes me sick.

[@cybercat1531]

*Shoots them* Gotta make sure its off.

[@EnjoyCocaColaLight]

#JusticeForTay

[@CturiX.IREALLY]

The fact this could be the beginning of an infinitely generating RPG is insane

[@USBEN.]

Life simulation but interactable

[@justamanofculture12]

Saw this mod in skyrim. Terrifying.....

[@billywashere6965]

I hope they use something similar for Star Citizen's NPC quest givers.It's a lot more efficient than trying to get voice actors for every type of NPC in the universe.

[@KY_100]

​@@billywashere6965and a lot more shit

[@telefrag.]

I remember a couple of years ago the game AI Dungeon had a lot of trouble with keeping track of whatever happened prior. These NPC seem amazing at keeping a coherent conversation in comparison.

[@HalTheBot]

AI Dungeon was the precursor to all of the recent AI popularity; the harbinger of what's to come. It's a shame that the game is a shell of its former self-I used to have a blast messing around in it.

[@explosionspin3422]

What happened? Haven't checked it out in a while.

[@privatepengu]

​@@explosionspin3422 same, but i followed the subreddit for a bit; apparently the creators placed a lot of limiters on the engine, and there were some monetization issues. though supposedly the more dedicated userbase isn't experiencing any problems doing the things they've always done, it's just that the creative freedom and "pick up and play" part of it has been "downsized" (?) a little bit

[@meatisomalley]

@@privatepengu They used to use ChatGPT based models, and those models got lobotomized by openAI so they switched to different models and AIdungeon is pretty good now.

[@privatepengu]

@@meatisomalley how long ago was it they started using chatgpt based models? was that when they introduced dragon/griffin or before that

[@TehTezMan]

Wow, this is like... Roleplaying games may finally involve roleplay. I would totally, absolutely bumble through this with a cliche noir affectation like a 1930s detective and have a blast

[@jabajuba]

Getting engrossed in your Dixon Hill stories again I see, captain.

[@yteriaereh6467]

almost feels like we are seeing a very early version of actual westworld lol. In time with augmented reality, I can see a real life westworld existing

[@LL-yd8zz]

6:57 Nope, nope, nope. That is actually frighteningly human. Josh isn't boring, Josh is just fucking *done*, having worked in a factory for a while I can say Josh is our spirit animal. That is a depressingly realistic character.

[@GardianOfLight]

This reminds me a lot of Façade from all the way back in 2005. If I recall correctly the two characters in it used a goal/reward model where player text input would add or remove goals. The list of words it would recognize was really long so it did a pretty good job of selling the illusion.

[@art0007i]

It would be really cool if there was a spiritual successor to façade game, but with technology like this.

[@0uttaS1TE]

​@art0007i I wonder if "melon" would be an immediate game over?

[@negativefg7922]

@@0uttaS1TE You will be sent to hell immediately after saying that

[@Novashadow115]

God that was a memory

[@gooky]

melon

[@-austinfelts]

16:16 "Endless unseen islands" feels all too relatable. I really miss the young days of playing games and letting my imagination run wild. I'm honestly stoked to see how this tech can and will shape games.

[@narutrixil]

I wonder how speedrunners would adapt to these kind of technologies. Can you imagine a future where speed runners lead the forefront of AI research?

[@keeb__]

Like software engineers testing every edgecase, speedrunners abuse them.

[@ciaran_2693]

top 10 questions guide

[@TheFlyingslug]

Imagine being an AI npc in a video game and a speedrunner walks up to you, blurts a string of random key phrases, and causes you to finish the game for them

[@eduardopupucon]

@@TheFlyingslug "hello i am a speedrunner and i want this game to end as soon as possible, can you finish the game for me please?"

[@rhandycs]

Speedrunners are gonna be the greatest social engineers with this tech

[@DeepWeeb]

12:18 Philip trying to get the NPCs to sing the intro piece of "I'm the Scatman"

[@Dall_]

Damn, imagine like playing divinity and being able to convince the evil guy to just give up fighting or join your cause

[@JT-ev8sd]

Or in the middle of a gun fight, during a stalemate convincing the enemy to turn sides and help you, yet have the change of them pretending to help you to get closer and kill you. This incredibly human situation happens a lot on games like rust or among us so it would be awesome to see that awkward dance of whether to trust or not happen between an AI and a human.

[@pinedraws]

Real life charisma roll nat 20

[@saucyboi7789]

@@JT-ev8sd😱

[@marmalade101]

20:12 imagine you witness a factory blowing up and the detective comes up to you and asks you for some python code

[@AntonioZL]

and you just recite it for him. word by word. including imports.

[@okto_0]

telling the AI characters to rhyme is propably one of the funniest things to do with this technology. And people say they will take over the world. If only we could run this game completly locally without an internet connection!

[@goigle]

What cause this chaos, this destruction? I’m just a bystander with no instruction

[@metasamsara]

This was the part that broke immersion for me it's generic chatGPT behavior, a proper in game character would tell you it is not appropriate to ask such a thing.

[@trainee5471]

@@metasamsara To be fair, this AI was otherwise quite good at avoiding acting like an answering machine

[@yesyes-om1po]

@@metasamsara It can be programmed to act no different to a human, but ChatGPT's goal is not that, it was designed to be a general purpose helpful AI that would do what you asked of it.

[@Spokenword]

@@metasamsara You could excuse that with lore, maybe in this world cops have absolute power and could throw you in jail for a week for not cooperating so people just go along with it to be safe.

[@hi_its_jerry]

that was such a great video! not just because of the novel subject matter, but you can tell Philip put lots of effort and care into it, and it shows! probably one of the most well produced 2kliks video in recent memory, imo.

[@RealHorsen]

Just 4 minutes into the video, but holy shit. This is it. This is what i have always wanted from video games

[@narutrixil]

Looks promising, but I really hope that these AI models will run locally instead of in the cloud. Would suck to see single player stories with an experation date

[@timeTegus]

Yes. Luckly ther are alredy good open source models

[@HalTheBot]

We'll get it eventually. Don't look at where we are, look at where we'll be in a few years time.

[@andyasbestos]

There are plenty of pretty good open source models you can run locally. They're pretty easy to find on huggingface. Though, the ones that have decent intelligence and coherence are pretty heavy. You can run them on the CPU, but then they run at a glacial speed. Ideally you want to run them on the GPU, but then you need one with plenty of VRAM. You can get light models too, but in my experience, they are too dumb to be all that interesting.

[@DesperateSlacker]

I share this sentiment, friend! I don't want there to be another reason for games to be tied to an online server.

[@trainee5471]

@@andyasbestos Hopefully we'll be getting dedicated AI hardware, even if the trends are to move everything to cloud. Another possible improvement I see is specialized AI models trained only using the set of data strictly necessary to perform its function. Like, a model trained to act out a specific NPC

[@moopledoopy]

This seems like the exact technology that the game Façade needed. There have been attempts to recreate Façade in early AI experiments such as AI Dungeon but this would be the ideal technology for a reimagining.

[@AE_Sub]

I just really hope these kind of games will also have extended NPC "memories" because it makes it so much more convincing if you're not constantly reiterating things you've already said several sentences back

[@olivercharles2930]

True true, or if they do have memory limitations they will ask you to remind them or somethinig more organic

[@Catzzye]

16:50 This unlocked a memory.. I was watching someone play this game and every time they tried to get to this island something bad happened. I remember the fairies and them being super uncooperative and some puzzle doors, and the long garden..

[@TheAwesomeKielbasa]

Josh is the most believable of the bunch. Like, the one who did the poem for the asking of it, doesn't come across as anything like a real person, but more like chat gpt. Josh doesn't care about your questions, and is annoyed he's being inconvenienced. He has a terrible, demanding job, and doesn't have time for his own pursuits, and now a detective is asking him irrelevant questions, when he just needs to get to work to earn his living.

[@thing4826]

It would be hilarious if in future games, you can scare NPCS to leave the scene using a similar method you tried at 15:30. Like telling them the building they are in is on fire and watch them run out only to realize you lied to them... all without having to be scripted.

[@MothmanGamingTV]

My best friend spent a few years of her life completely stuck in Skyrim, she was so shut out of the real world that she recognised the NPC's as real people, and even still to this day feels strong emotions if one of the NPC's she was "close" to is killed, even if it's not in her game, and that was with Skyrim level NPC's. I absolutely love this technology, and the possibilities for NPC's in the future if gaming took this path is endless, however I think it's really important to consider the real world problems this could potentially cause, not the "AI will turn evil trope", but the connections people could end up forming with characters that could potentially replace human contact, something that isn't healthy. Imagine if Skyrim had this level of AI, but with a better speech model and more polished in general. I genuinely fear that some people may completely replace human contact and catch real feelings for NPC's within the game, something that isn't healthy on it's own. Now imagine someone who does this decides to marry a character, and over the time of their save gets to know all of their likes and dislikes, like how they love mountains but hate heights, or how they love red apples more than green ones, just stuff the AI randomly generated and saved into your game file for that character. Then one day that persons save file is corrupted, and they have to start over, that character will be different this time around, it will have the same backstory and lore that the writers have created, but nothing the AI generated, to that person if they are genuinely tricked into believing this is a replacement for real human contact, they have just lost their wife. It could literally drive people insane. You might think this is unrealistic, but again I have seen this already happen in the world with gaming, and I fully believe if Skyrim or a game like it had perfected this tech, my friend would never have gotten help. I genuinely would love to see RPG games with REAL characters, but I think this is a topic that does need to be seriously considered before it can ever be carefully implemented into real games.

[@ghoulbuster1]

When the AI is a better companion than real humans.

[@lospierdol]

There are already people who prefer to chat with an AI chatbot than real humans, I've learned about it thorough louis rossmanns channel where he recently talked about it.

[@pacmikey1763]

Blade Runner 2049 GF incoming

[@jorge69696]

Fear not, it already happened. There were some news recently about an ai chatbot service for romantic purposes that changed how the bots worked after a while and people were furious. Google "replika ai scandal" or something along those lines.

[@RyuuRider]

Honestly a lot of modern communication is not healthy. You need good conversation, good people. Without healthy people around you, you're better off with an AI anyway. Currently AI isn't there yet, but I don't think this is a negative. It'll certainly be healthier than trying to hold a conversation online 90% of the time.

[@forbiddentictactoe1734]

No more ingame war crimes boys 😥

[@ninjasiren]

it kinda still can happen lol, just allow an AI NPC in the code with war crimes and gets triggered with a specific event or if told to? you can kinda still give an AI NPC a personality

[@Vitoreo]

This blew me away so much 13:18 The fact he not only noticed the name was unreasonably long but also got annoyed at it and then Insluted you was crazy.

[@pacmikey1763]

I actually have tears coming down my face and cant breathe this is the funniest video I've seen in years, I had to stop for 10 minutes at a time at the almighty ruler

[@inworldai]

We think he's funny, too! It's a great example of how game devs can add easter egg characters to bystander NPCs for a bit of fun!

[@shoco2]

@Inworld AI was there any explicitly parameter or something you had specifically for him to act that way? Whatever it was the result was amazing

[@ThatsHekkaz]

@@inworldai Hats off to you Inworld AI team! Those sort of unique NPCs are what makes me want to speak with absolutely everyone and find all the unique and strange characters. I love your work and I can't wait to give it a try one day!

[@inworldai]

@@ThatsHekkaz Thank you! We love hearing these kinds of comments! I'm going to create a post exposing how we designed the Almighty Ruler so check out the blog next week!

[@shoco2]

@@inworldai awesome, looking forward to it!

[@Catzzye]

I feel so bad for Alex hahhaha, this is such an excellent video. One of the best executed sponsored videos, awesome work.

[@filipborch-solem1354]

Story driven games of the future gonna be wild.

[@fujiwaranovari]

"What do you mean take me 2k-" "I SAID TAKE CARE, ALEX!"

[@sunnysideeggs]

I have been waiting for this since I was 10. I'm overjoyed to see that someone is starting to integrate AI into game characters. : )

[@ethancobb4002]

How old are you now?

[@sunnysideeggs]

@@ethancobb4002 11

[@ethancobb4002]

@@sunnysideeggs lol

[@negativefg7922]

@@sunnysideeggs okay that was unexpected

[@Autunite]

That exciting feeling that there might be lots to explore in a game is one of the best feelings. I got that feeling when I played INFRA, a Source-based story driven puzzle game. It has such an open and detailed world with several pathways through a linear story, with lots of secrets, that I felt like I could go anywhere. I could interact with everything in the world, and I truly seek that feeling again in a game.

[@E5rael]

Oh man, the implications of Victor mentioning marriage at the end, what he truly felt about 2kliksphilip, it made me laugh out loud. 😆

[@a_wild_Kirillian]

It's very impressive both how well the demo works and how you managed to showcase it in the most entertaining way

[@oldvlognewtricks]

I loved them calling you out for the tediously long name, and the only character to pronounce it in its entirety was a cripplingly grandiose megalomaniac 😅

[@typho6279]

I have wanted a sequel to Facade so badly, and this new era of AI should give us that in endless doses o:

[@JimmyTheGiant]

I can't wait to see what this leads to in a couple years

[@elwen8525]

Man this looks fun af it’s like playing a table top game and just fucking around with the npcs. God I wanna get my hands on something like this

[@JesZammit]

this is unreal, i cant belive how far AI has come in such short time. imagine if they had a whole body script or model that lets them freely move however they want at their own will. they could get super deep with this like if their age sets restrictions on certain parts of their body for movement or even damage taken, i feel like even for the character you are playing it could affect your gameplay

[@_fremdkoerper]

Josh seems pretty relatable ngl

[@lumi3089]

This is one of my favourite videos form you. The humor is right down my alley, the aglomeration of interesting information to learn is big and the way you interact with games and other media in a somewhat childlish manner is very comforting to watch. It feels odly real and genuine, as if a was listening to a close friend talking. I love your content for all of these things.

[@Biped]

Phillip got conspirator-zoned

[@SkyBorik]

Philip is gay

[@Dionyzos]

I thought about the possibility of implementing this into TES6 but had my doubts since Bethesda is not known for pushing technical boundaries. But since Microsoft owns them now they could just make them do it like they did with Bing. It would be one hell of a marketing tool.

[@eee1200]

Bingo

[@emilianozamora399]

​@@2kliksphilip this video was running through my mind while watching this one

[@pentapa3923]

@@Dionyzos True, but they are probably way too far into production to be able to add it now. I'd imagine you have to design your game from the ground up with AI NPCs in mind, and you have to do a lot of testing beforehand to figure out the limits of what the technology can currently do.

[@toddhoward7125]

@@pentapa3923 TES6 is still in pre-production seeing as their next game, Starfield, is still in full production mode, so it'd be possible to implement. Todd however has said previously on a podcast interview on the topic of AI voice generation that having the voice actors is very important and they add so much to it. The technology is growing rapidly thought and assuming they create DLC for Starfield which could take a year then full production for TES6 would start in about 17 months, by which point this technology could look much better, who knows.

[@SasquatchOni]

The adventure game section really sent this video home. That curiosity is something I deeply miss with gaming. You’ve officially cranked my interest in AI and video games.

[@GreatGreenGoo]

YES AI controlled NPC dialogue is FINALY here! Ive been dreaming about this for years. This is the future of gaming. Fine tuning and more refinement will inevitably make AI controlled stories, reacting on what you do rather than scripted events. Like RPG's

[@PunikaProduction]

I recently started playing Shadows of Doubt. Imagine such a procedural investigation game combined with the tech in that demo.

[@masterman397]

now I can ask NPCs for some sweet, sweet, Starch Kola.. Don't happen to have any do you?

[@Johnnyupside]

@@masterman397 Get one at your local dumpster you bum. But seriously that game with this kind of A.I would be a walking talking noir film generator

[@negativefg7922]

I thought about that too. That would be really fucking awesome, having different personalities and some people getting angry or scared of talking to you, having to lie to them just so you can get info out or threatening them. Seems like a thing that NEEDS to be added there.

[@KyriosHeptagrammaton]

They need to ditch all their fancy lighting and whatnot to make overhead for this stuff. Who cares if the pixelated world is slightly more reflective! Give me performative npcs!

[@masterman397]

@@KyriosHeptagrammaton I'm sure the game can be optimized enough without downgrading visuals, just need to give them time.

[@nathanfay1988]

I can't wait for 2kliksphilip to replace all of the CT and T voice lines with A.I.-generated war monologues

[@dkDeMKN]

Thanks for uploading this. Absolutely fascinating.

[@Summanis]

It's funny how this is the second thing I've seen this week that I said would be cool 2 years ago only to be called an idiot for because I "didn't understand how AI worked". With AI writing and voicing dialogue, helping animate models, drawing landscape textures and models, and helping create large numbers of variations for natural looking effects, it looks like game design is being streamlined at a pace that finally exceeds the increase in complexity.

[@chase4671]

this is simply one of the most mind blowing videos I have ever watched. Going back and forth with Alex telling him how the world is ending and he understanding that and moves the conversation along by himself... the filler details that dont exist but are just so casually mentioned that they might as well do... the atmosphere of the game is incredible. feels like a revolutionary moment in games is about to begin with a new genre of ai-rpg about to be born

[@ShadonicX7543]

Immersion and realism is the holy grail of gaming, and this is a massive step on a new road towards said holy grail. Imagine a game as expensive as Skyrim with all of the NPCs being genuinely meaningful. Having a dynamic relationship with your companions even. Wow

[@nevets5]

What an interesting demo. Talking about Kings Quest, one day there might be an AI that can seamlessly add new locations to a game that no-one has ever seen before... keeping the mystery. By the way, love that updated music you've been using.

[@kipchickensout]

"he may have died in the explosion" "do you like cats" 😂 i enjoyed the video

[@j.d.4697]

The "nuclear meltdown" part was what (pun intended) literally blew my mind.

[@GlorboFlorbo.]

I just saw your ArmA Reforger video. You've seriously gotta check it out now! We've got 5 different helicopter mods! RHS mod, Javelin missile, tanks with tracks! Tons of gun mods!

[@woosix7735]

What an awesome idea! I would definitely want to play a game with this kind of tech in it! Also this is what good sponsored content looks like, actually good product that are not predatory or useless!

[@pleasestopsubscribingtomyc3360]

YES!!!!! ever since GPT-2 i was BEGGING for people to put this stuff on a game scenario. it's such a perfect fit. FINALLY!!!

[@The1Wolfcast]

Oh my god this is so freaking cool! It reminds me of those voice commands that swat 4 has and when I would debate chatgpt on deus ex and system shock and whatnot lol, I can already imagine so many cool concepts with this!

[@existentialselkath1264]

I think bioware style games will always work best with hand crafter characters with well written personalities. For random npcs though, or more open rpgs like bethesda is known for, this tech would be incredible once it matures.

[@inworldai]

We agree that great writing is key for certain games. Our tech allows for scripted lines to be used with event triggers or in line with player intents so that you can have characters say key dialogue that pushes the game narrative forward -- and also be able to ask them anything while having them respond in character. Plus, we can make the scripted dialogue non-repeatable and you can have the character wait until the right point in the conversation to say the scripted dialogue. So, you get NPCs that don't repeat themselves or randomly blurt things out.

[@existentialselkath1264]

@@inworldai ok, that's actually pretty cool. There's always a certain level of sadness when you finish a game like mass effect and know that you've heard all that anyone will ever say. This would effectively solve that. I assume the scripted elements would also be able to have actual voice acting too? That's another thing that AI might be able to do convincingly, but not with the same depth or meaning

[@inworldai]

@@existentialselkath1264 It would still use voice models but game studios can use their own voice actors to train their models. Our tech has an emotions engine that changes voices based on the emotion an NPC is feeling at any time and there are other pretty advanced voice AI models that you can engineer to use with our product like Eleven Labs.

[@SeidenFisk]

Probably couldn’t have chosen a better youtuber to sponsor for this than phillip. Awesome stuff, the pacing of speech still sounds a bit robotic / stilted, but I’m looking forward to see what we’ll see in future games.

[@MarceloTezza]

This video was brilliant, get better and better as more as i watch!

[@Loy_Otterton]

DAMN YOU. This is now my favorite video I put it next to your old Operation Flashpoint video.

[@Frumpbeard]

"It seems almost a shame for all these casually generated details to simply be wiped upon starting a new game. Because I want to remember Anna as that person who has a particular opinion about bacon-flavored bubblegum." This was a big plot point in Westworld.

[@the0neskater]

Honestly even this tech alone seems like a fun little simulator to play around with conversations and thought experiments It's going to be amazing seeing this be used in more games and open up entirely new genres, such as really deep interactive social manipulation games, escape rooms, coop/ai based problem solving etc. Great stuff!

[@FlavioSantos-uw1mr]

I was working on such a project using machine learning, but since someone else is already doing it at obviously higher quality than I am, I guess I'll just put it aside and takes this project instead, it's always been a fascinating idea for me to be able to actually interact with NPCs in open conversation, I'm so happy we're finally getting there, and combine that with new VR technology and Man that's exciting!

[@sirnamenloss4791]

fuckign amazing video phillip... were watching the future together and u give me so much context, concepts and ideas to it

[@ZadakLeader]

This is Facade on steroids

[@Ruvaakdein]

Melon!

[@grayscale420]

Oh my god! This has been a feature I've wanted to add to a game of my own in the future. I'm stoked to see the future of this tech, my god.

[@RustyShackleford556]

Imagine if they put this in Unrecord, both for investigation and for suspects and civilians on active scenes

[@hi_its_jerry]

as if the game didnt look real enough already!

[@trainee5471]

@@hi_its_jerry This is gonna have the opposite effect. The current TTS solutions haven't even approached the uncanny valley, let alone surpassed it, and are uncapable of expressing emotions (as far as I can tell), meanwhile Unrecord has a lot of angry shouting

[@RustyShackleford556]

@@trainee5471 That is fair, but I was imagining it'd use AI speech synthesis instead of TTS. Same problem applies to both tho

[@zubinkynto]

@@trainee5471 elevenlabs is pretty good.. but not fast enough if that’s what you mean

[@trainee5471]

@@RustyShackleford556 Well, I equated AI speech synthesis to TTS in my comment, because it is defeacto nothing more than TTS at this point

[@isaacweisberg3571]

I am so glad you used ever more of dad's music in this video!!!

[@natepfeiffer5224]

I’m excited about this tech for the future of games. Things can become so much more open-ended and immersive.

[@jholotanbest2688]

This is getting insane. VR combined with AI voice, facial animations and GPT-4 dialoge will be pretty much like talking to a human.

[@phosphatepod]

The one thing I don't like is that random NPCs will just answer your strange requests. If someone told me to describe a nearby explosion with a poem, I obviously wouldn't fulfill the request. I hope that if this does get implemented in any games, this is fixed. Edit: now that I've rewatched the part about cats and some NPCs thinking it's too unrelated, maybe it is already fixed?

[@quancena5772]

Yeah philip said that, likely because it's a demo, the npc's in this world are told to answer anything you ask them, but they could just be told to ignore you if they don't care about what you're saying

[@Wapako]

That's actually insane ! AI is clearly gonna be huge in the videogames industry !

[@flare242]

This is amazing. I've already seen ChatGPT being implemented to NPCs in Mount & Blade. The tech is amazing, but the uncanny feeling is strong there.

[@michaelcera11]

please make more videos on this topic i cant keep rewatching

[@FeRoOOo71]

13:17 that a.i caught me off guard😂

[@Lucatin]

I envisioned something like this a few years ago, when I first noticed AI was quickly improving. This is exciting stuff. Especially considering it's only gonna get better from here.

[@Vasilefs_Terranorum]

Also, just imagine this technology being incorporated into a BioWare like game with companions with whom you could have proper conversations.

[@Viperzka]

This is completely amazing. I am beyond excited to see this in our future games. They have been getting decently powerful transformer models to run on local computers, so it is totally possible that they can get these limited scope AIs built into machines in the near future.

[@Tovilian]

I have to try this demo. Can't wait for more npcs like this in future games.

[@Casperr]

13:10 - he is *literally* singing the Scatman song

[@trainee5471]

Let's remake Façade with this engine

[@jaimelubrani4435]

Wow, I was literally just playing Cyberpunk and thought AI would be really useful coming up with random NPC chatter and dialog.

[@gunneone]

Most interesting paid promotion I've seen in a long time!

[@Kacpa2]

I think unique experience aspect is extra value for people who would watch people playing it and for replaying the game. Everyones playthrough being more unique in such ways, outside of gameplay aspect.

[@jesuschrist194]

This is awesome.. You're the perfect person to watch in this AI frontier, you will navigate this well and lead many of us to the light from the darkness haha. I am so genuinely and greatly excited for the future here, I think those NPC's you described, the ones who play their role as an NPC but also just exist as a personality, I think those NPC's are basically general intelligence copies, we are going into the territory of having people, fully fleshed out people, in a video game. The perfect games for this I think are open world sandbox games like Mount&Blade Warband, where there is no main story, and no pre planned events, everybody does actions in their interests, and so do you, with different motives, just like in real life, except here the consequences are contained within the game. And within those worlds in the future, we'll be able to do and say things we absolutely cannot and will not do in real life, and get to play out those scenarios, and It'll all be motives, interests, desires, needs, anything that drives us as people will drive those NPC's too, and suddenly every farmer has a meaning and every looter and merchant and every lord and king, all will follow their heart and mind, and that's the time when video games will truly peak, atleast for me. And I think those times aren't far off from now, keep it up Philip you have the best music and most interesting videos out there :) I hope my comment put a spark in the mind of whoever read it :) much love!

[@R3TR0J4N]

AI on NPC would be wild seeing its application on RPG, immersive sims, and might be the only moment for JRPG and mainstream rpg since FONV, DOS 2, DAI, Mass Effect and Disco Elysium to had a comprehensive and broad dynamic writing on games lol

[@FLy1nRabBit]

I feel like we've just gotten glimpse of what games in the future may be like. Imagine RPGs where YOU control your dialogue and characters respond in realistic ways. That would be gnarly

[@Theo-sb1lo]

God i was thinking about this use of AI this morning! so nice of you to read my mind and make this video for me :)

[@Kekatronic]

man the moment chat GPT came out I was just waiting for this

[@abcthecamper1799]

in the future, calling someone a NPC will be a compliment since its like saying they are smart as AI

[@IrIcHiHaRu]

Regardless of any downfalls with AI chatbots, when it comes to the immersion of seeing something actually react to you, this still seems like an objective improvement over a typical NPC that doesnt have any perception beyond its narrowly scripted dialogue

[@georgehornsby2075]

For this to be so good so early is really impressive. Nowhere near stable enough for complex quests etc but imagine it after 5-10 years of development. This could be a total game-changer for RPGs and rogue-likes.

[@quaver7522]

Imagine we get to a point where those infinitely branching storylines become reality. An infinite story generator, with AI generated everything; questlines, items, big events, npcs, secrets...etc. An ever-evolving fantasy world. Those mangas I read about VRRPGMMOS could 100% happen in my lifetime. The possibilities are endless.

[@aurorakins]

In this video, the super advanced AI, known as 2kliksphilip, interacts with lesser AI and reports his findings.

[@k7ufo819]

This is revolutionary. I never imagined the day I would in action. The advancements in AI have opened so many doors previously locked.

[@BodomsScythe]

The future of gaming will be insane...