Can Chat GPT replace the NPC in my Game ?

What if Chat GPT could control a NPC ?
❤️ Support on Patreon : / valemvr
🔔 Subscribe : www.youtube.com/@ValemVR?sub_...
👍 Valem Tutorials : www.youtube.com/@ValemTutoria...
🌍 Discord : / discord
🐦Twitter : valemvr?lang=en
🔥 Tiktok : / valemxr
····················································································
📝Best VR Assets ( These links are Affiliate links which means it costs the same to you and I get a small commission. Thanks for your support!)
VR Interaction Framework
assetstore.unity.com/packages...
Hexabody (Physics VR Player)
assetstore.unity.com/packages...
Mirror and Reflection for VR
assetstore.unity.com/packages...
Auto Hand (automatic hand grab pose)
assetstore.unity.com/packages...
Hurricane VR (vr physics interaction)
assetstore.unity.com/packages...
3d Hand Model for VR
assetstore.unity.com/packages...
····················································································
📝Full Series on How to make a VR game • How to Make a VR Game ...
····················································································
If you enjoyed this video, here are some other really good channel you should appreciate :
⌨️ Game Dev
Brackeys : / @brackeys
Dani : / @danidev
Code Monkey : / @codemonkeyunity
👨‍🎓 Vr Dev
Justin P Barnett : / @justinpbarnett
Vr with Andrew : / @vrwithandrew
····················································································
#vr #vrdev #madewithunity

[@teawa_]

The fact that you can make him do things on trigger, I’m just imagining the potential of a Sims type game in VR

[@ValemVR]

It's mindblowing when it actually do more than talking, the only downside is that it's very unpredictable because its based on the AI will so I don't know how they can handle that versatility in gameplay. :o

[@teawa_]

@@ValemVR trueee

[@erobusblack4856]

​@@ValemVRmake a separate modal with unity ml agents to control the needs based state machine and use something like deepminds Gato to link them together.

[@NoCodeFilmmaker]

You can also use open source stuff like RIVET and Supabase for the logic outside the game or experience. That's where you can execute advanced stuff like setting up agents and complex prompts and logic for autonomous sims. In fact there's already a game where the NPC's live independent lives all on their own within the game.

[@teawa_]

@@NoCodeFilmmaker whats the name of the game?

[@ValemVR]

Big shoutout to the amazing folks doing the VR Jam 2023 currently ! itch.io/jam/vr-jam-2023

[@StrangeLake]

This is some genuinely cool stuff! I imagine that there are some awesome ways people can incorporate this in their games and I can't wait to see what the future holds.

[@SamSamTutorialMan]

I love this. One of your best ideas yet! Here's a silly suggestion.. you could make it so there's these really hard puzzles to solve and you need to talk to the AI to help you solve them.

[@JeffinFL]

So cool and I love how you always incorporate humor

[@danielboza5747]

I have done something similar, also using the same openai unity module. The way to get faster answer is: stream gpt-3.5 response and "simulate" streaming whisper API, by recording chunks of 5 seconds. Its a little tricky but you can get responses in 2-3 seconds

[@Brosquini]

I love this project I beg you to keep working on it!!! it is so awesome, I would love to see the bar lady to be able to serve you drinks, or to have characters walk around the bar and talk to each other, maybe they could even know your location and the time, like asking you to come closer to them so they can hear you better, or exit the bar to go home and that type of thing.

[@braveitor]

Nice content as always. You always manage to put a smile in my face. :D Thanks!

[@adhochero6619]

thats so dope ai is gonna be crazy in the future. great video, so funny too.

[@yashsonar5999]

Awesome buddy... That's really cool. I just loved it. You have really worked so hard for this. Hats off sir...

[@CamVanZek]

Another stellar video! Your skills are awesome but your personality makes this videos worth waiting. Great job and thanks for a couple hard laughts. With ChatGPT, my thoughts are automatically goes to another level. Not only NPCs guided by AI but entire game (engine) controll by AI. You can come back to a game you love and have new experiences every time you come back to it! (Main line of events remine constant but side quest can have infinite possibility and make game experience even more awesome)!

[@halbzwilling]

Well done, Valem!!

[@Tzill]

This is really cool stuff. Someone did something similar with ModBox a few years ago, been waiting on a follow up ever since gpt4 dropped lol

[@lightweightabsorbent2008]

You should update this project using the new whisper api, tts api, function calling and the new model GPT-4-Turbo. Just build a class system for function calling, I would love to see an updated version.

[@pierrestenborg3125]

interesting stuff man, keep it up

[@cryptkeeper]

This was great!

[@AnasMations]

3:27 That was hilarious xD

[@Faux_Fox_]

My god, that's so fucking cool

[@77netwar]

Really cool!

[@OnlyOneGames-tl6jt]

Love this channel

[@hakan19041]

Great Video i will look forward too the patreon tutorial!

[@ValemVR]

Thanks will try to post it as soon as possible :)

[@KaanErayAKAY]

Great work.

[@dhanushkumar7161]

brooooo that was epic

[@cullisplays5206]

This was actually really cool

[@ValemVR]

Thanks dude :D

[@rodackor]

Great content, très bon turorial.

[@guidocomba]

Like Allways i say Excelent video to wake up a new interesting toping!!!

[@user-lu5vt8ew1v]

Je viens de découvrir ta chaine. Continue comme ça

[@MaszekMester]

...and I am here, still strugling to grab a cube

[@lucashyde1164]

I really want to utilise this When do you think the tutorial will be available

[@RunyCalmera]

This is great!!! A great future. Many opportunities

[@BrummieLadd]

Brilliant 😂😂👍

[@VRplay86]

I think it's awesome 😎 so much potential 🤠

[@ValemVR]

Thanks for watching :D

[@NightSpyderTech]

West world! Let’s go!

[@GamerReality]

I see you used lip sync for this project, how should I go about using lip sync for my multiplayer game where I'm creating cartoon characters from scratch? I'm thinking about using the Oculus Lipsync and having a Fiverr artist model the 12 blendshapes.

[@_skeletoon]

Hey, Valem. Did you use any of the Generative Agents Architecture?

[@PigOnPCIn4K]

Hey there! This is exactly what I was looking to setup and test soon but now I won't need to! If youd like someone to test out the VR AI I'm your guy, I have some ideas we could do for a video as well as my community would love it!

[@indiaink10]

3:49 favorite moment lol

[@teawa_]

This is insane 😂 What software did you use to design Fred?

[@ValemVR]

Hi man I used Character Creator. :)

[@XboxPlayerPL]

Is there any real time voice cloning that i could use in production? I need SDK that i could use in unity game. I mean, something like I speech and it converts to any voice like bruce lee or will smith. I do not mean text to speach conversion. I mean, real time conversion.

[@metalabs6804]

Why don't you use Oculus voice sdk ?...please let me know

[@Hacktheplanet_]

hopefully AI systems will expand the scope of what one developer can do

[@BasedReda]

4:32 am I going crazy or was the haki sound effect 💀💀💀

[@ValemVR]

Yeah! I'm glad that someone noticed it !

[@gits999]

How westworld started :

[@Christian_Bagger]

I kept watching because of the accent

[@insertmemehere1681]

"good idea"

[@pratyushjain5344]

Can someone help me i am trying to import the Kevin model in unity but whenever i import the model i get a fbx import warning stating that cant generate noramls for blendshapes

[@nicks4727]

I wonder if you could do this with the open source chat models so it can run locally and have a playable demo, vs having to provide a chatgpt key and it costing money

[@ValemVR]

I guess you could try to generate some response by using the Chat GPT AI and then save all of them locally and try to trigger one of the saved response to fake that the AI response in real time

[@nicks4727]

@@ValemVR There are chat networks that can be ran locally that are not chatgpt like stable vicuna. It's not as fast or huge as chatgpt though and It would probably be difficult to get it to work with unity.

[@JeppeBeier]

@@nicks4727 Problem is for any of the half decent models you need a very beefy GPU, so you can't ship a game like that. You would have to run instances that the game would then poll over the network if you want it to work for people. For instance I've got a decently powerful machine with a 2070 Super, and even I struggle with anything larger than a 7B model. Then adding the task of rendering a game on top would make it completely impossible.

[@nicks4727]

@@JeppeBeier Your right, I was thinking it would make a good demo for the people that had the hardware

[@CrAzYpotpie]

​​​@@nicks4727Then why did you even ask the question in the first place? The answer is yes, it just isn't feasible to make a game based on such tech yet, that is if you are looking to reach an actual customer base that could run it, but you seem to recognize that already. You will get your Project Milo "game" soon enough, don't you worry.

[@MicroblastGames]

I want to see the tutorial, is the patreon off?

[@ThomasFinas]

*snifffs* ahhhh...french memes - u -

[@ValemVR]

Aha I had to drop some :D

[@jackboback2721]

True 🗿 moment

[@ValemVR]

🗿

[@pastuh]

Ineteresting if it would be hard to create for existing VR game..

[@SamSung-ff2gr]

push it to Oculus store right now

[@user-sd7dg2lz6d]

what are you using for lip sync? I want to buy your Patreon subscription but I am not sure will it solve my problem. i have to lip sync and built it to Webgl platform I am tried multiple option but didn't worked for me

[@FireBlast2.0]

Are you going to continue the vr series

[@ValemVR]

You mean the tutorials? Yes I'm posting one every week on my second youtube channel Valem Tutorials :D

[@FireBlast2.0]

@@ValemVR I meant the VR Multiplayer Series :)

[@FeTetra]

intelligent ford????

[@chiki1256]

install the game is available ? (allez quoi)

[@jeezyjohns8647]

What is your software to create avatar and visieme ? Green and Black for its interface... I think it is maybe a tool from Nvidia ? I created 1 french VR multi experience using metavoice, chatgpt, Google text to speech and Ovr lips. I have found 2 avatars from ready player with visieme... Then I make your turorial with Rebecca ! That was my second avatar with visieme... I dont know use 3D software like Blender or an others... And your software it can maybe easier for just create visieme from avatar generated by ReadyPlayerMe... Then this Avatar, Fred was created by 3D artist or avatar generator like Meta humans but compatible with Unity ? Maybe a Nvidia tool, Again ? I believe your are in beta test for their news tools ?

[@jeezyjohns8647]

I see the response in another coment. Valem use Character Creator for create Avatar and visieme.

[@ValemVR]

Hey! That's right, I use Character Creator 4. Just take care of choosing the right viseme type in CC4 that will fit to the blendshape target you'll need with your OVR Lipsync

[@alon0shoa]

This is something we did in our lab a few months ago using chatGPT kzbin.info/www/bejne/nZmXfaawpK6Eb5Y

[@ValemVR]

just watch the complete video its crazy i love the way you used it on a historical person and the presentation setup with the quest pro passthrough great stuff!

[@alon0shoa]

@@ValemVR Thanks! I used some of your help with this channel! 😁

[@cryptococonft9523]

this is how westworld started... XD

[@c.g.1896]

As alwaysss : perfect and funnyyyy P.S.: would you please feed me too Valem ?

[@MuromachiLines]

7:38

[@messengercreator]

and I'll challenge u AI CHAT DEEPAI u create a ncp/NPC

[@S1xtee123]

Game?

[@Light846]

Wow this is just like the movie Free Guy (The concept)

[@GBart]

ML is not AI! ML = cheese AI = a whole pizza Nobody knows how to make crust, or sauce, or toppings, or a pizza oven. We just have provolone. It's not even mozzarella

[@branidev]

This is all great but unfortunately now you cannot make a game like that and give it to players because they have to have their own API and paying subscription to what ever server you using or you would have to pay some enterprise version of subscription to have all them players playing your game at the same time, which is shame but we are getting there it is matter of time and anyone will have AI generated answer locally from their PC offline i think..