Meet Your New Wingman: GPT-4 Turbo in Star Citizen!

We made a useful AI companion for Star Citizen with the new OpenAI APIs that were just released. And it's really working, no post production or fakes have been used in this video.
We are using OpenAI's APIs
- Whisper - For voice recognition
- Text to Speech - For human-like voices
- GPT-4 Turbo - For everything else
This is the first video in a series of videos that will be released in the future. It is a showcase and is intended to give you an idea of how you can integrate AI tools into existing games or applications. In the upcoming videos we will show you how you can implement them yourself and what further potential we see in this technology. So stay tuned for more content on AI development.
Join our Discord Server for more information: / discord
Support us at Patreon: patreon.com/ShipBit?...
#wingman #wingmanai #starcitizen #shipbit
See @ShanieMyrsTear and his Star Citizen video here: • Star Citizen: I rolepl...
00:00 - Intro
00:35 - AI ATC
02:11 - On-Board AI
04:51 - Trading Office AI
- - -
WEBSITE: www.shipbit.de
TWITTER/X: / shipbitagency
- - -

[@ShipBit]

Wingman AI is OUT NOW! Check it out at kzbin.info/www/bejne/qpbQfZage6mcjLc

[@jessecdh]

THIS IS INCREDIBLE. EXACTLY what Star Citizen is missing with immersion and ease of access at times. But this would completely change the game for me. CIG has to see this immediately!!! 🤩

[@Billy-bc8pk]

When Chris saw Hybrid Audio's realistic immersion sound video he had the sound team add a realistic sound module to the game exactly how it was designed in Hybrid Audio's video. So if this gets enough traction and Chris sees it, it's pretty much 100% guaranteed it will end up in the game.

[@CheapoAss]

​@@Billy-bc8pkand another delay😂

[@TrickOrRetreat]

​@@CheapoAssit will not delay server meshing team or pyro team etc. This tech needs to happen. Even though voice attack exist on steam for a cheap price

[@davidd5523]

Chat gpt is actually pretty expensive for business use, especially chat-gpt 4. If CIG can make it work great, but I hope they do the due diligence on cost first

[@j.d.4697]

Yeah but those useless old farts both at CIG and in the community don't want it. I suggested something like this months ago and people didn't want it.

[@TayoEXE]

I think this could be interesting for a Star Trek kind of experience as the captain, ordering crew mates to do certain tasks while maintaining your own, etc.

[@TrickOrRetreat]

Could be used to giving orders to npc's on a big multi crew ship.

[@NatjoOfficial]

I was going to say, a large as fuck capital ship listed as only having a single required crew member. It's entirely run through voice commands and such, but has the downside of being significantly slower to respond to certain actions, while also being able to avoid obstacles and seeing the context of what's in view of the ship and such while you can just run around the bridge, faffing about.

[@robertpatrick5861]

​@@NatjoOfficialThe problem lies in the actual complex tasks that need to be done.. like maintenance.. as none of these things are just.. artificial.. but ohysical tasks that need to be done. You would really need a lot of NPCs actually running arround checking etc. A bolted on AI could never manage.. or would be waaaay to expencive.. This would be needed to be done in engine with task specific software... and still be REAL heavy on the servers!

[@ziggyz8345]

A.I generated stuff in star trek bridge crew would be amazing and is the game i assume you are talking about

[@NatjoOfficial]

@@robertpatrick5861 not necessarily. You don’t need multiple GPTs running around doing stuff, you just need a single GPT controlling and sending out pretty rudimentary NPCs to do the tasks that need to be done, or for certain things simply a counter with “NPCs” available for a task and then a countdown to when that NPC is available again. It doesn’t need to be insanely complicated. Plus, you’d only need really the input interpretation of the GPT which is one of the lighter weight parts of it and something we’ve put in games before. Give the AI some basic pre-made voice lines, or even a text to speech bot which can generate from pre-made sentences cobbled together like “[fire detected in] [cargo hold]”. (Tbh, I don’t think it even requires a GPT at that point…)

[@nickg2691]

It cannot be overstated how much this will change gaming in the next decade. AI crew, companions, settlers, enemies. Your companions will remember everything you have been through together in game, will have unique personalities tailored to you, and actual conversational abilities. Prerecorded dialogue and interaction trees will no longer be needed. Missions will have nearly endless nuance, making them all unique to the player while progressing a wider storyline. NPCs will all be running basic neural nets giving them unique environmental and situational awareness/reactions. Graphics will become even more lifelike using generative AI to polish the GPU-generated graphics. There will be endless AI-generated side quests, the list goes on and on.

[@Sm0lPerson]

It will need to be worked on a great deal with some railroading for important story beats, if you've ever sat and tried to RP with AI it often forgets, misunderstands and outright curbs the conversation with unrelated topics. It'd be nice in small doses, but running major game systems with this would be asking for failure.

[@jtjames79]

​@@Sm0lPerson What you are playing with are very rough prototypes with garbage user interface. They're already are multimodal LLAMA agent swarms, I read about four different memory optimizations just this morning in white papers. Just this morning a single small file made SDXL 10x faster. Even a 3060 can spit out an image every couple of seconds. Instead of having a guess what sampler works best with what model you can just try all the samplers in less time that it takes to make a cup of coffee. It doesn't just make the images generate faster it makes the entire process 10x better for the same compute. Same thing for LLMs. LLMs still don't have it's "ComfyUI" yet. There is still a lot of very low hanging fruit, and lots of interested developers.

[@nickg2691]

@@Sm0lPerson Yeah of course. I don't think anyone is saying this is ready for production it is more of a glimpse into the future of gaming and NPC interaction. It will likely be an add-on/modded feature to begin with, most likely accompanied by a monthly fee, soon followed by AI-generated DLC or mods then finally integrated into a game at launch. This is likely the worst it will ever be which, as a gaming enthusiast, is incredibly exciting.

[@JINGWA64]

@@Sm0lPerson like already mentioned your referring to outdated, obsolete and likewise poorly setup ai platforms, you also have allot of people even charging subs and other fees as well for junk ai, because they know your average consumer is clueless, even to the fact its possible to run them on a home PC, which means most AI platforms especially on any app store have a mandatory online service model, not only to milk your wallet to unlock their features etc, but also to collect and sell your data, which they cant milk if its released as a standalone download, so they not only prey of consumer ignorance, they also feed it through mis-information as well.

[@paskky913]

The problem is computing power. ChatGPT needs tons of video cards to run.

[@nekuuchihaify]

you need to show this to the devs and see if you can sell it to them or something, this is absolutely genius

[@jesfr3236]

there are no IA in starcitizen lore

[@cybergothika6906]

If a user knows it I'm pretty sure the devs at CIG are all well aware of it as well.

[@Wha73v3r]

@@jesfr3236 if we are just talking about the ATC Contatcs: its not AI inside SC its a AI here in real life just controlling the NPC so its no AI in SC Lore its just Game Tech For the Ship Controle yes this is against Lore

[@Chris_KAy]

no its not, every moddingcommunity is using ai since the first became popular, skyrim hello?

[@666okano]

mate the devs have enough problems this will only set them back another 12 years and 5 game engines.

[@ShipBit]

LIVE: UPDATE: We are thrilled to announce, that we are one step away from releasing our first version of WingmanAI! Currently we are in polishing phase and are planning to get feedback from our Patreons (as early access testers) earlier next week. If there are no major issues, we plan to release the first version to the public next Friday. To give you some insights on what to expect, here is a list of features that will be included in the first release: - Talk to different AI characters - Create / Modify your own AI characters - Support of multiple AI characters (each has its own configuration and history) - Define commands and keybindings which can be triggered by the AI characters - Define instant action commands which can be defined by phrases and are triggered faster (like VoiceAttack) - Enable / Disable audio effects - Plugin system to extend the functionality of WingmanAI and implement your own logic (including API calls etc.) - Multiple languages, even on-the-fly switching in conversations We are really looking forward to your feedback and your ideas on how to improve WingmanAI. Again, thank you so much for your amazing support! It really means a lot to us Have a wonderful weekend! --Original Post: Hello everyone. We are absolutely overwhelmed by the response and your feedback. We try to read every single feedback and update this pinned comment to a little Q&A ;-) 1. "How did you do it?" We're currently working on a series of follow-up videos to show you exactly how we did it and how you can do it too. 2. "It's like Voice Attack!" It's similar to Voice Attack, sure. The main difference is: you're actually talking to GPT-4 Turbo, which means: you don't have to say a specific keyword or command. You can, of course, talk to an AI and talk about anything in your mind. 3. "The response time is not fast enough." Yes, this could be improved in the future. But we already have prototypes that shorten the response time. And we will definitely talk about this in one of our next videos. 4. "This is not the Seraphim Station!" No, it's absolutely not ;-) To be honest: At the time of recording, I didn't know the name of this pyro station yet, so I just called it Seraphim Station. But that doesn't really matter, because the AI doesn't know anything about it either. 5: "How can the AI react to the scan results?" It can't at the moment because Star Citizen doesn't have an API or anything like that. GPT just made up a response, that's all. And yes, that is a bit arbitrary and not correct. Thanks again for your feedback and let's see in the next video ;-)

[@jamiefolds5295]

please post vids on how to set this up. it feels better than voice attack, as i cant always remember the exact phrase to use with voice attack

[@LevelGroundGamer]

So for number five scan results why not have the ai respond with something like please refer to your dispaly or hud for results? or I have marked them on your display.

[@geekdomo]

@@LevelGroundGamer you can simply train the AI to do just that. Like say a phrase to it "from now on anytime you do a scan tell me to check the hud". It's very teachable. Only issue is it does "hallucinate" quite easily so you would have to refresh what you taught it from time to time. I have a script I run every time I run out of tokens (although now it has significantly more tokens to use).

[@zakthedrippa]

Hey, I love this idea. Can this be set up to allow chatgpt to control actual player accounts? Because if so I want it

[@TheChosenOne471]

Hmm… can I use it even if I’m not in the captain seat? Also is this useable in game? Like can I use it? And is it considered cheating?

[@Valkyani]

Voiceattack evolution. It never stops to amaze me what the star citizen community does.

[@clarkelliott6272]

The big difference between this and VA is that there isnt a need to train the onboard hardware to map your voice, the AI just runs it itself and has a very good confidence level on these commands. Also non-scripted responses... just insane. Switching to other languages on the fly is just showing off.

[@Norman_Peterson]

NO This thing has huge potential. given the spending attitude of RSI customers and the potential of this work, I hope you think about creating a specific app. It has a lot of potential and real utility. An AI that can connect from the ship, to the helmet when you are outside the ship, is very useful. excellent earning potential. and choose which is the best depending on the parameters you enter. the voiceattack is just a repetition of instructions, here the APIs provide data and information to a system that can MANAGE AND MANIPULATE them. it's absolutely not the same thing.

[@bradblickenstaff4082]

@@Norman_Peterson I think that's why the comment said "evolution," either way I agree... this is absolutely amazing. The potential is immense.

[@UUnngghh]

The folks at voice attack need to be paying very close attention to this. This is the direction that should be moving

[@formerly_chucks_69]

It's like an improved VoiceAttack... very nice.

[@Bang1324]

An immersive VocieAttack with a relative locational knowledge database Excited to see if this will be progresed into a true Verse'Companion

[@MrTree421]

Just a lot more expensive at $20 a month. But truly interesting for the future.

[@JadeStarwatcher]

@@MrTree421For people like me who are already paying the $20 a month for using GPT-4 for other things I'd love this to get more of my money's worth!

[@Anachroschism]

The beauty of this, is there's no one way to talk to the AI, the complexity of how you use it, can dynamically scale, to how you talk to it. If you want full ATC mode, it can do it, but if you want to simply turn on the engines, it can do that too, and unlike a typical game mechanic, you're not required to do either.

[@ShipBit]

Yes, and you can change this to your liking. It’s basically just a GPT Promt shaping the ‘character’ of the AI.

[@Anachroschism]

@@ShipBit only missing the API access for better feedback and control. Hopefully in the future, we see more of this type of NPC interaction in games, as well as the NPC conversations.

[@curly_]

And it would also be nice to be feeded by cornerstone and erkul

[@Johnnyo2408]

Wow, just wow!! This has the potential to be a total game changer! Full immersion. Seriously mind blown right now!!

[@DeutsBoui]

Wow, did not expect to see something so badass today... Stoked to see where you take it!

[@chrisdavis7533]

I thought you had stopped playing this many moons ago? Or do I have the wrong person?

[@DeutsBoui]

Well I never really started until this year, now this is the only thing I play. Assuming this is the pilot I called Khruu/4th, you got the right guy. @@chrisdavis7533

[@Tobes1984]

Well this is just an excellent example of the power of the new openAI custom GPTs and the native JSON outputs with no latency and mutliple function calling at once can be now be utlised, im assuming this is using the openAI whisper API as well with the new GPT 4 model. Pretty damn cool if you ask me. Iv been watching all the use cases pop up over the last few days but this one i did not expect, nice work.

[@SuperRedman76]

There is a delay between communication with the AI, but hopefully that can be fixed.

[@ErikLiberty]

The title of the video says it is using ChatGPT Turbo.

[@wazzuppoo]

what’s a jason output?

[@richardcharlesworth2020]

The delay will get better. The new 4 turbo model that he’s likely using has yet to be optimized for speed ( been optimized for sophistication and lower cost first). Also he’s recording his speech and then sending the GPT an audio file to analyze first. Great pattern for a compelling technology proof and when he or someone else takes it to the next step they will likely stream the audio into a separate speech-to-text agent and then pass the text to the GPT. That will reduce the time delay significantly. The thing to call out here is that he built, in under a week (the tools he’s using were released from OpenAI on Monday), a break-through compelling immersive experience, the likes of which have never existed in the gaming world. Fucking Bravo Zulu!

[@ErikLiberty]

@@richardcharlesworth2020 According to ChatGPT 4 itself: Whisper, an automatic speech recognition system, works by converting your speech to text before it's analyzed by systems like ChatGPT. Here's how the process typically works: 1. **Speech Recording**: Your speech is recorded via a microphone or other recording device. 2. **Speech Recognition**: The recorded audio is processed by Whisper, which uses advanced algorithms to transcribe the speech into text. This conversion happens locally on your device or on a server, depending on the specific implementation. 3. **Text Analysis**: Once your speech is converted to text, this text is then sent to ChatGPT or similar systems for analysis and response generation. This process ensures that the language model (like ChatGPT) only deals with text input, maintaining a consistent mode of operation regardless of whether the original input was typed or spoken. The key advantage here is in maintaining user privacy and data security, as only the transcribed text, not the actual audio file, is sent for analysis.

[@dormitor187]

It is an honour to live with you at this time. I can't imagine a more innovative game than Star Citizen with this feature and the possibility of a GPT! And of course Skyrim ;) Und mit dem Sprung auf deutsch hats mich völlig verrissen, BIN BEGEISTERT!

[@Rikalonius]

Have to say I loved it. Communicating with flight control makes it so much more immersive.

[@JustThisGuy42]

Holy shit this is amazing. I want this in my Star Citizen life right now! You sir, are a genius.

[@JustThisGuy42]

Can it target nearest enemy and fire remote turrets?

[@OneTwoMark]

@@JustThisGuy42 Lol obviously not.

[@ImpressionismFTW]

@@OneTwoMark Based on the way its executing commands that can be bound to keys in game, you could probably get it to target nearest enemy since thats a keybind in the game. Aiming and firing the turrets is another matter and I don't think it would be possible at the moment without multiple accounts to provide player characters to man the turrets. Once we have AI blades in Star Citizen built in which can operate the turrets and probably keybinds to go along with it, then I think this should be possible based on what was shown in the video.

[@gprime8697]

This is easily the coolest thing I've seen in gaming ever. You should think about reaching out to game devs and offering your services integrating this into their games, im sure there are countless games that would benefit from having this type of machine interface added to them. I really cant get over how cool this is lol

[@galvendorondo]

I’ve wanted this for SO LONG, i just didn’t know it was possible. This is amazing.

[@Time2gojoe]

I hope next years citizencon is just as good as this years.. but a lot of it's about dramatically better A.I. You can talk to and hire

[@SatoriLuvTheFlex]

Probly will be big as squadron will either be out or about it around that time

[@fortnight5677]

@@SatoriLuvTheFlex I thought you were supposed to Answer The Call in 2016?

[@Rummyson]

@@fortnight5677 That was the plan, until the community demanded the game be expanded and planet tech came online

[@Time2gojoe]

​@@fortnight5677I've seen the leaks of the 2016 game. Glad it was completly scrapped.. looked like a crappy version of advent rising.. which is itself crappy.. the new SQ42 trailers look like a PlayStation 6 level revolutionary game in comparison

[@MrMcbear]

The trading office bit and then doing it in german blew my mind.

[@gundulf3084]

utterly brilliant, I am especially interested in learning more about how you drive the voice synthesis with such superb voices and vocal effects. Outstanding, thanks for sharing.

[@TheDavidMetcalfe]

Impressive implementation. You should also include how much all the API calls cost in total for a sense of where we currently stand with the technology and its accessibility.

[@keremsen4116]

OMG absolutely amazing. This must be an official feature. It would be really helpful especially to new players. Because I remember when I first downloaded the game I was very frustrated with constantly checking web for tutorials.

[@tawa68220]

Dude this is awesome! I hope CIG could work with you into implementing this fully into the game itself. I really liked the part where the AI explained where to sell the stuff, as I hate to have to alt-tab and google or even ask people in local chat.

[@PatrioticGinger1776]

I've always wanted this in a space game!! Can't wait for your videos on how to implement

[@dimensions7834]

This really puts a whole new level to the game! Very excited to see this and want to use it when available.

[@bigfoot9049]

This is pretty damn cool, only thing I could say to add would be different ai voices for different roles, maybe have a handful of voices for the different atcs and such.

[@Vartazian360]

Thats pretty wild..The only issue is processing delay time. Im sure over time GPT will get faster but wow pretty insane.

[@ErikLiberty]

At OpenAI's DevDay a couple days ago they said they had to choose between making ChatGPT faster or cheaper.They chose cheaper and got the cost down to 2x-3x cheaper for pay-as-you-go API calls. They said they will now pivot and work on making it faster.

[@TheKorbi]

I think for ATC calls the response delay is fine, but for the bord computer not ^^

[@SpaceMike3]

@@TheKorbi A delay in ATC calls is absolutely fine by me. Feels more realistic imo

[@ShanieMyrsTear]

For the in-ship AI model there is no need to use GPT-4. 3.5 Turbo is practically seamless as far as response time and far cheaper (literally fractions of fractions of a penny). Worry not about speed.

[@jabbathehut9587]

I have been testing this for a couple days now and.... WOW! I'm blown away! This takes everything to another level!!

[@jazzman782000]

So awesome! Fully integrating this into the game would take it to the next level.

[@MineconTt]

HCS Voice packs is currently developing something similar to this but based on their professional voice acting and ai integradtion into Voiceattack. I honestly cant wait this is the start of JARVIS

[@jean-lucpicard581]

Thanks to Eleven labs, you don't need professional voice acting anymore i.e. you can just train the AI with already existing snippets of voice actors and then use TTS to extend it infinitely.

[@ShipBit]

@jean-lucpicard581 yep, we’re already working on 11Labs in Wingman!

[@dubmcz]

This is what a "next-gen" game would implement. Love you guys for taking this endeavour on and demo'ing it. CIG, i hope you're taking notes!

[@philfoster7235]

This is genius. Talk about immersion. Looking forward to learning how to add this feature.

[@Katana_Blue]

Damn, this is absolutely fantastic and adds a greatly needed addition to our fantastic game, Well Done to you Good Sir

[@musachi5999]

Oh my days… this is just way too awesome! Hats off for getting this working in such an immersive way and even switching between languages seamlessly makes it even more amazing. The commands feel natural and the AI response is exactly how I would expect as well. I really would love to see this become something everyone could potentially mod into their games. I’m interested to see how their “anti-cheat” interprets this, obviously it doesn’t seem to care much at the moment but I wonder if when the game launches proper, will something like this get blocked by them? If so, I think the whole community would clamour for an official addition of this feature, adding another 10 years to SC’s development probably😅

[@HMS_Thunderwolf]

felt like a Voice Attack copy to begin with, but this is alot more dynamic. the information getting could prove really helpful and interesting. plus the idea of having it reply like a real conversation instead of just pre-recorded voice lines opens alot of options.

[@MINIMAN10000]

I figure that's why he pointed out that it's not the same. Voice attack takes voice to text and then hits a key. It is looking for only key phrases. Whereas this takes voice to text and then passes it to GPT. GPT is something you can communicate to. If there is an API or script or something it can be given information from it can do pretty much whatever with it.

[@kunze2377]

I am really looking forward to the point when we can actually have conversations in games by just talking to NPCs. Great Job!!!

[@severus2609]

Simply amazing! Unbeliveble I live to see this hapenning!

[@BenJaminLongTime]

this is pretty awesome actually. just normal old SC feels much more scifi and immersive with nothing more than some dynamic interactive AI talking man.... would love to see this as a permanent implementation to the game. Like many have said, very star trek vibes talking to the computer and giving it some commands to execute. I think when it talks back dynamically is even more immersive than the in game actions it performs funny enough, but the combo is ideal. I think SC has a fairly hefty barrier to entry too that is really neat to have commands for the 'computer' to do, like shields full aft, or all power to thrusters, landing mode, lights, ATC for stations all nice additions to the game but tedious and immersion breaking to perform when you have to look up keybinds or something, asking the computer or station though via voice? hecka cool and realistic-scifi for the more trivial tasks of operating a complex ship.

[@Relay3rx]

All we need now is the ability for a computer module in the ship to execute remote commands so that you can do other stuff while the computer does the action, imagine running your your ship, getting in range and having the computer start the engine up and open the doors for you!

[@MMORPG87]

if u have a second account it can be done. a player has to be in ship seat for anything to happen. the game is not coded for anything to work like that.

[@Danger781s]

I had an idea like this but it would be for every single game that you could own which would offer each game a new perspective each playthrough. Awesome content 👏

[@NoOneCares2k]

Blew me away with the seamless language transition. Bravo, very well done!

[@easterworshipper5579]

i think i prefer the speed of VoiceAttack for the ship functions, but asking the computer for trade routes and the like is pretty neat!

[@coolfarmer]

The speed is not a problem, AI will become faster and faster. For now it's slow, but in a few months/years it will be very fast.

[@konellin189]

but do they actualy are acurate? if so its brilliant. I got VA and I love but this Sir is way to crazy.

[@AWARHERO]

I need this NOW!!!!!! I use Voice Attack which partially does some of the things you demonstrate but no interactions with stations.... This is awesome! I'm eagerly awaiting your instructional videos on how to do this.

[@Sgt_RED]

you can do this with voice attack aswell. you just have to set up voicelines that react to these specific ones you say.

[@AWARHERO]

@@Sgt_RED Yes, i understand. but you can't get Trades routes info ... This is way more in depth

[@LouSaydus]

This doesn’t actually add any interaction with stations, it’s all just chatbot fluff.

[@JadeStarwatcher]

@@Sgt_RED Setting up voice lines is time consuming especially when AI can come up with their own which aren't going be the same each time you issue the command.

[@eavdmeer]

All true, but are you willing to fork out 20 a month for that?

[@Xarf]

Very cool demonstration its like Voice Attack 2.0 . Looking forward to see more videos :)

[@StevenTheGeek]

Pretty cool. I have almost all of it doing the same in voice attack with no latency but I still love it. I like the idea of feeding the trading database into open ai for an upgrade, good job 👍

[@LatteLazarus]

I've been using VoiceAttack but I would definitely love to replace it with this! AI is the future.

[@KhairulFadzlyAKarim]

Could they add those together, I love Voice attak voices, imagine having obsidian ant ai actually conversing.

[@JadeStarwatcher]

@@KhairulFadzlyAKarim If the HCS people are watching this they should know this is the future. they have the voices, they can clone them for use in their own proprietary AI and offer a "Voice Attack Service" like this.

[@eavdmeer]

VoiceAttack has plugin support and HCS currently is using a plugin to access the log files and the frontier API. Should not be too hard to access other APIs

[@williwichtig7741]

That looks amazing, i am very curious to see the next videos and how to implement it.

[@hanovergreen4091]

DAyum!!!!!!!! Finally here in a pocket sized box. Glad I lived to see it but also worried about the future. Thank You for sharing! Grüße und Danke!

[@eternalroree]

Incredible job with the backend. Smooth. 👏🏻

[@theMooly]

What im hoping to see is speech-to-roleplay type of feature. Not everyone is confident nor has "an epic movie voice". Having an IA record you and modify what you say to fit a roleplay character of your own, would be really interesting. Players to players ship to ship hailing with such technology would feels like a true movie! Amazing video! Would you think this works in French :-D ?

[@Zweistein001]

That's a very interesting concept, actually.

[@ShipBit]

Yes it also works in French ;-) And yes: Interesting thought…

[@fortnight5677]

What the fuck omg the soy

[@historyman9436]

It would also help those that are sorta shy to also talk ingame

[@Frostie3672]

​@@historyman9436for some it's not just shyness, there's millions of people around the world who have a stammer, I'm one of them & the kind of idea the op is talking about would be a game changer for allowing those with a speech impairment to also join in & use voice tech like this as well.

[@aguy446]

AI is outlawed in the game lore. The developers have said having AI run everything would make a boring game.

[@VortexStolenName]

Then we'll do it ourselves lmao

[@OneTwoMark]

AI is literally planned to be an option to man your turrets in future. A cheaper option of NPCs. Its gonna be AI > NPC > Player for effectiveness.

[@historyman9436]

@@OneTwoMark If OP is right, I presume that running the AI turrets will be either susceptible to you skirting the law, or the lore will be adjusted

[@boukm3n]

It clearly isn’t in this scenario it’s incredibly useful and enhances immersion. If anything, this makes the experience much more exciting

[@LykosMenon]

@@historyman9436 For clarification on what was said, general artificial intelligence was banned, not ai. AI for specific use cases is very much a thing but is heavily regulated where it's allowed. Think of it like how cars now have adaptive cruise control, lane keep and departure sensors, automatic traction control, etc but full self driving is undergoing a lot of scrutiny in legal fields right now and is beginning to be regulated. Automated turrets would fall in that complete automation heavy regulation area if they can do full target selection, prioritization, etc but if it's just whatever the pilot targets and it's just pilot controlled turret gimbals around the whole ship, that would be way less regulated.

[@fenrisboi]

Instant sub, this is amazing! Show us more! :3

[@jamesprentor8433]

This is so cool! And an actually useful fun looking integration that would really increase immersion. This kind of thing is what all games that use dialogue should have.

[@AmericanVikingGames]

I know CIG wants the Captain to be a usable functioning role for Players. Always wondered how they would set up an interface for that kinda gameplay but honestly I can see them going down a route like this

[@hallker]

This seems so immersive and incredible. But also its implications potentially dangerous... not sure if CIG should include this or ban it immediatelly. 😅

[@doge5401]

Shit like Tobii already gives a significant advantage. Other peripherals are arguably more advantageous for certain scenarios. No reason to not have this.

[@grahamw7657]

Could something like this be client side only? To mitigate risk.

[@hallker]

@@doge5401 Well, at limited capacity yes... what I am refering to is that AI in general can be trained for games likes this. And if that would happen, it would most likely be indistinguishable from normal players. That could potentially ruin multiplayer gaming as a whole. Don't get me wrong, this is miles away from such a scenario and I would actually love to have something like this in game. But only if CIG would be in full control over what this can and can't access.

[@hallker]

@@grahamw7657 Hard to say. I would love to have a companion like this in my helmet or my ship... But I think it would have to be very very limited. The way it is presented in the video is fairly basic, despite how incredible it sounds/seems. So, as long as it uses only in game controls and reacts only to what players say it might be just a great tool. But the fact it offers a trading route scares me. Not sure if it somehow collects from in game data, or it just searches the internet to find the answer and that is not cool honestly. Like, it could remove all the mystery/investigation from the game.

[@AtelierdesHautesCotes]

it's amazing work and realistic conversation. I loved it

[@ssutrisno]

This is amazing! Can't wait for your next video!

[@robertrossiter346]

imagine if they intergrated this into the game, it would only add another 4 years to development, nothing really.

[@gamerairways]

That's cool. Nice to see AI applications like these in gaming. It's going to make things quite a bit more immersive.

[@siahtamba4189]

great concept.... been thinking of getting autopilot and all lot of stuff that is possible with what you have done. thanks for the idea

[@arkadiusz5913]

Looks good for a video. Don't think it will be useful in day-to-day playing due to two reasons from the top of my head. 1. Gets annoying if you need to go through the same chit chat 20 times a day leaving your hangar or doing any other repetitive activities. 2. You're gonna get blasted asway before you can say 'computer, please arm 2 flares and launch them in order to counter these two missiles approaching me' :D Nothing beats having HOSAS with shit-ton of buttons and just doing all of these in seconds.

[@apeman296]

You do understand that this is optional, right? Obviously you can still operate everything via the keyboard etc...

[@RunesLegacy]

It's meant to be immersive.

[@YellowKing1986]

You can do it all by yourself or tell the ai assistant. I think its a very good idea. You can tell computer do do something while your hands are busy.. Like "Give me more shields!" and the computer will reroute power etc. But it would have to have faster reaction times than this.

[@ErikLiberty]

​@@YellowKing1986OpenAI said a few days ago that they worked on making ChatGPT cheaper for developers and now that they have done that they will work on making it faster.

[@arkadiusz5913]

Don’t get me wrong, I’m happy if more people use that and wait for the AI to process their command for shield change as I fire away at them :) It’s cool for crusing peacefully around. For dogfighting or any combat scenario it is way too slow. Waaaaay too slow.

[@gamezillagaming5625]

this would take this game to a whole new level i think. AMAZING WORK!!!

[@alexanderhewett5328]

Bravo! That is incredible!

[@norsewrath8967]

Baffeling! This is a must have imo now that I know it exists 🤣 cant wait for the follow ups to this vid 🙌

[@Mootkins]

Instant sub. This is absolutely amazing!

[@TheDeleren]

Great idea. Really looks like fun!

[@GrimReaper_Ossi]

Cooles Video! Nice work, i really liked the trading assistence feature. Provided the AI could get real data from ingame from a scan, the exploration side of the game would benefit a lot.

[@razrburn]

This is amazing! There is so much possibility here.

[@Syphirioth]

Yes we need our a.i. gaming companions. Very important! XD So far Bard and GPT both agreed with me it was great idea according to them some weeks ago. It's nice to see someone doing something to get the hype started :)

[@BobWobbles]

Great work. Seriously impressive. I'm most interested to see how you got the trade info since we can't just data mine the game files anymore. Looking forward to the 'how it was done' videos.

[@bamtoday]

Fantastic! This is the most exciting add-on I've ever seen!

[@kaptnsternhagel8829]

Das ist ja mega! Da habt ihr was richtig cooles auf die Beine gestellt! ❤👍

[@HawkesGaming]

This is so beyond next level man!

[@crye2122]

I gotta have this. Flying across the Milky Way in Elite with no-one to talk to except my ships computer was some of the most fun I've had in a sim.

[@thodraalnight6974]

Das ist sehr nice! Voice Attack war ja schon cool, aber das hier ist der Hammer. Bin gespannt, wie ihr das gemacht habt.

[@hectatusbreakfastus6106]

This is so incredible! Great work!

[@Genny_Woo]

THANK you for this amazing app

[@hahn-solo]

This is soooo gooood! Can’t wait to find out how to do this myself

[@JaK_Winter2099]

Cool to see. The ATC part is pretty interesting I actually know of another group of people that use voice commands to simulate an AI on your ship. Look up voice attack. It's been used in star citizen and elite dangerous I think they have other games to

[@joker_g7337]

The station and trading controllers are a Must. Geniale Idee! I already have the copilot things with voice attack.

[@biotechisgodzilla]

Very cool! ❤ Maybe compare this to voice attack for a pro/con video? Aber auf jeden Fall Großartige Arbeit! Saucool!! Things id love cig improved after integrating it: 1. Control vehicles without being seated!!! (Not just emulating hotkeys) 2. Speed 3. Complexity (computer, fly us to ...)

[@MaskoDNK]

A Skyrim mod was made a few months ago, that added an AI companion which worked like this. It's truly incredible and completely changes your stance on immersion and NPC interactions. This is the future of gaming.

[@Fallub]

That is truly amazing. I really hope this inspires CIG. Thank you.

[@simonm7590]

Excellent and subbed for more. You know you can do all the work for this and sell it. People are largely lazy (including myself in that) or don’t have the skills and would pay for a solution rather than a guide! Just saying 😉 Top job and looking forward to using this, especially if it replaces Voice Attack (which I think is great) with more wide open commands to utilise.

[@franciscobeukes440]

Awesome Awesome Awesome - This is the missing link that will finally turn Star Citizen into a game. Love it.

[@blacklionapps7335]

Simply Fantastic!

[@Alex_A7]

Impressive. Now we need this for NPCs within the space stations & outposts :)

[@MrErick1160]

This is the most incredible thing I've ever seen

[@IonizedSun]

Wow echt gute Arbeit. Dafür, dass Du die Wandlung über die einzelnen Tools hast, ist der Delay echt kurz. Super Arbeit, Sub kriegt ihr.

[@stalkkermatty]

wow that is some amazing work would love to have this great work guys.

[@eckhardt1115]

Einfach Geil, freue mich auf mehr Content der mit AI zu tun hat.

[@martzooo]

well, this is the future of gaming. Incredible work. WOWZERS!

[@merclord]

The completely blew me away! Tony Z needs to get his hands on this to complete the economy AI

[@RobertTheCoder]

A well positioned dose of AI can make the game far more immersive than it is now. I would love to walk up to the bartender in Grim Hex and ask the bartender if he knows of any criminal jobs that don't show on the MobiGlas, or being able to ask the clerk at the gun shop where I can buy a sniper rifle (even if it is at a different shop).

[@castlewhale4746]

This is one of the coolest things I've ever seen and even still it's super basic and straightforward compared to what might be possible with AI in videogames 5-10 years from now. I now can't even imagine Star Citizen being considered finished (whenever that is) so long as it doesn't have this or similar features. It actually blew my mind when the trade office gave you a preferred trade route for the Taurus based on real external info (including estimated travel time and profit margin?!?!?!) but without having to even so much as open an external site yourself and tab bounce back and forth trying to obtain information that should just be available in the game. Fantastic API implementation, I really hope to see this get some form of official implementation from CIG so the metagame can evolve from "who is better at using external sites to get all their information" into "who is better at gaining information from the in game AI".

[@clintcollins8966]

Wow! Perfect! They need this in game now!

[@povracer8074]

Nice. That's pretty cool and seem's perfect for star citizen 👍

[@commander_haas1415]

Keeping an eye on this for sure.

[@NicoRobln]

U need to get hired as soon as possible!! Amazing work!

[@yashik]

it's so immersive and good it's quite scary, on one side I want to press the button to turn lights on but also I want to talk to Computer and give him command to do it... hehehe