This would be a great achievement if it was made 10 years ago. Now this is a tech demo any game dev student could put together in a few weeks using the tools available.

OK, cool, but it is running an LLM. So, after we buy this, how much per month are we going to have to pay for tokens? Are we responsible for sourcing our own? Can we locally host our own with something like Kobold? You guys need to be very upfront about this as most of your audience probably isnt familiar with the ins and outs of this tech.

Combine this with rimworld

The character behavior (like how they walk to place to do task) kinda reminds me of messing around with goap AI systems. Like are they using an llm to run something like a goal oriented action planner that defines the available actions and what steps are needed to do them? I'm guessing the longer presentation might go into this sorta stuff...

I still think a Skyrim mod was a better starting point for this tech than Sims. The "AI Director" sounds very intriguing though. If it is what I think it is (an AI game master) and it is able to enforce the game rules written in natural language, it would be huge!

Wow, this really answers a lot of the questions I had about this game. I think that multi-modality and more emergent interactions with the world will be the key for making this game what it deserves to be. As Marek Rosa said, Space Engineers(and other games like Minecraft) are very spatial and physical games, and I don't think LLMs are the tool to solve NPCs interactions with such a world: The problem I see is that a good multi-modal model is hard to train, both because you need LOTS of compute, and because the training data is more problematic: less data available, more "noise" in the data, less synthetically producible. I've recently skimmed a paper about unsupervised learning games from (KZbin) gameplay videos and I don't think we're there yet, however a hybrid approach(e.g. machine vision for navigation/orientation/physics coupled "manually"(translate world state to text) to a LLM for planning could work, as these technologies already independently work(e.g. describing images textually, geometry/depth from images, prediction of future states based on "physics", etc. all have been done before). Can't wait to see where this will take us in a couple of weeks, months, years!

So this is where all the people who scammed NFTs in games went after that grift went bust.

Good stuff!

It would be amazing if you would be able to get that new text to speech voice that also has emotion in its voice and sounds much much more human. Of course this is still in alpha. But that would make a huge difference in immersion i think. Otherwise looks very promising and i am interested to see what kind of world they would live in and what items they have access to. I hope it is more than just a small plot of farm land. I wish you all the best on this project!

I think I once saw a video about something similar, and have always wondered why this didn't exist as an actual game/sandbox yet. Very interesting, although I would have loved to see a more complicated world(like a voxel world) and more complicated interactions with that world(e.g. complicated world changes without explicitly informing the characters, so they have to "figure out" some of the emergent properties of this more complicated world, and require long-term learning. Seeing as this is from the makers of Space Engineers(one of my favorite games!) I have high hopes! In the long term I think a lot of games can be made way more alive by even simple AI agents, but games like Space Engineers or Minecraft could be taken to a whole different level(Think of your in-game AI friend who can play 24/7, using the machines you created for them)! I'd really love to see how AI agents would interact with very large and complicated worlds, but I get that that is probably very difficult.

<3

Very interesting. At last a game with AI elements! Keep on the good job.

Can you tell me how to authenticate gmail to send mails.

Can you tell me how to give authentication of gmail to send mails

So clang got an email now huh ?

The other videos are great but this one is weird. Only point it makes is that you don't have image generation. I tried the same image and prompts and it used the analysis for me and made it grayscale using python. "make it" could be pointing GPT4 more to creating it in black and white instead of editing it.

Very impressive, especially for an early prototype!

Okay so its late at night but I'm almost positive I heard that voice get a bit annoyed when you reminded it about the pond. Anyway what is the story with the latency? Its horrendous, we won't be using LLM's for flying races any day soon!

Human intelligence is on decline. it is heartbreaking to see so few views and comments. if it is stupidity o other bullshit so many people view it. is future of evolution decline of intelligence

I was just researching to work on the same thing 😂 good work!

Super~ really amazing ! 🙂

8 years later, & 1 more to go

I was really hoping it would say what the fuck why didn’t it work

Finally, someone with vision. The human brain isn’t one homogenous blob, so why would any decent AI be?

Hidden gem

Very cool!

I must needs listen again to this dialogue. Towards the end Bach's rationalization about our evolution seems particularly Germanic in nature rather than true genetic function and flow.

Nice.

This is crazy cool

very curious about this

This was fantastic. I watch a lot of Levin's videos but this is among his best. This vid might seem a little "out there" for the unfamiliar. For beginners, watch his TED talk (was done zoom style). Then watch one of Levin's own presentations with his slides. The sections on tadpoles and planarian worms are fascinating. Then try this video you are on now. This video was a superb balance of reviewing laboratory developments and frontier insight and implications.

2

Very interesting - have you published any literature around this work?

Use Elevenlab's voice generative AI to fully integrate voice acting into generated text.

Did that NPC just walk up and PUNCH the woman he was interested in?

Time to try new walkers

That's amazing! Are the blocks at the end of the legs new block (non vanilla)? Do they sense the ground?

paper?