AWESOME NEW Unity AI Tools!

[@ermilburn02]

Apparently one of those "Verified" AI solutions on the asset store is just using existing, mostly stolen 3D models. Kenney was talking about it over on Twitter.

[@MEATHEADBooYA]

Yeah, they dont care they just want money. There has been scams before where companies claimed their 3d assets are AI Generated but really it was just people making bad assets or just stealing the assets for a large fee.

[@ermilburn02]

@@MEATHEADBooYA Actually, Unity removed them from the Asset Store around 2 hours after I said this. Also, their package was free, like most of the Verified AI packages.

Regarding 9:46, when he answered: "Runa. It's our own dataset", I wonder if he misspelled the name of the guy who asked the question (Rune).

[@AthleticDesign]

He most certainly did, LOL!

[@markoterzic7115]

It would be interesting to compare Muse and ChatGPT answers to see how they differ

[@CESRex21]

Fr

[@4Core100]

@@CESRex21 no cap this is bussin

[@GameDevNerd]

Well, since Gpt4 got nerfed and is essentially the same as 3.5-turbo now (causing me to cancel my subscription to OpenAI), I can guess that its answers should be significantly better because it will probably just be a better fine tuned instance of Gpt4 for Unity.

[@danielrosenberg7174]

@@GameDevNerd where can i find info on nerf. i notised it less good 2.

[@theebulll]

AI is a great tool for outlining and prototyping, but it's a double-edge sword for new developers. You really need an understanding of Game Dev fundamentals to know what is usable information from the AI. It's very good at giving you answers that are technically correct, but you would never want to use them. It's the same reason you shouldn't use a calculator to learn math. You might get the answer but you'll never understand why or when to apply it.

[@foten3D]

Thanx

[@sreejithkakkat]

After 5 years, you just have to type the game idea in detail, then unity will create the game for you😂

[@kulwindersingh-gc4bh]

Not possible 😛

[@sreejithkakkat]

@@kulwindersingh-gc4bh let's see😂

[@sabiplaypuzzles7332]

Hmmm, so game developers become writers

[@BravoPhantom]

@@sabiplaypuzzles7332 You got it upside down... "So, the writers will become game developers"

[@sabiplaypuzzles7332]

@@BravoPhantom vice versa ♾🤓

[@paulbunyangonewild7596]

"House of commons, commons of house!" "Id fight and die for my country!" "That can be arranged" -spitting image

[@gabriale739]

I just hope it doesn't take them 2-3 years to release a 1.0.... I am quite hyped for the trained speaking model and very exceptical about the animations one... Personally I would have preferred a remodellation of actual animation screen with faster controls/shortcuts and the possibility of hotkeys assignment.

[@troyna77]

BUT the real important question is if we use these tools, is Unity gonna expect a bigger cut of the games profit ? Kindof like how some of the non unity assets on the asset store does.

[@PhoenixTheGame]

So in 9:56 , I think he meant to write Rune, which is the name of the person he is replying to

[@junaidywijaya]

When i saw Factorio montage or played the game, I always wanted to try to recreate them, the mechanics are fun and enjoyable

[@krishnansubramoni7801]

I am quite excited for the AI tools. It will be incredibly helpful for solo devs or small teams.

[@docblz]

Being an entirely solo dev is actually a viable option now. You can make a AAA level game by simply curating procedurally generated content. It’s both amazing and somewhat scary to imagine what can become of this.

[@tkg__]

@@docblz remember that Steam will not allow AI-generated content on its storefront.

[@Maxx__________]

@@tkg__ i'd be curious where and how they draw that line.

[@AlexanderCrumpler-bq4hx]

@@tkg__ doesn't that mean any game with any form of state machine isn't allowed?

[@docblz]

@@tkg__ it’s gotten so good, how can they even tell anymore? it’s like someone using an obscure 3d model pulled from a sample pack they don’t technically have the rights to. morally questionable, yet very hard to catch in practice

[@Arab_GameDev]

I have been waiting for your reaction on this topic

[@lizkimber]

Hats off you for not claiming chatgpt is the perfect coder. Cos I tried it for some simple things and the code it confidently gave me did not work nor even remotely do what it said. On correcting it. The new code didn't even compile. Personally i looked at the ai tools on the asset store and they all seem to be front ends to stuff you have to buy or sign up for. Which is not mentioned in the overview

[@juleswombat5309]

CoPilot is used to support coders, not replace them.

[@jamesderaja]

Can we use these tools any timeline for a public beta release?

[@remcee2]

Hi Code Monkey! Could you make a tutorial on how to make your Unity Graphics look good?

[@ererbe]

0:27 hundred of comments that ask this question including myself. (also i think the text part is morally okay, the art part is probably morally grey or worse... while i think it held potential to be useful the internet showed me that many many people (by far the most) abused this. and i think it really would be the better to have generative image generators banished from the internet for now.... which is impossible and wont happen)

[@IndieDevSam]

I might be odd for thinking this but I've never been afraid of AI, I look forward to all the ways it can be a useful tool. Thanks for the video!

[@baerthe]

I wonder why they didnt incorporate into the data from unity learn. it could let the text gen actually give you some idea or direction imo

[@Synith19]

Thanks for the recap. I like when you do these as sometimes I miss the official videos.

[@Caphalem]

Asset generation with AI sounds like a godsend for small teams and solos. However, you make a very good point in asking for the sources of the datasets.

[@GameDevNerd]

I don't think that's a good point at all, but a very dangerous one that hearkens back to the closed-source mentality of the 90s

[@Caphalem]

@@GameDevNerd Well, imagine you are an artist who makes music or graphic art for a living which has a certain style to it that's specific to your work. Now imagine spending years perfecting that style which is by now Really good. One day some company introduces an AI with a subscription model that generates art which is clearly generated by using your work as training without any notice made to you. Would that be fair to you?

[@GameDevNerd]

@Caphalem that's not how it works, nor would that harm me in any way. Everyone loves to imagine that their digital art or creation is super unique and special because they created it and it was hard. But honestly it's not, and people who don't pay for art don't pay for art _anyway_ ... stopping small indy devs from benefiting from the new, modern tooling is not earning ANY artist an extra sale in real life, only in an imaginary world where people shell out loads of money for art no one was buying. What's really happening is a group of digital content creators are entrenching themselves in a hopeless position instead of adapting to new, modern tools and workflows that are rapidly evolving, rather than embracing the "upgrades" it could make to their profession or hobby. And the ones who are going to get caught in the crossfire are all the small, indy game devs and film makers whose work will be banned and suppressed for the sake of this senseless morale crusade against new tech. Am I more worried about some backward-thinking 3D modeler getting their feathers ruffled because new tools are making hand-building models less relevant, or more worried about the dozens of little indy teams whose games might get banned or suppressed for the sake of this goofy controversy? Definitely the latter ... and the fact is, people don't pay for art they don't want to pay for, and tightening the noose on a bunch of teenagers trying to make their first game won't earn them a single additional sale of artwork no one was buying anyway. And in practically every case I've seen, digital art styles are not unique or concrete enough to assume someone "stole your style" -- that is human ego + fear of new tech deluding us into thinking it had to come from our "stolen special sauce", when in fact that artist doesn't even have enough art pieces to create a fraction of a training set. It just doesn't work that way in the real world. But I can tell you what the real world effects of this goofy controversy will be. Backward-thinking artists and creators aren't relevant now, and won't be relevant no matter how hard they stamp their feet and yell about it. The big companies creating these models will crush them in the battlefield of the courtroom, still end up getting their way anyways, and the ones who will suffer are small business owners like me, indy devs like many of the folks here and hobbyists who were just trying to have fun and build/share their own games and films.

[@GameDevNerd]

@@Caphalem hopefully that didn't sound harsh/mean, I'm really sick and taking a bunch of meds right now 🙃 😅

[@GameDevNerd]

@Caphalem I guess what it really boils down to is whether or not it is _unfair_ for either man or machine to learn to do something cool you knew how to do that was considered an "exclusive" skill ... and the answer is honestly _no_ it isn't. If that was the case, we could argue that every invention/tech ever should be dismantled/destroyed, no power tools, no farm equipment, no robotic assembly lines, all those things stepped on _someone's_ toes at some point ... but the world has to move forward.

[@Poliman-pl]

thanks for another great video, many thanks to you for asking questions that we all would and not telling the marketing bu....it

[@JordanGarland]

The teeth not moving on the AI alien model while it talks look so weird. It looks like they just took an image of teeth and put it in a highly detailed characters mouth?

[@SpcmnSpf22]

I believe Sylvio misspelled Rune's name when replying in the tweet. Probably because that's how his name is pronounced. Itis not the name of their dataset.

[@at930pmgames]

I would love to see npcs you can interact with and talk about anything related to that game universe. Imagine playing a game like the sims with that enabled. Or a survival game meeting other survivors, asking them which zombie they killed last and how they did it; or complain about the food and the npc responds to that: "I dont know what you talking about, the rat burguer is amazing"; for example :D. Immersive games are the future in my opinion.

[@hamzemohammadpour244]

Rune is that guys name 😅 he misspelled that !

[@322ss]

lol yes, was also going to point that out, Rune was one of those early Unity engine developers!

[@jumpkut]

Pretty sure the ‘Runa’ comment is just a misspelling of the original tweeters name, Rune 😂

[@avicxer]

I Love CodeMonkey ❤❤

[@Zippy_Zolton]

Muse looks cool, I might mess around with it after my vacation

[@yoav_tc]

Looks really cool

[@NestedMango]

These are awesome

[@ProfessionalJason]

I think of "talking to any NPC as long as you want" more like "using your social skills, charisma, and observations to persuade NPCs and change the course of the game in an entirely unique way." I get how this still wouldn't appeal to your tastes in games, but the possibilities could be endless. I also don't like talking to NPCs and yet I'm very excited about this.

[@zainch6489]

Lots of love for code 🐒❤

[@troyna77]

as an intermediate beginner, consulting chatgpt in the text based format is useful. I can take all the information and break it(my immediate project) down into a steps. Then use those steps to learn and understand the terminology better, So I can ask more precise questions about specific use-cases.

[@SciMajor1]

It's annoying that if one clicks on AI and views the tools, that they all come up as "free" yet, at least for the two that I checked, they are far from free. Inworld's solution, for example, is a minimum of $20 per month. Unity needs to crack down on these false "free" claims. I don't mind the fact that the devs want to be paid for their work but I do mind the deliberately misleading claim of "free".

[@RootGames]

Interesting stuff 🤔

[@theblackdragon7321]

This would help so much for some of us who are not artist, nor musicians and who cannot afford to pay someone to do the work. If I could afford someone over AI I would. I have a few friends I would commission in a heart beat, but yes 100% need to know if we can use the AI generated images or not

[@GoodNewsJim]

How do draw an owl? Draw two circles then the rest of the owl... LOL. It's like how I give directions. See this road? Go down it, and ask someone else down there.

[@SubjektDelta]

I myself also hate communicating with NPCs in games but thats because they can only say what someone made them to say and you will get the quest in your log afterwards anyway. But being able to interact with some NPC in a way like never before would be amazing for VR! Like being able to start dancing and the NPCs have different reactions based on their character like with Watch Dogs. Or just flip them off and getting them mad or whatever, would be amazing.

[@ardaaydin4771]

I do not understand why they did not add an AI to generate 3D models from prompts. It would be more attarctive if they would.

[@CodeMonkeyUnity]

Im guessing it's on the roadmap, but 3d AI is still pretty weak at the moment

[@EvansdiAl]

You appear in Unity's official video, did you see?

[@CodeMonkeyUnity]

Did I? Which one?

[@EvansdiAl]

@@CodeMonkeyUnity Is AI taking over game development? - samyam that's where i saw u!

[@ReckerEightySix]

What if you want create game with help of AI. But the Steam said: Sorry kid. We don't give permission release that your game with made from help of AI. Read the rules.

[@PhiLudo]

the voice of that alien dude sounds like ripped off disco elysiums narrator

[@LukiGames0]

I would love that animation tool. I suck at animating but it will be a great thing to create a rough sketch of an animation and then refine it in blender or other tool for animation.

[@TheArghnono]

Every Unity youtuber in this part of the galaxy has posted a video with the exact same thumbnail within the last few hours :-D

[@turksinnovations]

I can't wait for Muse to come out. It'll be a force multiplier for indie devs.

[@Maxx__________]

7:20 "Talking to random NPCs for hours on end" - I get that sentiment and I think the way you phrased it strikes at the heart of the issue, however I have to hard disagree that there isn't something potentially compelling here. Talking to random NPCs should never be the end goal, but consider how autonomous NPCs can be interwoven with more traditional NPC game logic. You can have characters with motivations that they're able to communicate, express and act on. We're probably a ways off from that and I agree that things like having to have small talk with shop owners before they'll get around to selling you stuff is just really bad UX.

[@luaykashef]

2060 in preview packages 2049499 release

[@artemrzhanov6315]

I cant wait for it, i think i will use sprites i think

[@PhantomKanal]

Wow...

[@theteleportingminecart351]

I am look forward to working with this unity based ai in the furture....! if all goes well

[@shadowspirit6459]

Please let me know where I can find dev-log or smthing like that about Dinky Guardians updates? I see there is a 0.113 update but can't understand what exactly was changed since 0.112

[@brummii]

Don't whitewash this new tool, apparently there is a lot of sketchyness going on under the hood, like stealing models off of sketchfab.

[@saul8510]

that another tool that unity falsely verifed, the good news is that it now deprecated thanks to the community.

[@jrrrohm]

I use it a lot with Rust but I need to fix and refactor most things it produces.

[@jeffg4686]

How far out until we're just the directors, telling it what to make and the adjustments? I think we're getting so close that I'm losing motivation on the core...

[@GameDevNerd]

Personally, I think it's wrong for everyone to draw this fake line in the sand about datasets and training. Prior to 2021/2022 we were all yelling about open source, freedom of information, liberate the web, open up the world, and now we suddenly want to Blackbox publicly available information ... nope, can't have it both ways. Either you support open and free tech or you don't. My stance never changed. Freedom for all. Do what you want. "Training AI" isn't some dark magical ritual, doesn't harm anything. If you post stuff on the web, humans and software can all read it and learn from it. That's just how the new world works. The sooner we come to terms with that and get over this old school blackbox mentality the better ... choose new hills to die upon, because this is the wrong one, folks ...

[@Bamboozled007]

AI is great but sadly it will come to the point - "If everyone is Super, no one will be." (Syndrome - The Incredibles)…..artists, developers, animators, musicians, writers etc. soon it will be - “we can do it to, if not better with AI”…..therefore the wow factor is put on technology and no longer on a persons unique skillset/talent anymore…we’ll all be super therefore no one will be.

[@Claritism]

I see no issue with that. That should be the end goal anyways.

[@BerixMaster2010]

The fact that they're extremely vague about how the datasets for how all of these tools is sourced is concerning, honestly. My own thoughts on generative AI aside, right now is an extremely uncertain time for generative AI in terms of ethics and especially legality. Considering the amount of time needed to train LLMs, and how EVERY tech company is rushing to jump on board this current hype train, I wouldn't be surprised if half of the tools they showed off were just tweaked versions of pre-existing tools like ChatGPT and MidJourney. Those two in particular have been under heavy vocal and legal pressure as of late, so that may be part of why Unity has been vague about their AI dataset's sources.

[@MEATHEADBooYA]

That's because they are just that, ChatGPT / OpenAI and MidJourney / Stable Diffusion.

[@saul8510]

​@@MEATHEADBooYAand? You think that midjourney abd stable diffusion uses 100% copyrright free assets? They know that telling about what the database came from is important for people, but they chose to say 0 because it would piss people and prob investors.

[@jaulloa21]

Hellloo and welllcum

[@themirlabs]

I would love that talk to any npc for ages thing in RPG games. so i could just learn more about the world and such

[@alec_almartson]

I'm very hyped about these A.I. Tools, because this means we as Developers are gaining more power to create 🎮🖼🎨 the Games of Our Dreams ☁️💭 (And as knowledge is Power, the more we know about writing Good Quality Code and creating Good Art is key to judge and correct ourselves the mistakes these A.I. Tools will make in the first years, while they are on Beta and Alpha stages).

[@Mel-mu8ox]

It worries me that they they avoid claiming there are no copywrite issues If people try it, they will be less incline to stop using it since they've already put a ton of work. If it turns out there is copywrite materiel, AI copywrite issues will be made worse. There could be a high price for using it in the long run. Either creative copywrite no longer stands. (games included) Or you have to stop selling the projects that used AI. really need a third option, or at least some assurances

[@jihadrouani5525]

All features are awesome, but first of all a minute of silence to Unity assets store publishers, you guys been great. And with that done some people are apparently allergic to AI to say the least xD, but for them they can't deny Unity Muse text, that one is trained on their own documentations and release notes, so no ethic issues there and can basically be thought of as a revamped search engine that gives answers more relatable to specific cases. Unless they enjoy the pain of skimming through hundreds of pages of docs and forums... The inference engine is seriously impressive, not the result so much but the fact it can run even on mobile (some may challenge this as flagship phones come with some super powerful Neural Engines, Apple's A17 can do something like 15 Trillion operations per second) tho only 30% of people have flagship phones so it'll be interesting to see the performance of the inference engine on low/mid devices... Interestingly, PC's don't have neural engines in their CPU's, AMD is just starting to do it on the laptop version, nothing from Intel so far, Apple pretty much did copy/paste of their NE to the M series of chips, GPU's can fill the gap but they're usually maxed out in games and having a dedicated Neural Engine is so much faster even against a GPU that isn't doing any 3D rendering per frame. It'll be interesting to see how they achieved it.

[@sabiplaypuzzles7332]

If no tensor cores are available, then compute shaders such as CUDA are probably used. For the web, WebGL does not support compute shaders. However, there is a new development called WebGPU that supports compute shaders.

[@jihadrouani5525]

@@sabiplaypuzzles7332 But that's the thing, every aspect of the GPU tend to be maxed out, tensor cores would be the fastest for inference, but they also run DLSS/FSR, so how do you balance between the inference engine performance and DLSS/FSR performance.

[@sabiplaypuzzles7332]

​ @jihadrouani5525 Who says the LLM calculations are so computationally intensive? Sure, learning the LLMs is extremely computationally intensive. But the baked values ​​do not seem to be as computationally intensive as, for example, visual calculations such as DLSS, FrameGeneration and Co. As I said, if Sentis also has to work on the web, then only the compute shaders can be accessed using WebGPU. Ergo, the calculation can either not be that computationally intensive, or the AI ​​will have to be restricted somehow and the NPCs will then act "stupid".

[@jihadrouani5525]

@@sabiplaypuzzles7332 For the WebGL part, those games aren't graphically intensive because of the size limitation, so typical CUDA cores won't be maxed out, no DLSS on WebGL either so Tensor cores are just sitting there doing nothing, WebGL tell us nothing about where the inference is running and how it performs. Even if it's running on CUDA in WebGL, you can't in PC's and consoles as they're the most maxed out types of cores in GPU's.

[@JohnnyThousand605]

Muse is interesting, but Sentis? meh

[@rambro5237]

this helps in rapid game dev without 2d or3r artist for inde game

[@sxsignal]

how to draw an owl..... bwahahahahaha

[@jjones1032]

I have to admit: I'm getting a bit of AI fatigue. It'll be nice when all the hype dies down.

[@matthewdilks2677]

It is a bit tiring that EVERYONE is doing it but hopefully it will be helpful once everyone calms down

[@davidvarga2916]

AI can draw can make music can make code. We can design and put em all together. What a wonderful life.

[@horngamez]

Third

[@Notllamalord]

Being able to spitball and problem solve with an Ai is a really cool idea. An animation/3d model generator would be insane, I love coding but finding art really sucks

[@dago6410]

The only problem is now whenwvwr i sear h for videos om AI (as in how to make the enemy logic in a game) youtube instead shoves all this autoregressive language model crap down my throat. No, thank you, never said im interested in language models, please give me AI instead, thank you.

[@CodeMonkeyUnity]

heh yeah that is indeed an issue, I guess now you have to be more specific, so you have to search specifically for things like State Machine AI, Platformer jump AI, etc

[@dago6410]

@@CodeMonkeyUnity what wpuld you sugest (as in what to search for, or specific answer, or specific video?) For Ai for a game where ai is not controlling just ome guy, but a whole army or whole faction, like in chess or an rts or something like civilization/EU/hoi (not that scale but you get the idea)

[@CodeMonkeyUnity]

I don't think there's a specific name for that, it's a very niche topic so that is indeed hard to find. Perhaps there are some RTS AI tutorials that cover that, although I assume more are focused on the AI of each unit rather than the commander AI. For that topic you're probably only going to find it covered in some complete courses on making RTS/4X games

[@gabaghoul23]

imagine this in Skyrim

[@incrypted607]

The copyright argument that I tend to see is so odd to me. It is like arguing that you can't sell a painting you make after looking at a different artist's painting because seeing the painting influenced the result you produced. It doesn't make sense for people, and it doesn't make sense for other thinking machines like artificial neural networks.

[@saul8510]

and it make sense selling the painting and making it your private propierty , expressing that you can get it for free? it the same with textures .

[@incrypted607]

@@saul8510 Do you mean to say that I'm wrong because you have to buy a painting to own it? If so that is still not a rebuttal of what I'm saying. You can go to the art museum and then paint an original work and sell it without having to credit anything you saw at the museum. Same with authors. They are not, and should not, be expected to credit all the books they read for free at the public library. Also sorry if I misunderstood the point you were making.

[@juleswombat5309]

Unity making lots of announcements, but with no delivery. Pretty typical of them to create confusion and chaos. .

[@mccleod6235]

This time last year it would have been unthinkable to talk, in plain English, to a machine and get source code back. Let alone to be able to continue the discussion fluently. Now it is "not particularly impressive". How quickly we become accustomed to new technology.

[@krisztiankeresztei5500]

I think, The AI in the beginning would be a big help, but in a 8-10 years AI will be cabebol to make a AAA game alone! Maybe we need AI to get faster, But AI not need us to make a game in 10 years...

[@dotRianne]

Some jobs AI cannot do. It will never replace designers for instance. As a developer myself though, I'm not so sure .

[@krisztiankeresztei5500]

@@dotRianne I hope you're right, but don't forget AI learning much faster and this is just a beginning.

[@saul8510]

You are a good dreamer kris, i was like that honestly , but i doubt you will be able to make a AAA game ALONE in the future with AI, it just a simple tool, also what your experience with game development?

[@krisztiankeresztei5500]

@@saul8510 Well my experience with game development is its cost much time, it heavy to do, if you have a full time job. I know AI make the work faster, but with time it will be dangerous. Amazing what new tools we have now, and this is a only a start. It's, just a strange bad feeling that AI will create, not just games or programs, also images, voices...Now is good, it's a revolution. We can profit from it, but what is the price?

[@hamzahgamedev]

As a solo game dev, working on an open world farming game.. I couldn’t be more happier ❤ thanks Unity 🫶