The PROBLEMS With Unity's NEW AI -- Muse & Sentis Announcement

Today Unity have announced two new AI products: Unity Muse, an expansive platform for AI-driven assistance during creation, and Unity Sentis, which allows you to embed neural networks in your builds to enable previously unimaginable real-time experiences.
Whether you’re just getting started or already a Unity expert, Muse and Sentis are here to help you open up new avenues of creativity and innovation. We’re committed to working closely with you to explore, validate, and define our AI offerings, which is why both will be available via closed beta at this time. Your feedback is vital for this work and will be actively solicited, considered, and integrated throughout the process.
What do you think about them?
➡️Unity AI Landing Page: unity.com/ai
➡️UI Introduction to AI: blog.unity.com/engine-platfor...
🎁 Get OVER 190+ Scripts, Projects and premium content on my PATREON HERE:
➡️bit.ly/SpeedTutorPatreon
·························································································
🔥 INSANE UNITY SAVINGS: bit.ly/UnitySalesHub
🕹️Unity Sales: bit.ly/UnitySalesHub
🕹️SpeedTutor Unity Store: bit.ly/STUnityStorePuzzlePacks
🕹️Quick-Start Bundle: bit.ly/UnityQuickStartBundle
🕹️Weekly Publisher Sale (+FREE Asset): bit.ly/WeeklyPublisherSale
🕹️Unity New Release Discount Sale: prf.hn/l/BdvEmg3
🔥 INSANE HUMBLE SAVINGS: bit.ly/HumbleBundleDeals
🕹️Unity Hidden Gems Bundle: bit.ly/UnityHiddenGemsBundle
🕹️Summer VR Bundle: bit.ly/SummerVRBundle
🕹️Low Poly Polygon Assets Bundle: bit.ly/5500PolygonAssetsBundle
🕹️Complete Guide to AI & ChatGPT: bit.ly/ChatGPTAIBundle
🔥Unity Materials / Files & More:
🕹️Synty Assets: bit.ly/SyntyLowPolyAssets
🕹️CGAxis PBR Deals: bit.ly/CGAxisPBRDeals
🔥 UNITY SUBSCRIPTIONS:
🕹️Unity Plus: bit.ly/UnityPlusDeals
🕹️Unity Pro: bit.ly/UnityProDeals
·························································································
💰BIG DISCOUNTS on my website, for my UNITY ASSETS:
➡️www.speed-tutor.com
💬Join the Community Discord:
➡️ / discord
💝 Make a donation to the channel:
➡️www.paypal.me/speedtutor
·························································································
⬇️ SpeedTutor Puzzle Assets:
🧩Unity Store: bit.ly/STUnityStorePuzzlePacks
🧩My Website Discounts: www.speed-tutor.com/
⬇️ SpeedTutor Best Selling Assets:
🧩Adventure Puzzle Kit: bit.ly/STAdventurePuzzleKit
🧩 Note & Letter System: bit.ly/STNoteLetterSystem
🧩Examine System: bit.ly/STExamineSystem
🧩Keypad System: bit.ly/STKeypadSystem
⬇️SpeedTutor Model Packs:
🧩Unity Store: bit.ly/STUnityStoreModelPacks
🧩My Website Discounts: www.speed-tutor.com/
My Assets include: Gas Mask, Flashlight, Generator, Themed Key , Padlock, Phone, Chess Puzzle, Lever, Valve Puzzle, Fuse Box & Safe Systems. Cardboard, Debris, Massive Models and more!
························································································
⭐ Connect with me:
💬| Discord: / discord
🐦| Twitter: / speedtutor
📱 | Facebook: / speedtutoruk
🖥 | Website: www.speed-tutor.com
·······················································································
#SpeedTutor #Unity #UnityAI

[@SpeedTutor]

Is it something you think that you'll end up using? You're looking forward to it? Let me know! :) 🔥Unity Sales: bit.ly/UnitySalesHub 🔥SpeedTutor Unity Store: bit.ly/STUnityStorePuzzlePacks 🔥HUMBLE SAVINGS: bit.ly/5500PolygonAssetsBundle

[@batwimp]

I love how they have "Do a backflip" as one of their examples, and what the character does isn't a backflip.

[@SpeedTutor]

Would have been better if it was a barrel roll? :P

[@batwimp]

I use ChatGPT every day to help with Unity development, as well as Stable Diffusion and Dall-E for image creation. CGPT is a good helper tool, but it sometimes writes bad code. The more lines of code you need, the more likely it is to be bad. I've had it write some really useful editor tools, and simple code that I just didn't feel like writing. It can't take the place of a programmer yet, but it sure is handy when you don't want to write a bunch of boring stuff, or you're not quite sure how to do something and you have it write some code for you so you can see how a certain thing works in Unity. I hope I can always use A.I. to help me with code and images, because it really takes the sting out of a lot of things.

[@SpeedTutor]

You're exactly right, that's exactly how I do it. It takes a good level of understanding of Unity and C# to truly leverage it to be useful. I like to use it to break down my idea into small chunks, work on mini features and tasks. Then once it's done, we can progress onto another simple feature. If you tip-toe through the generation process, I think you could out with something reasonably optimised. Especially since you can ask ChatGPT for optimisation tips as you go along.

[@12feetup]

I hope you don't plan to publish on Steam. They're currently rejecting games that use that sort of image generation.

[@batwimp]

@@12feetup I'm not using any of those images in production yet. But I'm curios how they would even be able to tell.

[@12feetup]

@batwimp There are AI tools that can be used to identify AI-generated images with reasonable accuracy. But I'm not going to pretend I know exactly what Steam's process is. I only know that some devs have recently had their games rejected for this reason. Steam has offered those devs one chance to remove that content from the game and resubmit. If the game doesn't pass the second time, it's disqualified from being submitted a third time. I don't presume to tell other devs what to do... just passing along a heads up.

[@batwimp]

@@12feetup I appreciate the heads-up. That should change the way I do some of my upcoming games in the future. Luckily my first game on Steam has asset-store-bought graphics. For my upcoming 2D game, my workflow shouldn't violate any copyrights, so it's too bad if it gets flagged by steam. Basically, I'm taking asset-store-bought 3D models (those which I would technically have permission to use) and posing them just-so (for instance, I have a meadow asset that I bought some time ago), then I would take a snapshot of that meadow and bring it into Stable Diffusion as an image-to-image. Then I just type "Pencil drawing of a meadow" and it gives me back essentially the same graphic, but as a pencil drawing. So technically it would just be a pencil drawing of a graphic I already have permission to use. Oh well. i don't want to poke the bear. I'll just stick to using graphics as I have purchased them.

[@devm585]

I really was waiting for this tool, really, this is a huge huge huge news, and can't be abandoned, in a moment where AI is pratically being adapted in many things. So I just want use it and make so many things that now are ideas

[@SpeedTutor]

Lets hope some great things come out from it! What do you plan to use it for?

[@brmawe]

Has anyone signed up for the closed beta? I'm wondering what it's like.

[@sabiplaypuzzles7332]

NDA ☝

[@SpeedTutor]

Not any information on it yet, I hope to get to use it at some point! :)

[@JoSke633]

So, to summarize.. these are the problems with your prediction of what the tools are going to look like? The title of the video is misleading..

[@theoriginalmakaaka101]

I have a unique brain in that since I was a child, I have a memory span of about 20 seconds before I forget what I was doing. As a result, having the AI there when I forget how to do something, helps me out. I can program better than Muse, I can draw better than muse, I can design games better than Muse, but due to my brain, I am very unproductive as I easily flow into tangents. It's similar to ADHD and I do use the classification of ADHD but it seems to be a unique condition, I just forget what I was focusing on, but I have a near-photographic memory once I remember what I was focusing on.

[@luaykashef]

2060 in preview packages 284939 release

[@SpeedTutor]

I see what you did there and I LIKE IT!

[@danillomdg]

I don't think its a positive step in the right direction if in the training of these models it uses datasets containing scraped work of artists, animators, designers, etc., without any form of consent and compensation. Unity is currently very reluctant to disclose the datasets and this is a very bad sign. I'm currently developing a indie game in Unity and seriously considering moving all to Godot. You are right saying that it would be good to help with the tedious work, but it also seems this generative ai "tools" are always trying to automate away the good parts of the creative process. Finally, I don't think we should use our personal limitations as artists and developers as an excuse to ignore the real harms these tools are doing to creatives (I'm seeing this excuse being made many times on the internet). But anyway, this is just my opinion. Thank you very much for the video, keep up with the great tutorials.

[@SpeedTutor]

You're very welcome, my friend and you're absolutely entitled to your opinions surrounding it because it's a very vague topic. As I mentioned in the video, it's whether we do see restrictions on it's usage in the future as it becomes more of a main stay. I think for me it helps get past roadblocks that would usually take hours. You could say that you learn more from searching for hours but often you don't easily find a solution at all. Then again, even if you go along to Godot, who's to say where the content will be pulled from?

[@danillomdg]

@@SpeedTutor Thanks for your response. Yeah, I can't deny it could absolutely help with roadblocks. I'm just concerned abouth the ethical problems that these technologies are presenting in their current iteration, and would personaly like to stay away from them even if this hurts my productivity and not support products that push them too hard. That's where it comes my recent consideration about Godot, but they could also do this in the future so you never know 😂 And you're right, we don't know where the content will be pulled from, and that's why I think wee need at least some form of regulation in this field and transparency from the companies.

[@SpeedTutor]

I think you're right. I'm very hopeful that Unity will address the concerns of everyone in terms of where it's getting the dataset from. If it's pulling from their official content, documentation and the like. That's fair enough but it will have to have a deeper understanding than just the documentation. Don't you worry, we'll be slave to the machines soon! :P

[@danillomdg]

​@@SpeedTutor Oh yeah I forgot, our Overlords are coming anyway, why bother? hahahaha

[@SpeedTutor]

We're already slaves in a giant machine called life, anyway so what does another Overlord matter? Haha. Good luck with everything you're working on though! :D

[@BadBanana]

This topic almost needs me to make a video reply to you. There's far too much to talk about with regards to almost every point you made Copyright Texture mapping Size control Model animation Code generation The list is non exhaustive As a solo developer My most painful gripe is definately art, When code is regarded I feel competent to create out almost any system you can name given the right amount of time, and resources But art wise I suck I'm no artist with regards to modelling and texturing so an ai interface I can prompt that will generate texture maps and models allowing me to choose from a game ready set to place and I'm golden As a solo dev that's the AI dream come true But it simply doesn't exist yet It's been tried and tried but hasn't come full circle with something I would call acceptable as yet. I look to the future for this feature within unity It will give younger developers an edge too since they're less experienced and have less time in already then can focus on less intensive sides of development to perfect their craft Pertaining to artist I suppose you can call code art, as well as map building, I do get rather particular with it as a rule. Yes a video would have been better set out than an essay for you. What we hope to create with our project MiMeta is definitely needing an ai generative baseline but I genuinely beleive we will probably leave it to voice and text based information rather than runtime model generation. I'll let users create models with a system as opposed to a Web interface with ai. I think it will feel more personal and generate value in each node rather than let an ai make tens of thousands of iterations, we also intend to let users sell each other their creations so again Allowing an ai to generate them would likely harm the value taken from each piece. Hit me up if you want more info man I'm in your discord under Bad_Banana_Dev as well as here 😊

[@SpeedTutor]

How do you see the ability to get it's original information? Would you have to opt in for AI to use already created content and learn from it or do you think companies should be specifically creating the content themselves for the AI to learn? Similar to how Unity want it to learn from the documentation and offer resources that way? :)

[@BadBanana]

@SpeedTutor I definitely see Ai as something that shouldn't be universal. It never seems to work out that well, Look at Google search engine nowadays. Yes I certainly think AI integration to our project as well as anyone else closely resembling it should be personalised and built in house. Even with a simple taskset they can be defined properly to pertain precisely to what your expecting them to do. (We mean pattern recognition generative learning machines) Definitely need to be specified to their direct workload as opposed to trying to make sentience Yes

[@themaskyyt]

It kinda scares me to think what the future is going to be, now with this A.I. stuff. Probably, at some point, your average amateur developer would be able to make an entire game...with just some prompts. And possibly make millions with the end result. What's the point of learning to do stuff anymore? Why should I continue learning if, in the future, a machine will be handling all of the technical stuff for me, ? For fun, I guess? What a time to be alive...

[@SpeedTutor]

That's because we might all be dead before that point happens, so you should continue to strive for what you enjoy no matter what the eventual outcomes. You could have said the same thing about jobs in regards to manual processing in the past. Machines came along in terms of computers or manufacturing processes. It's the sad progression of Human life, we always innovate and someone has to lose out. You just continue to strive to be the best you can each day, do something you love and you'll be able to lend that into far more than just game development! :)

[@camy_dev]

this looks really cool hopefully they stick with it, it will be rough for years but I can see a future where people open Unity and make a full game only with prompts. I have been experimenting with a few lighter weight LLM models that can run locally and am investigating training/finetuning one for a game, it could be trained on data about a fictional character and blacksmithing for example and play a character with dynamic dialogue. It also wouldn't preclude us from having handcrafted dialogue in certain situations for quest etc. Really exciting stuff.

[@SpeedTutor]

Oh that's amazing to hear, how did you get into something like that and what made you decide to do it? In this case you mention, how do you give it boundaries on what it can and cannot say? Is it pre-generated in terms of dialogue that you already know rather than anything realtime? I think we'll always have a need for very bespoke content because the problem arises when you see 920000000 AI created games hit Steam / Google Play / Apple store and the market get absolutely annihilated. I think it will always be average content because the AI learns from the majority of average content, so bespoke things will always rise to the top. Just those won't happen as often. Who knows. :)

[@camy_dev]

@@SpeedTutor its a model for gpt4all, ggml-gpt4all-j-v1.3-groovy.bin. I believe it based on gpt3 and thus won't say mean things unless you really get creative and ask it to roleplay or something lol. I have yet to finetune or train it yet (following tutorials and researching) its hard on your gpu to train and can take hours apparently. they have bindings for java, python, C# etc. so far i have made a java app and a website where you can chat with it, yt wont let be put the link it deletes my reply lol. GPT has been in my periphery for years as a cool thing and the recent AI mania has prompted me to dive in farther. it would be cool to be one of the first game to incorporate it. yeah there probably will be some trash made with it but as boring as many games dialogue is this could be a step up lol. Anyway hope I answered you questions.

[@SpeedTutor]

You're very right in that matter, you will see more and more bloatware but again these marketplaces already get hammered with poor content. You give the same people tools to make this stuff even faster, better than they could before and it's going to get messy. Haha. You're right though, it does require engaging experiences, marketing and the like.

[@SpeedTutor]

That's really interesting, haha! Thanks for the explanation, my man. I wish I was smart enough for crazy things like this. Don't you worry, I'm still rolling a ball in Unity. Having my fun. :P I wish you the best with it and I'd love for you to keep me updated when you have something new. Make sure to keep me updated on Discord or something. Great to hear from you. :)

[@camy_dev]

@@SpeedTutor hey thanks, its really me just flailing around till i get something working like always, i've been a Unity dev since like 2010 and am always trying to incorporate the newest stuff for fun like jobs, burst, ecs etc. this year I started a certification course in programming so i went down some web dev/java app rabbit holes. Yeah totally keep you updated, ill train a model get it running or referenced somehow in game and share it on my yt and the discord. Great content, great channel speed. Also must say you taught me a lot of my first concepts and scripts in Unity, I have followed so many of your tutorials to learn lol ty.

[@krisztiankeresztei5500]

I think, the AI in the beginning would be a big help, but in a 8-10 years AI will be cabebol to make a AAA game alone! Maybe we need AI to get faster, But AI not need us to make a game in 10 years...

[@SpeedTutor]

You might be right in that sense, do you think you'd lose the love for making games if that happened?

[@krisztiankeresztei5500]

@@SpeedTutor No i'm not losing, but i lose the chance to Live from the " work " what i love. Or i lose the chance to get a better car from my "work", or pay a week end trip with my Girlfriend, or yust buy a few beer... But the worst is i lose the chance to get atention, lose the chance to thel a story... I can tell it, but nobody lisen it. Because AI will make hundreds a stories in hour or lather minits. Have sens to tell a story if nobody listening?

[@franklinbishop7161]

"promo sm" 😪

[@gasparayakos8215]

So how are AI systems not under massive lawsuits? In order to "train" it, it needs to scour the internet for everything. This isn't a person we're talking about, it's a machine that basically mixes and matches the ungodly amount of stuff it's seen and gives you an "original" interpretation of it. Legality wise, it's a grey area. AI systems are products, not sentient beings. If I had the resources and the lawyers I'd sue for sure.

[@SpeedTutor]

I think the issue is the fact that these are very new ideas and in some cases it might be impossible to know where it drew reference from. Where do we draw the line between an artist finding other artists work online and copying a style? Then AI that does the same? As for the Unity's Muse chat, it's said to learn from the official documentation, videos and content.

[@supercyclone8342]

I still don't know how to feel about it. A highly effective and acceptable way to learn stuff as a human is to scour for whatever examples we can find and copy them until we are able to make original work, but when an AI does it, it's a problem... I know it's not that simple, but I find it very difficult to come up with a solid counterargument, tho I haven't done much research