Unity ML-Agents 1.0 - Training your first A.I

  Рет қаралды 115,838

Sebastian Schuchmann

Sebastian Schuchmann

Күн бұрын

Пікірлер: 225
@SebastianSchuchmannAI
@SebastianSchuchmannAI 4 жыл бұрын
Hello everybody! I have created a Discord Channel for everybody wanting to learn ML-Agents. It's a place where we can help each other out, ask questions, share ideas, and so on. You can join here: discord.gg/wDPWsQT
@soareverix
@soareverix 4 жыл бұрын
Does the server still exist?
@mithunmmurthy1473
@mithunmmurthy1473 4 жыл бұрын
@@soareverix yup
@strofll
@strofll 3 жыл бұрын
Can you pay attention to dc server that you are streaming because there is no admin and no order as well it creates complicated situations.
@immanuelwallace7095
@immanuelwallace7095 3 жыл бұрын
instablaster
@lucutes2936
@lucutes2936 4 ай бұрын
@@soareverix maybe
@youtuber9991
@youtuber9991 2 жыл бұрын
Great intro video! I'd love to see: 1) How to setup for agents/players with multiple states (switching from stealing to attacking to shooting, etc.) 2) How to have agents/players on the same team and performing the same goals together 3) How to apply these different states to AI agents in gameplay
@SebastianSchuchmannAI
@SebastianSchuchmannAI 4 жыл бұрын
Note for everybody watching: Two days ago ML-Agents Release 2 was released. Don't worry, the latest release just contained bug fixes, meaning you can still follow the tutorial without doing anything differently. The naming may be a bit confusing because Release 2 sounds like a big thing but it isn't, they just changed their naming scheme. I would always recommend using the latest release version! Enjoy! :)
@Daniel_WR_Hart
@Daniel_WR_Hart 3 жыл бұрын
Oh man, Release 2 was a year ago, but it's still the latest verified version that can be downloaded from the package manger
@bazzel1059
@bazzel1059 Жыл бұрын
Were there any further releases? Some may consider it cringe, but I'm asking ChatGPT to clarify certain methods that I can't understand from the documentation and it told me that the newest version of ML Agents takes ActionBuffers parameters, instead of float [ ] parameters. This could obviously just be ChatGPT being wrong, but this video and the tutorial I am following are 2 years old after all.
@UN0sebastian
@UN0sebastian 4 жыл бұрын
Thank you for the video, it is awesome! :) I loved the effort you placed in attaching memorable graphics to explaining the vocabulary and fields used
@djsmellhodet
@djsmellhodet 3 жыл бұрын
You are the only one really explaining ml agents, thanks a lot my game needed you ;)
@trungkiennguyen6955
@trungkiennguyen6955 4 жыл бұрын
Your video is amazing, that really just saved me 170 years of learning bro. Great work!!
@KishorDeshmukh
@KishorDeshmukh 4 жыл бұрын
Same here, really can't wait for more!! You are amazing! Your videos are amazing!👏
@AntonKozikowski
@AntonKozikowski 3 жыл бұрын
keep it up Sebastian! this is the next chapter my friend! cheers from New Mexico!
@JS-ir7wh
@JS-ir7wh 4 жыл бұрын
This video was a good start for me. I got the demos working... Now the hard/fun part. Thank you.
@secCheGuevara
@secCheGuevara 3 жыл бұрын
I can only reiterate the same feeling as everyone else here aroud! Thank you so much for those videos! They're great and so are you!
@pastuh
@pastuh Жыл бұрын
When we can expect updated tutorial? :)
@viveknegi4243
@viveknegi4243 4 жыл бұрын
The video was amazingly well done! To anyone following this on a windows 10 machine. Make sure you have python 64-bit installed and not 32. And the command that works for me is this: "python ml-agents/mlagents/trainers/learn.py --run-id=MyFirstAI". You first need to cd into the ml-agents repo just like the video says and then type in this command to start training. If you still get issues, you can use Anaconda to create a virtual env but Unity themselves removed that dependency.
@Cazametroides
@Cazametroides 4 жыл бұрын
Still not working for me, I get no message, I'm simply prompted to enter another command. I'm using the ml-agents0-release_6, do you think that's the issue?
@paperlessmove
@paperlessmove 2 жыл бұрын
Nice explanation! Thanks 🙌
@adeelfarzandali
@adeelfarzandali 4 жыл бұрын
I have never seen such in depth explanation anywhere. Great.
@yanndetaf5725
@yanndetaf5725 4 жыл бұрын
You are really amazing.... That was a friendly introduction to unity ml-agent. You explain things in a very simple way. That makes it easy to understand clearly the concept behind ml agent. Great work guy
@pushkar260
@pushkar260 4 жыл бұрын
Assing rewards @3:06 nice.
@ReinkeDK
@ReinkeDK 4 жыл бұрын
Hi Sebastian Really cool video, just started to play with ML-Agents myself and have trained all of the example ones. But never dig into how it work, but your video explained it nicely. You have gotten 1 new subscriber :)
@crassflam8830
@crassflam8830 4 жыл бұрын
Hi Sebastian! Just wanted to share a very slight correction regarding stacked observations: You sated that the stacked observation setting determines how many vector observations are gathered before sending them off to the agent; this is close but slightly inaccurate. It will still gather a new vector observation every time a decision is requested, and it will simply add the new vector to the running "stacked" history, while bumping the oldest observation out of the stacked vector array. For example, if you have stacked observations set to two and you are sending only a velocity reading to the agent, on the first decision the stacked vector might be (.567, 0f), on the second decision, the stacked observation might be (0.897f, 0.567f), the third could be (0.924f, 0.897f), and so on...
@SebastianSchuchmannAI
@SebastianSchuchmannAI 4 жыл бұрын
Hey! Thanks for the correction, I wish I could change the Video 😄
@crassflam8830
@crassflam8830 4 жыл бұрын
@@SebastianSchuchmannAI It's a really well made video lol
@crassflam8830
@crassflam8830 4 жыл бұрын
@@SebastianSchuchmannAI I think there may be some ways to do live editing or re-uploading. (people often need to change videos to make corrections or remove copyrighted content). Def look into it when you get a chance! (there's also the popup box option). Not a really big deal though; that one error is the only imperfection in an otherwise perfect video!
@DeJMan
@DeJMan 4 жыл бұрын
Does this mean if I only pass in positions then velocity won't be calculated?
@LibertarianGearhead
@LibertarianGearhead 4 жыл бұрын
Hey, Great tutorial! I'm still new to both Unity and ML Agents, but just finished training my first agents on the 3D ball game. Just want to point out, at the time of watching the video, the ML Agents repository was on release 12 and I had an extra problem in addition to the "trainer_config" problem (thanks DeJMan). I'll do my best to describe it below: I was getting 254 errors - most of them were "CS0234" - essentially the C# script couldn't recognize any of the ML Agents related stuff (I think - still new so not 100% sure). The solution that worked for me was to go to Package Manager, click on the + in the top left corner, and select "Add Package from disk", then go to the ML Agents downloaded repository downloaded from the github link in the description, then to the folder "com.unity.ml-agents", and add the file "package.json". Then, do the above again but for the folder "com.unity.ml-agents.extensions" - again the "package.json" file. This solved it for me. Hope it helps someone else.
@pixelpowergo1607
@pixelpowergo1607 4 жыл бұрын
You are an absolute legend! how did you figure that out? it cured that problem I was having. Hopefully this comment I'm writing boosts this comment up in the list so more people can see it. Thank You!
@LibertarianGearhead
@LibertarianGearhead 4 жыл бұрын
@@pixelpowergo1607 Thanks! Glad it helped someone :)
@jorgebarroso2496
@jorgebarroso2496 4 жыл бұрын
For everyone having problems importing ml agents folder into the unity project: 1. If you get errors like: "The type or namespace "mlagents" could not be found": reimport the mlagents package or import it if you hadnt already done it. 2. If you get errors like: "The type or namespace "mlagents.actuators" could not be found", after already having imported Ml Agents package through the package manager: try importing it manually from the github cloned folder (machine learning release 8) /com.unity.mllagents/package.json
@lpthurler
@lpthurler 4 жыл бұрын
Jorge Barroso, i solved the second problem just importing the ml agents 1.5.0 - preview version.
@jorgebarroso2496
@jorgebarroso2496 4 жыл бұрын
@@lpthurler Yeah that is was I was meaning, for some reason I couldnt install the 1.5.0 version in the package manager and installed it manually. I didnt know it was only me.
@gagamagaj2136
@gagamagaj2136 4 жыл бұрын
which unity version did you have?
@jorgebarroso2496
@jorgebarroso2496 4 жыл бұрын
@@gagamagaj2136 2019.4.3f1
@gagamagaj2136
@gagamagaj2136 4 жыл бұрын
Alternative Solution: if you have the ml-agents package from the package manager (which is currently a bit older than the latest release: 1.0.5) - than you could just download an older release from github with the older version (in my case it was 1.0.2) and use its examples folder (projects/assets/mlagents) - helped me with the „2.“ issue
@mahdiyanoori2700
@mahdiyanoori2700 3 жыл бұрын
This video is just so awesammmmmmeee thankyou
@herbschilling2215
@herbschilling2215 4 жыл бұрын
Nicely done. I look forward to more videos on ML-Agents
@timbon
@timbon 4 жыл бұрын
You definitely deserve more subscribers, my dude. This was a fantastic tutorial!
@SebastianSchuchmannAI
@SebastianSchuchmannAI 4 жыл бұрын
Thanks ❤️
@maoryatskan6346
@maoryatskan6346 4 жыл бұрын
Nice tutorial but didn't work for me on Windows machine. Please make a tutorial how to install properly on windows machine.
@viverohessmiguel9172
@viverohessmiguel9172 4 жыл бұрын
When I install the package of the ml agents I start to appear a lot of errors related to the fact that the 'Actuators' does not exist and the same with the 'ActionBuffers' Does anyone know how to solve this problem?
@monkeyrobotsinc.9875
@monkeyrobotsinc.9875 4 жыл бұрын
Assing rewards is my favorite type of reward.
@limbenny22
@limbenny22 4 жыл бұрын
This video is incredibly helpful!! You are amazing!
@hotakutsuki
@hotakutsuki 3 жыл бұрын
this video was Amazing!, im watching it for the 3th time... and now about to start the traning
@layrik-7951
@layrik-7951 4 жыл бұрын
ML-agent 7 has a code problem Assets\ml-agents-release_7\com.unity.ml-agents\Runtime\Grpc\CommunicatorObjects\UnityInput.cs(134,28): error CS0115: 'UnityInputProto.ToString()': no suitable method found to overrid
@bombbomb5554
@bombbomb5554 4 жыл бұрын
THANK YOU SO MUCH FOR THIS VIDEO! it helped me so much
@AnoTheRock69
@AnoTheRock69 4 жыл бұрын
Thank you! It is a very informative video regarding on Unity ML-agent
@lindsay5985
@lindsay5985 2 жыл бұрын
Anyone else get a stack of compiler errors at Step 5: "Assets/ML-Agents/Examples/PushBlockWithInput/Scripts/PushBlockWithInputPlayerController.cs(109,31): error CS0246: The type or namespace name 'IInputActionCollection2' could not be found (are you missing a using directive or an assembly reference?)" ?
@Foxter13
@Foxter13 4 күн бұрын
hello, do u resolve? i have 50 errors
@sebastiansilva6132
@sebastiansilva6132 4 жыл бұрын
Man, this is huge. Thanks so much
@rickybloss8537
@rickybloss8537 4 жыл бұрын
Why doesn't pip3 install mlagents work on my pc is it because it's windows?
@VatSri
@VatSri 7 ай бұрын
You just earned a new subscriber.
@connorkoury5434
@connorkoury5434 4 жыл бұрын
What a clean video, can’t wait for more
@jn9747
@jn9747 4 жыл бұрын
Hi, Thank you for a great video. Can I ask you where I can find the text you show on 8:20? All the best
@maarten9222
@maarten9222 4 жыл бұрын
when i try to run: mlagents-learn config/trainer_config.yaml --run-id=MyFirstAI it says 'mlagents-learn' is not recognized as an internal or external command, operable program or batch file. how would i fix this?
@Backurio
@Backurio 4 жыл бұрын
I'm struggling with this error for over 2h hours now. No solution from Mr Google could help me. Have you figured out a solution for this?
@maarten9222
@maarten9222 4 жыл бұрын
@@Backurio nope I gave up
@Backurio
@Backurio 4 жыл бұрын
@@maarten9222 This helped me get it running forum.unity.com/threads/mlagents-learn-is-not-recognized-as-an-internal-or-external-command-operable-program-or-batch-fil.909716/ Maybe it also helps you.
@owengillett5806
@owengillett5806 4 жыл бұрын
Very useful and informative, thank you
@muyibolanleaghedo8184
@muyibolanleaghedo8184 4 жыл бұрын
Literally 6 months later you cant even run the project anymore... all there is is compiler errors cause Unity updated everything...
@diyordev35
@diyordev35 3 жыл бұрын
do you know any fixes?ive been trying to fix it for 2 days
@matherium
@matherium 4 жыл бұрын
Amazing video! Thanks a lot!
@Mehrdad995
@Mehrdad995 4 жыл бұрын
10:23 That *simple* pip3 install mlagents took me over 2 hours because I didn't know that mlagents relly on something named "PEP 517" and "H5PY" which them relly on python 3.7, so as me having 3.8.2 it couldn't be installed, then I had to use the preinstalled 3.7 in a separate environment setup. so, yeah it took over 2 hrs and I'm not sure whether this gonna work at all or not :/
@vaibhavshukla7769
@vaibhavshukla7769 2 жыл бұрын
great info
@CraftyClawBoom
@CraftyClawBoom 3 жыл бұрын
How could you train the AI while in game? My game idea requires the agent to learn from the player. Is this possible?
@dhruvagrawal3856
@dhruvagrawal3856 3 жыл бұрын
@CraftyClawBoom if you want the agent to learn from player dont do reinforcement learning instead learn imitation learning, you can learn it from channel called code monkey but yes you need to know the basics
@pulkitmidha5710
@pulkitmidha5710 3 жыл бұрын
Great video, thanks
@JelleVermandere
@JelleVermandere 4 жыл бұрын
Very interesting, definitely something I will mess with in the future!
@carny666
@carny666 4 жыл бұрын
This is great. I'd love to see you start a new simple scene using an ML agent, code and all.
@gamedevboy1181
@gamedevboy1181 4 жыл бұрын
9:19 why did unity team wrote gameObject.transform 🤨 They should just write transform.
@soareverix
@soareverix 4 жыл бұрын
If you want to run with a specific config file, use this command: mlagents-learn config/ppo/CustomConfigNameHere.yaml --run-id=MyFirstAI This will let you change the number of max steps so that your model can continue to learn indefinitely and you can tweak the other values to figure out which ones work best. If you want to continue training a specific model, you can do mlagents-learn --run-id=MyFirstAI --resume. This will let you pause your model and later get back to training. (Please note that on my computer, it writes out two dashes as -- instead of - -. Make sure to use two dashes for these commands!)
@maloxi1472
@maloxi1472 4 жыл бұрын
Amazing ! I would like more videos about the Machine Learning Framework, please !
@cyberfox9595
@cyberfox9595 4 жыл бұрын
I am getting error message module 'torch' has no attribute 'set_num_threads'
@DeJMan
@DeJMan 4 жыл бұрын
1. What is the use of Academy.Instance.EnvironmentParameters? Why do we use ResetParameters in the Academy instead of manually putting those values inside OnEpisodeBegin? 2. How exactly does setting values in the "actionsOut" array in the Heuristic function call the OnActionReceived function with those values? The Heuristic method does not return any values.
@northstar7978
@northstar7978 4 жыл бұрын
very good video, here is a random comment to help you build your channel. good luck
@DeJMan
@DeJMan 4 жыл бұрын
You mentioned complex topics that need to be mastered to fully grasp machine learning. Can you list out some terminologies?
@SebastianSchuchmannAI
@SebastianSchuchmannAI 4 жыл бұрын
I was more referring to the ML-Agents Framework but of course it is even more true for Machine Learning in general. I think Hyperparameter Tuning is one of those complex topics, where an understanding of the algorithms (PPO/SAC) helps a lot, as well as curiosity, gail and of course all the basics of Machine learning and reinforcement learning in general. This course by OpenAI is a great resource for that: spinningup.openai.com/en/latest/spinningup/rl_intro.html But I have in no way mastered it, so take my advice with a large grain of Salt.
@lindsay5985
@lindsay5985 2 жыл бұрын
When installing ML Agents in Unity's package manager, if ML Agents cannot be found, try selecting Unity Registry.
@berkertopaloglu911
@berkertopaloglu911 4 жыл бұрын
You are great guy keep up the good work
@aigen-journey
@aigen-journey 4 жыл бұрын
what's the behaviour script/tree GUI at 6:17? I've never seen it inside of Unity
@DeJMan
@DeJMan 4 жыл бұрын
Its a third party asset: Behavior Designer
@karimedx
@karimedx 4 жыл бұрын
thank you ... Ii really like the ML Agents project.. I hope you post more tutorials on it
@comdudeskip
@comdudeskip 4 жыл бұрын
@3:19 *Assigning Rewards
@SebastianSchuchmannAI
@SebastianSchuchmannAI 4 жыл бұрын
Noooooooooo
@Kugelschrei
@Kugelschrei 4 жыл бұрын
Hey! I am about to start working on my Game Design bachelor thesis. ML is pretty much the only part of programming I haven't really explored a lot, though I have an understanding of the concepts behind it (Hidden layers, bias and weights, fitness function...), which is why I want to explore ML with my bachelor thesis, in the context of game design. I haven't really settled on a topic, though I'd love to turn the training process itself into some sort of game. I got a few ideas regarding this: 1) Let the user perform the selection which would otherwise happen by evolutionary algorithms (basically chosing AIs to keep for the next iteration, i.e. "manual evolution"); 2) Let the user change the rewards => Turn it into an "AI sandbox". I am just diving into the topic and stumbled upon Unity's ML-Agents. Do you know if my two options would be applicable for the ML-Agents framework? My main concern is that I could be locking myself into the framework too much and I lose control (or might need a different training algorithm which is not included), not allowing me to achieve my goal. Any thoughts on this? It seems like you have a better understanding than I have on ML-Agents. Gutes Video übrigens, direkt nen abo da gelassen :D
@SebastianSchuchmannAI
@SebastianSchuchmannAI 4 жыл бұрын
I think you have valid concern. The problem with having the users change the reward is that the training process is seperate from the engine and therefore seperate from the built application. If you want a nicely packaged application like unity can deliever, only inference is possible right now. You would need to create your own package that somehow includes the python and the unity part, which is probably possible in some way. Additionally, evolutionary algorithms are not included in ML-Agents though implementing one isnt too challenging if you are not striving for maximum efficiency. In summary, I would recommend prototyping with ML-Agents because its easy to work with but be careful not to invest too much.
@DavidBrit101
@DavidBrit101 4 жыл бұрын
it says invalid syntax when I type "pip3 install mlagents"
@Kakanics
@Kakanics 4 жыл бұрын
have you installed python? did you checkmark the bottom box that said something like "Save Python to path" or something like that.
@lasko8628
@lasko8628 4 жыл бұрын
@@Kakanics Have the same issue. Deinstalled and installed it with the ´´Save python to path´´ checked but still get the same syntax error. Using Python 3.7
@Kakanics
@Kakanics 4 жыл бұрын
@@lasko8628 what cpu are you using? Does it support avx?
@Kakanics
@Kakanics 4 жыл бұрын
@@lasko8628 try pip install mlagents instead of pip3
@lasko8628
@lasko8628 4 жыл бұрын
@@Kakanics Intel Q6600, I dont know. I try to install it on my Macbook and see if it works. WIth pip install mlagents I get the same error
@benevolenttumour
@benevolenttumour 4 жыл бұрын
Great video! I have been looking for an up to date intro to Unity's ML-Agents and this was perfect. Only issue is the second command in the description isn't what you types in the video. Looking forward to more!
@SebastianSchuchmannAI
@SebastianSchuchmannAI 4 жыл бұрын
I fixed that, thank you!
@carmineferrara388
@carmineferrara388 4 жыл бұрын
Thank you, this type of video are so usefull for me, I'm going to start a ML trainership next month. Can you make a video about the most important categories of Machine Learning and how to use them within ML Agents?
@AcTAL0n
@AcTAL0n 3 жыл бұрын
Hey Sebastian, sorry for the stupid questions, but did you ever make a video/post about what extensions you use with vs and unity? I'm especially curious about the inline parameter hints, and I couldn't find any help on the web and on your discord. But great video, I enjoyed it a lot :) Liebe Grüße aus Berlin ;)
@soareverix
@soareverix 4 жыл бұрын
I got it working! Quick question though: I've been running the 'walker' scene and I still feel like the agents are unbalanced and could use more training after it automatically stopped. Is there a way I can add to their training time and improve performance?
@soareverix
@soareverix 4 жыл бұрын
(Just had to edit the config file. Got it!)
@THELOBABAH
@THELOBABAH 4 жыл бұрын
great! thank you so much
@SmartKeyboard2011
@SmartKeyboard2011 4 жыл бұрын
great video! liked and subscribed, but in macosx terminal, after install Python3.6.8, running mlagents-learn error message: command not found, please help
@grandmage1925
@grandmage1925 4 жыл бұрын
when I run pip3 install mlagents it flags install as invalid syntax
@SebastianSchuchmannAI
@SebastianSchuchmannAI 4 жыл бұрын
Make sure you have python installed and checked the box "Add to PATH" when installing.
@grandmage1925
@grandmage1925 4 жыл бұрын
@@SebastianSchuchmannAI Thank you for your reply. Not many youtube tutorials do that. I uninstalled and reinstalled python buy still get the same problem. No worries thank you anyway.
@Notion615
@Notion615 4 жыл бұрын
you actually should run "pip3 install mlagents" from Command Prompt in windows not from the python interpreter
@grandmage1925
@grandmage1925 4 жыл бұрын
@@Notion615 I tried that same error
@harrivayrynen
@harrivayrynen 4 жыл бұрын
Can sameone tell me examples when the local installation is needed. I mean : pip3 install -e ./ml-agents-envs and pip3 install -e ./ml-agents
@harrivayrynen
@harrivayrynen 4 жыл бұрын
Thanx for version 1.0 video. It would be nice to see video where you build one example from scratch. And also have time to tell about settings and parameters in Unity. And use graphs to check out how learning is working when you change settings.
@SebastianSchuchmannAI
@SebastianSchuchmannAI 4 жыл бұрын
This is my Plan !
@psyphy
@psyphy 4 жыл бұрын
Great video man. With the help of this, I trained an AI to balance a pole in 3D. I even made a video. Can I ask you a doubt? How do you record videos from Unity Editor? (I used an asset from the Asset store called Video capture. Do you use the same?)
@thebloocat
@thebloocat 4 жыл бұрын
There's a built in record feature if you're using Windows using the game window Win+G
@YEIYEAH10
@YEIYEAH10 4 жыл бұрын
Hey Sebastian. Thank you for this video. I would like to ask if there is any way to extract the data that our agent is currently gathering to make data processing. I know that our python API is doing that for us behind the scenes, but in the case that we wanted to code our own algorithms to work with unity that would be helpful.
@TechnicalBurhan
@TechnicalBurhan 4 жыл бұрын
Do we also need pytorch ??
@TrippleXD545
@TrippleXD545 11 ай бұрын
this doesnt work any more; ie loading the example assets causes an error
@fernir8702
@fernir8702 3 жыл бұрын
Hello, are the commands different for windows and have I to type them in the cmd. Iam realy confused couse the installing dindt fkt. and the console say that there doesnt exist such a command
@onceappuonatime
@onceappuonatime 4 жыл бұрын
It looks like this is Reinforcement Learning. I am new to this, please correct me if I am wrong. If it is RL, then where is the State?
@SebastianSchuchmannAI
@SebastianSchuchmannAI 4 жыл бұрын
Yup it's RL. So where's the state? I would say there is the environment state which encapsulates everything about the environment and its internal, private state (The game objects in the scene, their logic and so on). Then there's also the agent state, which is a partial representation of the environment state, so everything the agent observes about the environment via its sensors like raycasts or cameras. Does that make sense?
@pedrodesanti6266
@pedrodesanti6266 4 жыл бұрын
This opens so many doors for everybody
@comet-tech
@comet-tech 4 жыл бұрын
Great Video!! Awesome!
@AbhishekVerma13
@AbhishekVerma13 4 жыл бұрын
Sebastian, Great video. I followed the steps and everything works except last mlagent-learn command. Still figuring out. You were little fast and You step 5, Step 6 on screen display was overlapping your mouse clicks. but I could follow pausing and replaying .. so not a big deal. Keep up the good work
@DroneMesh
@DroneMesh 4 жыл бұрын
Keep going.. I left for a a bit also and came back found out everything has changed alot. Your vids where the refresh I needed... Maybe we can collaborate sometime :)
@SebastianSchuchmannAI
@SebastianSchuchmannAI 4 жыл бұрын
Thank you very much. You have a great channel, I can probably learn a lot from you. Always open to collaboration!!
@MinhNguyen-vl7jj
@MinhNguyen-vl7jj 4 жыл бұрын
fantastic tutorial!!
@franziskaneu5915
@franziskaneu5915 4 жыл бұрын
Nice video Seppi!
@SebastianSchuchmannAI
@SebastianSchuchmannAI 4 жыл бұрын
Heyo! Thanks ❤️❤️❤️
@justserv
@justserv 4 жыл бұрын
This was so cool! I want something a little different. I want to make an AI character who can look at a scene, then "close it's eyes" and try to recreate the scene it saw from memory. Is mlagent capable of something like that? Or is it only capable of moving characters around?
@SebastianSchuchmannAI
@SebastianSchuchmannAI 4 жыл бұрын
Sounds fun! It might be possible to do with ML-Agents, it's hard to tell without having tried it. My gut feeling says this sounds more like an Autoencoder problem, it's a type of neural architecture that might be suited for this kind of task. I would say in general that it's less of a Reinforcement Learning problem, so I would look into PyTorch or Tensorflow to implement an Autoencoder. Good luck!
@justserv
@justserv 4 жыл бұрын
@@SebastianSchuchmannAI Awesome thank you! I'm new to the AI world and your tutorial was really easy to follow. Keep up the great work!
@beingalitaheri
@beingalitaheri 3 жыл бұрын
Awesome, Thanks. FYI I am getting the error right at the end after running the last command, Please help: Traceback (most recent call last): File "/Library/Frameworks/Python.framework/Versions/3.7/bin/mlagents-learn", line 8, in sys.exit(main()) File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/mlagents/trainers/learn.py", line 250, in main run_cli(parse_command_line()) File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/mlagents/trainers/learn.py", line 49, in parse_command_line return RunOptions.from_argparse(args) File "/Library/Frameworks/Python.framework/Versions/3.7/lib/python3.7/site-packages/mlagents/trainers/settings.py", line 871, in from_argparse key mlagents.trainers.exception.TrainerConfigError: The option default was specified in your YAML file, but is invalid.
@TrueMomentsVelogs
@TrueMomentsVelogs 4 жыл бұрын
I'm new in Unity, I am wondering to work for developing ML models with Tensorflow, Keras, But for commercial purposes I have to use unity, but I'm a little confused which one is better to work? Which one is much commercial?? Unity or directly work with Python AI frameworks like Tensorflow and keras????
@PonasSausainis
@PonasSausainis 4 жыл бұрын
I wonder can you train agent give him one behaviour and then train like other behaviour for example if I got shooter game and train agent to walk and shoot but later I want to that my agent can roam the environment can you do that?
@Husain8107
@Husain8107 4 жыл бұрын
Hello Sebastian ! Greatly appreciated the video. For a future video or tutorial series can you please show how we can write the python script that allows us to train the ml-agents ? I would prefer if you would cover both the TD3 and PPO algorithm just to see which would work better . Congratulations on a job well done with this video ! Hope to see more !
@bhanukadassanayake
@bhanukadassanayake 3 жыл бұрын
when I install, it give error saying missing Newtonsoft. do you know about it
@uspaget
@uspaget 2 жыл бұрын
dunno if you solved this but, go to Package Manager and add by Name com.unity.nuget.newtonsoft-json
@Charan_Vendra
@Charan_Vendra 3 жыл бұрын
Great Video
@j0kerplayz766
@j0kerplayz766 4 жыл бұрын
The last command 'mlagents-learn config/trainer_config.yaml --run-id=MyFirstAI' says that MLagents is typed wrong or could not be found, any ideas?
@DeJMan
@DeJMan 4 жыл бұрын
try this "mlagents-learn --run-id=MyFirstAI" if that doesnt work do this first: "pip3 install --upgrade mlagents"
@TheStrokeForge
@TheStrokeForge 4 жыл бұрын
Really cool!!!
@alexanderf1598
@alexanderf1598 4 жыл бұрын
I tried a bunch of package versions (including preview versions), both through importing directly from the package manager and manually importing the corresponding .json file. However, I still cannot run the 3D ball demo due to the following compiler error: Assets\ML-Agents\Examples\Match3\Scripts\Match3Agent.cs(5,22): error CS0234: The type or namespace name 'Extensions' does not exist in the namespace 'Unity.MLAgents' (are you missing an assembly reference?). Any ideas what could be wrong/what else to try?
@commonbloodysense
@commonbloodysense 4 жыл бұрын
(using cloned repository) You now need to install the mlagents package and the extensions package separately. From Unity package manager, click + (top left of window), then select add package from disk, navigate to \ml-agents-release_12\com.unity.ml-agents.extensions and select the package.json
@priyanshujain5215
@priyanshujain5215 4 жыл бұрын
I am getting following error - "ERROR: Could not find a version that satisfies the requirement tensorflow=1.7 (from mlagents) (from versions: none)"
@mr.puffin3947
@mr.puffin3947 4 жыл бұрын
Same here Can anyone help?
@DeoIgnition
@DeoIgnition 4 жыл бұрын
@@mr.puffin3947 you're either using python 3.8 or 32bit python
@kittytangsze
@kittytangsze 4 жыл бұрын
do you have tutorial of installation in Windows 10? I follow the doc instruction but still in vain. the Error is "DLL load failed while importing _pywrap_tensorflow_internal", "Failed to load the native TensorFlow runtime" . Any idea?
@alexhammer2802
@alexhammer2802 4 жыл бұрын
I had the same issue but it was becouse i had a folder named ml-agents-release_2 inside the ml agents folder so i had to do the command "cd desktop/ml-agents-release_2/ml-agents-release_2" to get it to work
@kittytangsze
@kittytangsze 4 жыл бұрын
@@alexhammer2802 I finally know the reason. My CPU is too old that current tensorflow does not support. :(
@adrianbricenoaguilar6701
@adrianbricenoaguilar6701 4 жыл бұрын
This is very good! Could you maybe do a video on how to make the observation and rewards? I do have experience with NN and ML. It would be super interesting if you could make your own simple AI by setting up your model, for creating one from scratch.
@kharekelas4259
@kharekelas4259 4 жыл бұрын
Hi, I'm using windows ten, I opened python I've just installed and input the pip3 install mlagents line, it complains invalid syntax. What I got wrong? I'm familiar with unity and C# but never touched python. I can't install anything by following the video, any ideas?
@thomasjoseph6893
@thomasjoseph6893 4 жыл бұрын
The documentation of ML agents is what you need to look at for troubleshooting. For me, things started working once I used a virtual environment, which they explain how to set up. Here is the documentation. github.com/Unity-Technologies/ml-agents/blob/master/docs/Getting-Started.md
@reelkaz2500
@reelkaz2500 4 жыл бұрын
shame it doesnt work for me for some reason i cant install mlagents properly which wont allow me to run the yaml file. Im getting some issue with Environemnt Error when installing tensorflow
@pratyushbarikdev
@pratyushbarikdev 4 жыл бұрын
Awesome.
@wiktor3453
@wiktor3453 4 жыл бұрын
If you have an error while installing mlagents in python on windows it may be because you use 32bit python and not 64bit.
@mohamadsenpai9030
@mohamadsenpai9030 4 жыл бұрын
This is great!
@Draco98
@Draco98 4 жыл бұрын
ImportError: DLL load failed: The specified module could not be found. getting this when i type mlagents-learn. pleae help
@Makaniiii
@Makaniiii 4 жыл бұрын
I had the same issue. Try to reinstall tensoflow via pip. In my case a downgrade to tensorflow 2.0.0 worked for me
@Draco98
@Draco98 4 жыл бұрын
@@Makaniiii thanks man ,it's working now, i was stuck here for the past 4 days.
@V4C38
@V4C38 4 жыл бұрын
@@Makaniiii How did you downgrade to 2.0.0 if I may ask?
@Draco98
@Draco98 4 жыл бұрын
@@V4C38 just type " pip install tensorflow==2.0.0" In the promt window
@judgementcole
@judgementcole 4 жыл бұрын
@@Draco98 Thank you so much. I did 4 days of research but i just realized this caused the issue
@timbon
@timbon 4 жыл бұрын
When I try installing it says, "Config file could not be found in \ml-agents-master\config\trainer_config.yaml" and when I check the folder, there is no file with that name. Did something change in the past month?
@DeJMan
@DeJMan 4 жыл бұрын
try this "mlagents-learn --run-id=MyFirstAI" if that doesnt work do this first: "pip3 install --upgrade mlagents"
@timbon
@timbon 4 жыл бұрын
@@DeJMan My dude, you're a lifesaver. It worked, thank you so much. Why has it changed?
@DeJMan
@DeJMan 4 жыл бұрын
@@timbon Unity has updated MLAgents such that the singular trainer_config file that used to hold multiple behaviors have now been separated into separate files (so its a different path now). This change has also removed the need to specify a trainer file (it uses a default one). Welcome to MLAgents Release 3
@timbon
@timbon 4 жыл бұрын
@@DeJMan well thanks. I'm going to go mention that in the Unity Forum I created
5 Hacks to speed up ML-Agents Training in Unity3D
6:24
Sebastian Schuchmann
Рет қаралды 17 М.
ML-Agents 1.0+ | Create your own A.I. | Full Walkthrough | Unity3D
16:54
Sebastian Schuchmann
Рет қаралды 69 М.
The Best Band 😅 #toshleh #viralshort
00:11
Toshleh
Рет қаралды 22 МЛН
UFC 310 : Рахмонов VS Мачадо Гэрри
05:00
Setanta Sports UFC
Рет қаралды 1,2 МЛН
Support each other🤝
00:31
ISSEI / いっせい
Рет қаралды 81 МЛН
A. I. Learns to Play Starcraft 2 (Reinforcement Learning)
17:42
Get Started with ML-Agents in Unity - Part 1: Setup & Installation
20:39
Dear Game Developers, Stop Messing This Up!
22:19
Jonas Tyroller
Рет қаралды 792 М.
Unity ML-Agents - 5 things you didn't know about - Version 1.0+
12:07
Sebastian Schuchmann
Рет қаралды 9 М.
AI Learns to Park - Deep Reinforcement Learning
11:05
Samuel Arzt
Рет қаралды 3 МЛН
Much bigger simulation, AIs learn Phalanx
29:13
Pezzza's Work
Рет қаралды 2,8 МЛН
Teach your AI! Imitation Learning with Unity ML-Agents!
16:18
Code Monkey
Рет қаралды 103 М.
Why Does Diffusion Work Better than Auto-Regression?
20:18
Algorithmic Simplicity
Рет қаралды 431 М.
A new way to generate worlds (stitched WFC)
10:51
Watt
Рет қаралды 555 М.
The Best Band 😅 #toshleh #viralshort
00:11
Toshleh
Рет қаралды 22 МЛН