FastAI learns to play Fall Guys - Undetectable Fall Guys bot.

  Рет қаралды 800,104

ClarityCoders

ClarityCoders

Күн бұрын

Пікірлер
@Mr3zoozee
@Mr3zoozee 4 жыл бұрын
Nice work!, I love this type of videos where someone use Ai algorithms to turn dump computer into super clever computer, I Hope you proceed uploading this type of video♥️
@ClarityCoders
@ClarityCoders 4 жыл бұрын
I got some others in the works already.
@Mr3zoozee
@Mr3zoozee 4 жыл бұрын
@@ClarityCoders Waiting...
@boo7948
@boo7948 3 жыл бұрын
gerge
@Chris_Garcia-693
@Chris_Garcia-693 Жыл бұрын
does this work
@doyouhavecottoncandy7890
@doyouhavecottoncandy7890 3 жыл бұрын
It's so smart that it tried to glitch thorough the walls
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Cheaters gotta cheat.
@houssemedyn5678
@houssemedyn5678 3 жыл бұрын
Your picture fits nicely :p
@hirzanabqary
@hirzanabqary 3 жыл бұрын
thorough
@fernandoi8958
@fernandoi8958 3 жыл бұрын
It has no idea how to do that since the training data is based on OP's games and he did not glitch through walls (I am assuming)... AIs that learn weird behaviors like that are usually based on evolutionary algorithms - you must have the simulation environment to do a "selective breeding" of AIs that perform well...
@hamada3680
@hamada3680 3 жыл бұрын
Boku wa doctorrr Tony Tony Chopper
@ashwhall
@ashwhall 3 жыл бұрын
You'd probably gain a lot by giving the model some temporal context. Instead of passing in only the current frame, you could stack the current and previous frames depth-wise for an input shape of (224, 224, 2). This extra information would give vital information about the direction and velocity of everything in the scene, and wouldn't require any significant changes to the model.
@YashSingh-rf7nk
@YashSingh-rf7nk Жыл бұрын
would we pass it through a lstm layer?
@ashwhall
@ashwhall Жыл бұрын
@@YashSingh-rf7nk It wouldn't be necessary, by using two frames you're already adding velocity information. An LSTM would help, but adds to the complexity of training.
@plns1717
@plns1717 4 жыл бұрын
Came from r/python and I just have to stay your very underrated, you have earned a sub
@ClarityCoders
@ClarityCoders 4 жыл бұрын
Awesome so glad you watched! The sub means a lot thank you.
@Sooyush
@Sooyush 3 жыл бұрын
Wow, he got recommended to me!
@DTorto
@DTorto 3 жыл бұрын
Agreed
@tedzards509
@tedzards509 3 жыл бұрын
Oh why did you have to remember me that GPU training used to be free on colab
@ClarityCoders
@ClarityCoders 3 жыл бұрын
A lot of fun to be had there and time wasted 😂
@BigFatSandwitch
@BigFatSandwitch 3 жыл бұрын
Is it no longer free. I know there's pro version as well
@israelRaizer
@israelRaizer 3 жыл бұрын
What happened? I can still access GPUs and TPUs for free here...
@something4922
@something4922 3 жыл бұрын
@@israelRaizer complaining about the free usage limits i assume
@israelRaizer
@israelRaizer 3 жыл бұрын
@@something4922 but the guy said it "was" free, as if you had to pay to use it now
@joshuafahrenkrog1997
@joshuafahrenkrog1997 4 жыл бұрын
Awesome video! Let's see you get a crown in another video!
@ClarityCoders
@ClarityCoders 4 жыл бұрын
Challenge accepted
@thefakeyojames
@thefakeyojames 2 жыл бұрын
@@ClarityCoders challenge dropped apparently
@LUVVEOUS
@LUVVEOUS 3 жыл бұрын
This is when your mom says put game on pause but you can't cause it's online game and you turning on AI
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Haha bathroom break.
@seaton1288
@seaton1288 3 жыл бұрын
Wow this is really cool! I'm surprised it doesn't have more views
@ClarityCoders
@ClarityCoders 3 жыл бұрын
I'm happy it got this many haha... Thanks for watching.
@amosnimos
@amosnimos 3 жыл бұрын
When people make an AI to beat a game it's no longer cheating it's art.
@Emeraldym
@Emeraldym 3 жыл бұрын
Untill cheaters start using the AI together with cheats and ruin the game
@JasonGrace69
@JasonGrace69 3 жыл бұрын
Tell that to the TF2 community, I'm sure they'll agree
@amosnimos
@amosnimos 3 жыл бұрын
@@Emeraldym personally i find it unlikely that somoane capable of coding AI and who took the time to do it, would wast his time using it to have am unfair advantage in game. Most cheater use tool they haven't made and barelly understand how they work real programmer d'ont waste their time trying to cheat in video game. i did my own runescape-bot once to have it mine, forge, and sell automatically when i was gone, and i d'ont consider this cheating for multiple reason one of them being that it get borring quick so i stop using it soon after. The other is that it's almost more work to make the programe then do9ng it yourself. And the programe did not have any advantage to other player it played just like i did but automatically. Other then that the other programme i made where on single player game because when you CAN code stuff like that your self you d'ont feel the need to use it to have an advantage in game which are just for fun.
@amosnimos
@amosnimos 3 жыл бұрын
@@JasonGrace69 they use actuall AI to cheat in Team Fortress? IMPRESSIVE what advantage does it have over traditional cheating methode like aim bot ?
@amosnimos
@amosnimos 3 жыл бұрын
@@Emeraldym yeah until then.
@WestMonkey
@WestMonkey 3 жыл бұрын
“The plan is simple” Ludwigs in my head
@corte_s
@corte_s 3 жыл бұрын
Alright boys so
@jfjdcentofo
@jfjdcentofo 3 жыл бұрын
Awesome ! Love how it seems simple to train (just record the screen), and yet performs "ok", didn't know it was "that easy" to train a ML model. I feel like you can supervize 10 of these IAs and help them when they struggle, but you could never play 10game at the same time. Very nice for job automation or whatever
@sangramkapre
@sangramkapre 3 жыл бұрын
Interesting. I think just using past 4-5 images as input would improve it a lot as it will have the information of how objects are moving as well. Keep it up!
@ClarityCoders
@ClarityCoders 3 жыл бұрын
I agree 100%. Thank you for watching and commenting.
@Yenrabbit
@Yenrabbit 3 жыл бұрын
Nice demo of picking a simplified framing of the problem and getting a proof of concept quickly! Great project :)
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Thanks for watching!
@simmbuddy
@simmbuddy 3 жыл бұрын
8:38 "we at least know we're headed in the right direction" unlike that random agent... ^^
@anshulagarwal4082
@anshulagarwal4082 4 жыл бұрын
This is one of the most entertaining as well as educational video I've seen in a while and now I can't wait to check all your videos out. Nice job I'm sure you're gonna blow up one day with content as good as this 👍
@ClarityCoders
@ClarityCoders 4 жыл бұрын
Thank you that's very nice of you to say. I'm just happy anyone is enjoying the videos!
@poketopa1234
@poketopa1234 3 жыл бұрын
Woah, I’m surprised you got any results with such unstructured data. Neat!
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Stupid project but cool haha...
@nickhall7793
@nickhall7793 4 жыл бұрын
Amazing stuff! Sharing this with work mates
@ClarityCoders
@ClarityCoders 4 жыл бұрын
Thanks for watching i really appreciate it!
@froozynoobfan
@froozynoobfan 3 жыл бұрын
i'd love to see an unsupervised learner do this
@qassem121
@qassem121 3 жыл бұрын
I am a newbie but is that even possible I have only seen CodeBullet's videos which most if not all are unsupervised. Though he would have to make the game first in order for it to have that amount of time to learn.
@froozynoobfan
@froozynoobfan 3 жыл бұрын
@@qassem121 reinforcement learning RL is a method where the agent learns from its environment, in most cases an environment is easiest when you have your own simulation.
@Qris_7711
@Qris_7711 3 жыл бұрын
@@froozynoobfan Almost: RL is a ML paradigm alongside unsupervised and supervised :)
@revimfadli4666
@revimfadli4666 3 жыл бұрын
Don't GAN and VAE count as unsupervised?
@froozynoobfan
@froozynoobfan 3 жыл бұрын
@@revimfadli4666 for a GAN you still need labeled data to train your classifier
@dome8116
@dome8116 4 жыл бұрын
Had this idea too a few days ago. However I never would have thought it would be so "easy" to make in terms of AI models/techniques. Great job dude!
@ClarityCoders
@ClarityCoders 4 жыл бұрын
Easy to prove the concept and have some success. You do run into some road block on the harder levels with camera issues. Might take this on in another video.
@AliHaider-kk1qs
@AliHaider-kk1qs 3 жыл бұрын
Thoroughly impressed by how you framed such a complex task into a classification problem! When I saw the thumbnail, I thought you’d be coding up some reinforcement learning stuff. Subbed!
@RealityGamez
@RealityGamez 3 жыл бұрын
Because there is a such thing of frameworks.
@ClarityCoders
@ClarityCoders 3 жыл бұрын
For sure!
@gumbo64
@gumbo64 2 жыл бұрын
its called imitation learning if U want to learn more
@MACHINEBUILDER
@MACHINEBUILDER 3 жыл бұрын
This is a super high quality video! Great editing, and it's super informative! 😁
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Thanks it honestly means a lot. I'm just glad people enjoy watching!
@ai_coding
@ai_coding Жыл бұрын
dude ur a legend for this! thank you.
@sygaming1199
@sygaming1199 3 жыл бұрын
Plot twist: He's using Fast AI to reply to all the comments on this video.
@superaluis
@superaluis 4 жыл бұрын
What awesome project! I would appreciate if you do some follow up videos on this project. You could train it using more and better data (say only of your winning games) and maybe using deeper ResNet architectures or maybe using grey scale images (these edge images are a bit too simple approach imo).
@ClarityCoders
@ClarityCoders 4 жыл бұрын
This is a very good idea and something I have been playing around with a bit.
@timeiskey1
@timeiskey1 4 жыл бұрын
its not just simple, its more complex than using greyscale and its bad
@phonecaz1434
@phonecaz1434 3 жыл бұрын
0:37 BOYS THE PLAN IS SIMPLE
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Haha should that be my catch phrase?
@scottclowe
@scottclowe 3 жыл бұрын
Why did you change the image to grey scale and run edge detection on it? At 2:11 you say that the colours don't mean anything to the neural network, but this is not true since your pertrained ResNet18 was trained on natural colour images. Since the output size generated by the pertrained model is fixed at 512 irrespective of the complexity of the input image, I can not see any advantage to doing edge detection on the screenshots. Did you try training the network on the original screenshots before this and have an issue that motivated the move to doing edge detection?
@Trapezoideris
@Trapezoideris 3 жыл бұрын
I had this thought as well. Really don't understand the motivation here
@scottclowe
@scottclowe 3 жыл бұрын
The simpler methodology here would be to just plug the raw screenshots into the model without doing preprocessing on them, and see what happens. It is best to avoid premature optimization. Don't try to fix an issue until you have confirmed it exists. When working in data science, it is best to get your first model working (going from input to output) and wait until you have this before seeing what needs to be improved. Then try out your ideas of what to change one at a time and see if they make an improvement on your criterion compared to the baseline. In this case, I would expect that performing edge detection on the input images decreased the performance of the model. Doing so moved the inputs away from the training distribution for the pretrained ResNet18 model.
@yoshtm
@yoshtm 4 жыл бұрын
Good job !! I'm doing a similar thing on my channel, for a racing game (Trackmania), but I'm using feature extraction and a simple NN, instead of a CNN. I didn't think it could work in Fall guys, impressive !
@ClarityCoders
@ClarityCoders 4 жыл бұрын
You interested in teaming up for a video?
@yoshtm
@yoshtm 4 жыл бұрын
@@ClarityCoders I'd like to continue my AI project for now, but maybe later !
@ClarityCoders
@ClarityCoders 4 жыл бұрын
Yosh I would really like to connect to ask you a few quick questions on your projects. I sent you a discord request to add as a friend would that be the best way to chat? I tried to message but we need to be friends first or share a server.
@KensonLeung0
@KensonLeung0 3 жыл бұрын
Thought reinforcement learning from the title. OMG just CNN! good job
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Yeah I have some reinforcement videos but this was a fun simple CNN project.
@KensonLeung0
@KensonLeung0 3 жыл бұрын
@@ClarityCoders good. I am a fan of fastai too.
@ChrisRid
@ChrisRid 2 жыл бұрын
A massive thank you for putting this video out there! I hadn't considered using AI before, and after watching this, I decided to dabble in creating my own AI to play a completely different game and experimented with using different code. Really helpful
@akimbocs
@akimbocs 3 жыл бұрын
opencv could easily be used to make it recognize the levels! Great work, love it.
@ramengreek4176
@ramengreek4176 3 жыл бұрын
It’s nice of you to try and help prevent these kind of hackings things, good work!
@Mikey0HeLikesIt
@Mikey0HeLikesIt 3 жыл бұрын
This was great, thanks for the inspiration!
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Thanks for watching and commenting it means a lot.
@R8Spike
@R8Spike 3 жыл бұрын
Ngl I want to see the ai footage. Always interesting
@ClarityCoders
@ClarityCoders 3 жыл бұрын
thanks for watching!
@MrCreeper20k
@MrCreeper20k 3 жыл бұрын
@@ClarityCoders Stream it 24 hours on twitch lol that kind of thing always seems exciting
@puggers8628
@puggers8628 3 жыл бұрын
Damn sooooo underrated keep up the gud work earned a sub :D
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Thank you! I appreciate the sub and comment.
@anyurag
@anyurag 3 жыл бұрын
Excellent !! Please do keep us posted and make a video about the progress after training it around for 60 games. I am very excited to see the final results.
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Thanks for watching and commenting! I will try and post an update.
@michaelc3650
@michaelc3650 3 жыл бұрын
Fantastic video! Was thinking of doing something like this before and never figured out how, this vid helped a ton!
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Glad I could help!
@DroneMesh
@DroneMesh 3 жыл бұрын
Keep this up.. Just keep uploading and your channel will grow. I love your simple and elegant solution.
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Thanks this comment means a lot. I'll keep on making videos!
@MaxGuides
@MaxGuides 3 жыл бұрын
I had more success memoizing the recent history as an input to a CNN & doing more feature detection for platforms, walls, and obstacles. I used mean-shift clustering to find moving obstacles and other players so that it would hopefully work on new maps as well.
@ClarityCoders
@ClarityCoders 3 жыл бұрын
That's awesome. You going to share that sh!t? Thanks for the view buddy.
@SaiNikhileshReddy
@SaiNikhileshReddy 3 жыл бұрын
A sub is a must for your channel. Keep up the good work. We need you to make these kind of fun videos of AI playing simple games.
@markstar6899
@markstar6899 3 жыл бұрын
It's so smart it tried to use speedrun tricks
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Crafty AI! Thanks for watching and commenting.
@sdfrtyhfds
@sdfrtyhfds 4 жыл бұрын
The code in the git is crazy simple and intuitive, Im really impressed! how common is the usage of fastai in your experience? as someone who learns ML, are there any other libraries you can recommend?
@ClarityCoders
@ClarityCoders 4 жыл бұрын
FastAI for me is great for the quick setup and testing things out. if you want to get more detailed I'd learn pytorch. I have a setup tutorial!
@sdfrtyhfds
@sdfrtyhfds 4 жыл бұрын
@@ClarityCoders i was lucky enough to learn pytorch in a practical course, but it was a little lacking when it came to search for hyper parameters, and i've never heard of fastai before.
@ClarityCoders
@ClarityCoders 4 жыл бұрын
@@sdfrtyhfds awesome it will be easy for you to pickup then Google them they have a tutorial series.
@bobdylan9173
@bobdylan9173 4 жыл бұрын
i'm love fastAI! I'm a huge fan of Jeremy and Rachael ... and yours, now @ClarityCoders
@ClarityCoders
@ClarityCoders 4 жыл бұрын
@@bobdylan9173 so far my highlight on youtube is him tweeting my video haha
@Keirp1
@Keirp1 3 жыл бұрын
A better baseline would be to just take the most frequent action, or randomly sample actions at the frequency that you took them in your training data. I suspect that would do about as well as this nn is doing.
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Very good point. Given more time and interest I would have gathered even more data and then balanced it better. Thanks for watching I appreciate it.
@nostradamus9132
@nostradamus9132 3 жыл бұрын
I agree, I also suspected, that the agent just learned the right random distribution. Also I did not see a confusion matrix for the test data. I think it unlikely that a agent in such a complex environment could be trained that easily.
@Saleenrulz
@Saleenrulz 2 жыл бұрын
It would be really cool to see the continuation of this
@nostradamus9132
@nostradamus9132 3 жыл бұрын
Did you do a confusion matrix on testing data? Did you set the probabilities of your random baseline agent to match your data? For example just running and doing nothing else should have the highest probability. It did not seem like this was the case. So it is possible that you just learned the right random distribution. Why don't you use Q-learning or other reinforcement learning methods. Your ground assumption that the action you performed is the right one leaves your agent lacking. Not including bad runs is understandable in your setting, but if you wanted to surpass your performance this would be counterproductive. I would recommend you to use a actor critic reinforcement learning agent. Or just a deep q agent.
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Honestly because i wanted to show how you could build your own supervised learning data set on a game. The project was also a starting point not really and ending point a lot of things could be improved including gathering more data. I do have some other videos on reinforcement learning!
@flache1086
@flache1086 3 жыл бұрын
Wait now it can qualify ... Can you make it so it records its own games and learn as a factor of his positionning ? Then make him able to run all by himself ... like 1 ...2 ... 10 runs at the same time ? Then if you leave it to learn maybe overnight it'll show you how much is possible with only there 3 entries
@philippurwoko
@philippurwoko 3 жыл бұрын
I never use fast ai before. Wow that was really fast AI development. Just need to add more huge of data of a pro player to make the AI OP at the game
@ClarityCoders
@ClarityCoders 3 жыл бұрын
For sure ad the pro player haha
@ronaldokun
@ronaldokun 4 жыл бұрын
That was very entertaining! Congratulations!
@ClarityCoders
@ClarityCoders 4 жыл бұрын
Thank you.
@adamjackson7585
@adamjackson7585 3 жыл бұрын
Can we get a part 2 and see how far this can go? Would like to see it win some games and get smoother.
@32DegreesFarenheit
@32DegreesFarenheit 3 жыл бұрын
Awesome video dude, you broke it down super well
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Thanks I really appreciate it!
@MrJCraft
@MrJCraft 3 жыл бұрын
this looks like a lot of fun and I plan on attempting this for a few games.
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Awesome I hope you share it!
@MrJCraft
@MrJCraft 3 жыл бұрын
@@ClarityCoders if I can manage to start it XD I haven't coded in months and never tried AI before, of course there is your discord I may or may not ask a lot of questions
@saivikassingamsetty3758
@saivikassingamsetty3758 4 жыл бұрын
Awesome video and great efforts!!!
@ClarityCoders
@ClarityCoders 4 жыл бұрын
Thanks a lot!
@Croixer7
@Croixer7 3 жыл бұрын
Hi, what an entertaining work. I am wondering FastAI does automatically balances each class image weight for result or not? I can see from the confusion matrix that the nothing action is ~10 times bigger than other groups. Because if not, then balancing classes magnitude could make result way more efficient. (Artificially enlarging small action datasets and reducing huge datasets.)
@Ori7
@Ori7 3 жыл бұрын
Yes, fastAI does a lot of magic in the background
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Yeah they make it crazy easy to spin something up. You can dig in and customize everything but out of the box it gets you running.
@chetranqui
@chetranqui 3 жыл бұрын
This looks like a much more fun way to play Fall Guys than the regular method, for sure.
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Haha These comments are cracking me up. Honestly when people ask why I didn't push this project forward it's because I was sick of playing. Thanks for watching buddy.
@Fine_Mouche
@Fine_Mouche 3 жыл бұрын
3:28 : what is CO or OO (the orange logo in left top corner)
@bibekdhkl
@bibekdhkl 3 жыл бұрын
Such a great explanation! I even don't know python basics but I am watching this ;)
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Thanks for watching and commenting it means a lot.
@bobdylan9173
@bobdylan9173 4 жыл бұрын
Amazing, Guy! Congratulations!
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Thank you! Cheers!
@amegatron07
@amegatron07 3 жыл бұрын
Nice work! I also had a long lasting idea to make similar aganets for games, and such videos as this one give me a big impetus and inspiration to finally dive into this :)
@nicklansbury3166
@nicklansbury3166 4 жыл бұрын
Fun video. Nicely explained, Liked and Subbed.
@ClarityCoders
@ClarityCoders 4 жыл бұрын
Thanks for the sub! Glad to have you around.
@somedudeonyoutubefrfr
@somedudeonyoutubefrfr 4 жыл бұрын
From reddit here ^^ I didn't waste my time :D It was worth it
@ClarityCoders
@ClarityCoders 4 жыл бұрын
Thanks for checking it out! I got some more cool stuff coming soon stay tuned.
@pochtanah
@pochtanah 4 жыл бұрын
Huh, so no need for camera control? Just 3 keys and hold forward, and edge detect for image processing, that's super smart and efficient, I wouldn't guess you could build an efficient player with just that.
@ClarityCoders
@ClarityCoders 4 жыл бұрын
Good note! That's why those 3 level were chosen because you don't need to mess with the camera. That would need to be addressed on the next version.
@tfw_sean
@tfw_sean 4 жыл бұрын
That’s really cool how an AI can just teach it’s self how to play!
@ClarityCoders
@ClarityCoders 4 жыл бұрын
Thanks so much I really appreciate you taking the time to watch.
@fernandoi8958
@fernandoi8958 3 жыл бұрын
I dont think detecting edges is necessary since the idea of DNN is to just feed (somewhat) raw data to it and it should find a function that maps input to output... Thats because using the edge detector you are skipping a learning step the NN would have to overcome, which is finding details in the image that may be useful in deciding whether to move left or right...
@albarnie1168
@albarnie1168 3 жыл бұрын
I will say that because the network was trained to classify textured/coloured images, feeding the edge detected image may not have been beneficial. grayscale at low res would probably have given best results.
@ClarityCoders
@ClarityCoders 3 жыл бұрын
I would agree honestly. If I could go back I should have done it both ways at least to showcase the difference.
@rubenr.2470
@rubenr.2470 3 жыл бұрын
that was amazing. would love an in depth tutorial of the code
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Thanks! That's a great idea. maybe the same concept on a game every has access to try?
@v1682s287
@v1682s287 3 жыл бұрын
@@ClarityCoders would be awesome
@drunkewok31
@drunkewok31 3 жыл бұрын
@@ClarityCoders You wouldnt believe how much of a poger u would be. There are virtually no in depth tutorials on how to make an ai to play games like this. It would be awesome.
@shaneknight1489
@shaneknight1489 Жыл бұрын
Now that I see this program, I have a theory that Fast AI could be useful for more than just playing video games. This AI could also be useful for other applications, such as learning Calculus for example. It could also be used to make the code that you need in order to get 100% on your coding project too. I am working on a project that involves FastAI
@mythorganizer4222
@mythorganizer4222 3 жыл бұрын
Okay that's creative. Replaced Reinforcement learning with CNNs 👏👏👏
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Thanks! can probably create some interesting use cases.
@lala-kq5ho
@lala-kq5ho 4 жыл бұрын
nice job man i think training to play CSGO is worth a shot now. thanks for sharing the process.
@ClarityCoders
@ClarityCoders 4 жыл бұрын
I would love to see that go for it!
@SuperElephant
@SuperElephant 3 жыл бұрын
Finally get to see some implementations that is applied on the real game, not an improvised game developed for the purely AI purpose like most of the youtuber does.
@ClarityCoders
@ClarityCoders 3 жыл бұрын
It's way tougher to be honest. Thanks for the comment.
@bahamut256
@bahamut256 3 жыл бұрын
You made this a lot more complex than was necessary, simply have the ai copy the patterns of the fastest fall guys and replicate their inputs.
@ClarityCoders
@ClarityCoders 3 жыл бұрын
You would need to have access to that data as inputs. I didn't have any of their code so I couldn't use that...
@briankaste6931
@briankaste6931 3 жыл бұрын
How does this account for the different variations within each mode? Like on Hit Parade, the 2nd section can be the revolving doors that you need to push through, or the spinners that were shown at 9:39 where you can do a combination of avoiding and jumping over the bars.
@ClarityCoders
@ClarityCoders 3 жыл бұрын
I used a different model for each mode. with enough data you might be able to share models.
@sam3524
@sam3524 3 жыл бұрын
This is so good! Imagine if there was some way to use the positions, velocities and hitboxes of relevant objects as input. Would probably take some serious reverse engineering though
@ShivamSingh-bx5lg
@ShivamSingh-bx5lg 4 жыл бұрын
Awesome stuff, subscribed!
@ClarityCoders
@ClarityCoders 4 жыл бұрын
Awesome, thank you!
@ArawnFR
@ArawnFR 3 жыл бұрын
Absolutely love the channel, I used to play a game when I was a kid (Wakfu) and I was wondering if you could make a video on it about farming, it shouldn’t be too complicated but sometimes when farming you’d encounter an AI to fight (fairly easy) but I’m wondering how you would tackle the problem with AI
@ClarityCoders
@ClarityCoders 3 жыл бұрын
I'll put it on my list to check out! Thanks for taking the time to comment.
@hello-fo5yg
@hello-fo5yg 2 жыл бұрын
imo if you are using a pretrained backbone stripping the incoming frames may not really be helpful at all, its likely very OOD compared to the data it was pretrained on
@TrooperJet
@TrooperJet 3 жыл бұрын
If you played more games to better train your AI, did it improve?
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Yes. Although I moved on as I got bored with the game 😄
@etyndigtland
@etyndigtland 2 жыл бұрын
Hey. I'm trying this bot out but it seems that when I try to create images, the cv2 imwrite function doesnt work at all - I've tried everything but can't get it to work
@Elimenator89
@Elimenator89 3 жыл бұрын
atleast were heading in the right direction when hes clearly running back to the start
@bloolizard
@bloolizard 4 жыл бұрын
Awesome project! Good use of fastai, definitely going to try to build something like this now.
@ClarityCoders
@ClarityCoders 4 жыл бұрын
Got another FastAI video coming out in a week or so.... If you're interested hit that bell so you don't miss out.
@starlite5097
@starlite5097 3 жыл бұрын
Hi, great work. You earned a sub. Question: how can I put games like these in some kind of simulator to play against itself so that I can run many simulations in a short amount of time?
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Tough with a live game like this without the source code. That's why a lot of people doing AI on games rewrite the whole thing in their own code.
@starlite5097
@starlite5097 3 жыл бұрын
@@ClarityCoders sounds complicated... I wanted to try and train an AI bot for clash of clans by letting it play against itself and to have an AI bot that knows how to attack and one that knows how to build bases... Wishful thinking though.
@chriszethird
@chriszethird 3 жыл бұрын
Just a question, I am truly interested into the normalization function you apply on your pictures, would you mind explaining how it works ?
@Fine_Mouche
@Fine_Mouche 3 жыл бұрын
3:26 : and for me who has a RTX 3080 and a Ryzen 7 5800xt ? still faster / better to use FastAi ?
@TheRyulord
@TheRyulord 3 жыл бұрын
FastAi doesn't affect training speed, it just lets you write higher level code. It's a good place to start if you're a beginner.
@omenquentama6453
@omenquentama6453 3 жыл бұрын
That outline picture does not include information about which way the ball is moving, or how fast.
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Yup could probably stack images to give it some knowledge of movement speeds. One of the many improvements you could make on the project I just got a bit bored with it.
@ITR
@ITR 4 жыл бұрын
Maybe you could mod the game to have the textures all be black with white outlines, since skins might mess with the training a bit
@ClarityCoders
@ClarityCoders 4 жыл бұрын
Very good point. I really want to figure out a way to keep the camera centered is my next challenge.
@ITR
@ITR 4 жыл бұрын
@@ClarityCoders Check out the melonloader, it makes modding unity games really easy
@codex6634
@codex6634 2 жыл бұрын
Could you do more videos about fastAI an how to use it for different use cases?
@Maric18
@Maric18 3 жыл бұрын
i dont think this type of "cheating" can be fixed since all you do is legitimately and imperfectly press buttons, even valorant level rootkit bullshit can't do anything if you let this run on a different computer and emulate a usb keyboard instead of sending button presses if the detection is " changes input at regular intervals" thats trivial to defeat too
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Yup and not a lot of incentive for them to try and stop it sense it isn't performing above a human level.
@tanujguhathakurta413
@tanujguhathakurta413 3 жыл бұрын
Would love to see ai bot playing among us and actually generating speech that can convince others that it's not the suspect.
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Honestly a super cool idea. Not that far off either sense among us would have some processing time.
@EP1CxEMAN08
@EP1CxEMAN08 3 жыл бұрын
Same actually! I've never seen a bot actually play Among Us before, just spam bots that leave moments after they join.
@freecode.ai-
@freecode.ai- Жыл бұрын
how can i pass a tuple of integers instead of using the direction classifier?
@HugoCoolDude
@HugoCoolDude 3 жыл бұрын
Why didn’t you use the colour and texture information to do masking? Basically a preprocessing step that transforms your screenshots into several simplified layers such contain the edges. Such that the AI can react specifically to pendulums and other object, while following the inside of the race track
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Honestly cause the color and texture difference would need more data and I was sick of playing. It's a really good idea though and would probably perform better.
@dashbolt101s
@dashbolt101s 3 жыл бұрын
Best would be to use a stream device linked to another computer or to another program at least - and train the AI to visually recognize different elements from the stream and make decisions from it - then send inputs back to the computer/game.
@FarazOloumi
@FarazOloumi 2 жыл бұрын
All this does is to press w with slight left and right ones. It never once anticipated or reacted to an obstacle smartly at all!
@kevintrigg3707
@kevintrigg3707 3 жыл бұрын
if it got turned around would it know that it isn't going the right way and turn back forward? if so would you have to teach it only to turn left or right when it was reversing to get back on track or would it see that it is more on the correct path as it turns and continues that direction until moving forward?
@ClarityCoders
@ClarityCoders 3 жыл бұрын
If you fed it some training data showcasing that scenario it could learn. So you would have to have played games where you got turned around and corrected the path.
@jaydenbrown6918
@jaydenbrown6918 3 жыл бұрын
You blocked the steam name at some point but it shows again at 7:34
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Maybe it will get me more friends 🤣... I left my phone number in a video once as well had people texting me all day.
@Danny-sj6es
@Danny-sj6es 4 жыл бұрын
Awesome video! Found it interesting that a resnet could be somewhat effective at this task. Of course for optimal results some kindve recurrent network will need to be used to encode contextual data from frame to frame. Also your approach of simplifying the images makes sense but it would be nice to see more data retained. Canny edge detection algorithm should retain more of the edge information.
@CristianGarcia
@CristianGarcia 3 жыл бұрын
Nice video! Did you try learning on RGB or even grey scale? I see no reason why it would be better to use edge features as input instead of the full RGB image, ResNets are powerful enough and its know that the first layers almost by default learn edge detectors.
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Very good points I'll keep that in mind. My decision came because it seemed to learn quicker and ignore the patterns and distractions of the characters costumes and such.
@CristianGarcia
@CristianGarcia 3 жыл бұрын
@@ClarityCoders I see, training speed does seem like a good trade-off for a baseline.
@bobentius7035
@bobentius7035 3 жыл бұрын
Felt a bit cut short at the end. Would have liked to see the improvements you talked about
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Yeah honestly I got bored playing the game so I didn't want to make more training data. It's fun but I was playing it like it was my job 😂. I should do another game with more data and some improvements.
@GeeveGeorge
@GeeveGeorge 3 жыл бұрын
Any plans to add re-inforcement learning to make it play fall guys, like AlphaZero , learning from the ground up? Would be fascinating to see something like that.
@ClarityCoders
@ClarityCoders 3 жыл бұрын
I would love to but.... need a bit more processing power than I have at the moment. 😂 If you guys keep watching maybe Nivida can hook a guy up.
@Chillwave6
@Chillwave6 3 жыл бұрын
This is the type of AI I'm interested in. Obvious bots are always annoying but when the bot can blend in like this, it's a good one. The ones with obvious cheats (fly/big speed/wallbreak) in games ruin it for everyone else in the lobby.
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Yeah it's pretty good harmless fun.
@RTMgi9
@RTMgi9 5 ай бұрын
Can we get more of this with a 3d old mmo game?
@lonelyPorterCH
@lonelyPorterCH 3 жыл бұрын
it actually qualified, nice :D
@micah6635
@micah6635 3 жыл бұрын
I know this is a bit late but, I wonder what a bot that would look for the closest player and mimics it’s moves would do
@ClarityCoders
@ClarityCoders 3 жыл бұрын
Haha. That is very interesting actually. Find a buddy and live or die with the results.
I tried to make a Valorant AI using computer vision
19:23
River's Educational Channel
Рет қаралды 1,5 МЛН
小丑女COCO的审判。#天使 #小丑 #超人不会飞
00:53
超人不会飞
Рет қаралды 16 МЛН
A.I.  teaches itself to drive in Trackmania
15:04
Yosh
Рет қаралды 4,9 МЛН
The Dome Paradox: A Loophole in Newton's Laws
22:59
Up and Atom
Рет қаралды 714 М.
I Scraped the Entire Steam Catalog, Here’s the Data
11:29
Newbie Indie Game Dev
Рет қаралды 630 М.
Using Image Recognition to DESTROY Fruit Ninja
10:08
CodeNoodles
Рет қаралды 615 М.
OpenAI Plays Hide and Seek…and Breaks The Game! 🤖
6:02
Two Minute Papers
Рет қаралды 10 МЛН
AI Learns to Play GeoGuessr
13:56
adumb
Рет қаралды 843 М.
When Optimisations Work, But for the Wrong Reasons
22:19
SimonDev
Рет қаралды 1,1 МЛН
AI Destroys a Mobile Game in Real-Time with OpenCV (Object Detection)
12:18
Using My Python Skills To Punish Credit Card Scammers
7:13
Engineer Man
Рет қаралды 4,9 МЛН
Fast Inverse Square Root - A Quake III Algorithm
20:08
Nemean
Рет қаралды 5 МЛН
小丑女COCO的审判。#天使 #小丑 #超人不会飞
00:53
超人不会飞
Рет қаралды 16 МЛН