How to Make an Amazing Video Game Bot Easily

[@EmoryM]

"Alexa, solve poverty." _Nuclear launch detected_

[@LalkeBanditen]

Slight chance of mushroom clouds...

[@capnam_12]

69 likes

[@yamom...5918]

@@capnam_12 NO

[@evanm623]

"Wanna piece of me boy!?"

[@masternobody1896]

This is the best I know create a bot to play fortnite

[@billjensen51]

"... only 10 lines of code. Start by importing thousands of lines of code already written but you did all the important work, trust me."

[@ClaytonGinther]

Right? I train my models using machine code.

[@IslandRai]

Were you able to comment this on all his videos so everyone knows what a complete and utter fraud he is?

[@enzoqueijao]

These new progamers are all so lazy... I program using only pencil and paper!

[@ThylineTheGay]

@@enzoqueijao *I* only code with punch cards

[@anuragsethi16]

True, but hey isn't that the case with every application when we import hundreds of libraries....

[@sentdex]

Definitely one of your best videos to date, nicely done Siraj.

[@SirajRaval]

thanks Harrison!

[@Sheddy29]

Django on sentdex and Machine Learning there ahahah

[@botino6152]

Howdy !?, This is Botino, a youtube bot. This message is meant to test KZbin software, to test the functionality of it. As you can see this message is working perfect.

[@mikejankowiak5434]

sentdex is this what inspired your super awesome python plays GTAV tutorial?

[@shimuk8]

sentdex yesterday I was watching your balance pole video and today I saw your comment up here... life is such a circle !! xD

[@JordanShackelford]

That hair futuristic af

[@SirajRaval]

thanks Jordan. it's open source too

[@Attakijing]

I have a pull request for you. It involves a basketball number

[@Melicrafts]

@@SirajRaval hi... i have download a source file from github, but i was not able to compile ... i need some guidence ...the source file is for subway surfer AI..please help me how i can use that source file

[@ppshe1]

can we make bots that create bots that make better bots to create even better bots???

[@deepbits7312]

Not yet, soon we will. Singularity here we come.

[@HeliosphanXtal]

I think we wont even notice the moment we reach singularity; we will end up way beyond it in a fraction of a second. Biological intelligence will be rendered obsolete. Interesting times ahead.

[@SirajRaval]

yes

[@159abdellah]

inception shit !

[@mikeunleashed1]

we're trying, but as of now, we currently can't.

[@newgamedk]

Hi Sirajology. If you discover errors in your speach, and want to record single words, and input them into your timeline, like "a list", or "intelligence", a tip to make it work, is to 1) record at exactly the same spot in the studio, and 2) listen to a recording of your voice in the same sentence *just* before you make your corrections, that makes it easier to pronounce and put pressure on words in exactly the same way, making it virtually impossible to hear you have corrected yourself. And 3) if you are a perfectionist, record whole sentences rather than single words, making it easier to choose where to do cut. Thanks for amazing videos. Best regards Søren

[@Egzvorg]

I guess option 1) is not available

[@SirajRaval]

this is great advice, thanks Soren. I was working on this all weekend with the team lots of updates were made really fast. this is the one thing i am unhappy about from this video and i'll definitely improve next time :)

[@newgamedk]

Egor Zvorykin Well if he remembers the spot he was in (the room / studio), then echoes will be the same, therefore much more likely to be unoticeable.

[@Egzvorg]

newgame what if he don't have access to the studio (eg. long ride)

[@newgamedk]

... Yes - you are right. :-)

[@danm4320]

This video is approved by Elon Musk. Well done!

[@SirajRaval]

thanks so much! Musk is awesome

[@u6uggg6hguiuggy]

@@SirajRaval He doesn't only care for himself, unlike most wealthy and succesful people. AND he is smart.

[@robinferizi9073]

@@u6uggg6hguiuggy who else does Musk care for?

[@DeaMikan]

Please continue this with a series!! Would love to learn how to use Universe properly.

[@michaeldevinsky4231]

bump

[@SirajRaval]

i will propose this to OpenAI soon

[@nikhilmenda2983]

Elon Musk sent me here!

[@harshvardhan-vy2vo]

Nikhil Menda me too

[@SirajRaval]

hell yea, greatest tweet ever

[@harshvardhan-vy2vo]

Ur videos are great by the way.

[@charleslaux8964]

Siraj Raval when I run the code I get Trace back (most recent call last): File “C:\users\gamer\appdata\local\programs\python\python3.6\coast.py”, line 1 In Import gym Module not found error: no module named gym

[@charleslaux8964]

Can you help

[@gabelarkin1796]

Came across Universe on another forum and my first thought (well actually my second!; first was to seek out more discussion at HN) was to see if Siraj had anything up re: Universe. Went to HN and you were the first comment. Winning!

[@SirajRaval]

woot, thanks Gabe. #feelthelearn

[@sgaseretto]

Your speed is getting better and better! Awesome video too!

[@SirajRaval]

thanks Sebastian!

[@jaideairblade]

How can you make in a pc game witch is like a flash game? Since you just showed how to do it in the environments

[@RageKid20]

when i try to install universe it says Command python setup.py egg_info failed with error code 1 in /tmp/pip_build_mememachine/go-vncdriver Storing debug log for failure in /home/mememachine/.pip/pip.log

[@danieldossantos5868]

They have some instructions here github.com/openai/universe

[@zackjandali]

@@danieldossantos5868 those instructions dont deal with this issue. Im having the same issue. Im using PyCharm. I've tried to change my version to 2.7 or 3.5, like they say on the github, but even after I've done that, when I type 'python --version', it says im using 3.7.4...

[@RaisesCom2]

I remember when this channel had 50 subs

[@ivangouvea4195]

Yeah. that was like 2 months ago...

[@SirajRaval]

Natu, you were one of the first people to watch my vids. Thanks for believing in me

[@RaisesCom2]

I told you, you would make it fam. Here's to 100k subs

[@SunMai93]

Natu "Altermax" Myers still not popular enough

[@Y2Kvids]

Natu "Altermax" Myers All of them are subscribe bot.

[@rtluo1546]

How could you release the video the same time as they release the code.

[@montethakkar]

"OpenAI asked me to make this video and I gladly said yes. They are awesome!!" He says it on the description.

[@rtluo1546]

Monte Thakkar I didn't see the description. This makes sense to me now.

[@graphoverflow]

it says "OpenAI asked me to make this video and I gladly said yes. They are awesome!!" in the description, so he must have had early access to the code

[@SirajRaval]

yup had early access, this was so dope worked on this all weekend and got to work with some heroes (Ilya Sutskever and Andrej Karpathy)

[@bara2c]

I am new to coding and dont have much idea of how to do this. What platform do you use to write that code? and what do I need to do to import all that info?

[@michaelfer4038]

Now to make a video game

[@theholyromanarmy4745]

I'm new to Python where do I write the code like you do? and how do I get files like gym etc.

[@PiusNyakoojo]

(0:11) It's Siraj (1:17) If master chief sees a grunt (1:50) intelligence (4:36) a list (5:43) this module is included in the environment so we don't need to worry about it (6:15) our VNC server in our local docker container (6:55) break it down Open AI

[@SirajRaval]

lol you caught all the mistakes nice

[@TheRedLaserOFFICIAL]

Video: 2016(4 years old) KZbin: *Puts in recommended* Me: *TRIGGERED* Me at the end of video: *....Thanks SO Much!!!!*

[@abduljilanids]

I had looked at openai when it first blew on to the scene, but with the universe update, i might have to dig in again. Also, great job at bringing fun onto ml education

[@SirajRaval]

thanks Abdul

[@oliveredholm4284]

Best video layout/format I've seen so far! 👍👍

[@SirajRaval]

thanks Oliver!!

[@ChristFan868]

Excellent stuff as usual Siraj! Keep it up! :D

[@SirajRaval]

thanks so much!

[@randyh647]

awesome ... happy Google recommend you based on my viewing habits. lol. still trying to solve my video problem but learned more in 2 days than past 5 months thanks!

[@SirajRaval]

woot, thanks Randy!

[@TheOswald42]

Siraj, you just read my mind, back then I often watch com vs com in fighting games, yeah I know it is weird watching computer playing, but I enjoy watching how AI react to each other, because I set it at the highest difficulty and the fastest AI movement, and the result is fantastic, they perform beyond human level reaction capability, and if both character power gap is close, it is like watching anime fighting scenes for 15 minutes or longer in insanely intense high speed fight thank you for this video

[@SirajRaval]

Oswald that's pretty cool i don't think that's weird. game bots are so fascinating to watch

[@丽明丽明]

how to read web browser game ?

[@alexfern8748]

Do you have links to bots that could play more complexe game, like skyrim for example?

[@harvindersingh5119]

Would love to see Bucky,Harrison and Siraj Collab😁

[@SirajRaval]

would be cool ;)

[@Prashant-ls3dd]

DE-FACTOR [Facts and Mythbusting] bucky from thenewboston?

[@RAJATTHEPAGAL]

Ohh that would be mind blowing. :-D

[@ryanhaberle4884]

i am really interested in this. Mainly the reason I got into programming. Do you have any links that can help me install universe, it is not allowing me with "pip install universe" great video and thanks!

[@yourinfoteacher]

the best and most useful language for bots is Autohotkey(i have some videos about it in my channel)... if you want an online freelancer or teacher comment one of my videos

[@CarlBeek]

Hey Siraj, When do you intend the deadline for this challenge to be? (Please say Thur 15, 23:59 (GMT -8))

[@SirajRaval]

Thursday the 15th at noon PST

[@CarlBeek]

Great, thanks!

[@contractorwolf]

another great video siraj, your speed and tempo are perfect now

[@soffoiramnin5503]

how do you install gym and how do you have it imported with no errors?

[@xPROxSNIPExMW2xPOWER]

the facebook thing running in circle hits too close lmao

[@SirajRaval]

ikr lol

[@poojanpatel2437]

You are great youtuber! Unique way to make video and very good!

[@kamranbashir4842]

I have a feeling that siraj is using a bot which studies different articles on internet, make a video out of it and post it on youtube. Infinite money....

[@SoberCwalk]

Great explanation of universe. Subbed.

[@SirajRaval]

thanks Ernest!

[@frydcircuit3805]

Hey I just found your KZbin channel and I just wanted to say that I really enjoyed this video and found it very informative, keep up the great work ;)

[@SirajRaval]

thanks so much Fryd!

[@Lil__Ro]

Anybody know how you do it for multiple keys? He didn’t explain that

[@gggsayian535]

All aboard to self destructing our world. Once we get to a point that AI will learn to program, we as programmers are out of the picture. GG

[@wobblemanjohnsonheisenberg]

Yo props bro, I'm a ME sophomore and I'm teaching myself basics of python C++ and I'm going to start Java

[@bendiebiene]

I can not import gym and universe... Can someone help me?

[@ratfinkskates]

I just get "connection refused" when running the program... Currently trying to figure out what to do about that but if you know, help is appreciated.

[@ratfinkskates]

Nevermind. Forgot to run Docker.

[@SirajRaval]

cool

[@andyrantshumanphilosopher7571]

How do i feed the data into a neural network? Do i just slap the code for the network on the end of the bot code and tell it that the input is the bot output?

[@tmaz5845]

Can this be applied in RPG games like call of duty,pubg or freefire?

[@danieldossantos5868]

I'm a little confused as to how to run the code. I tried running it in PyCharm and got, *'Error while fetching server API version: {0}'.format(e)* *docker.errors.DockerException: Error while fetching server API version: ('Connection aborted.', FileNotFoundError(2, 'No such file or directory'))*

[@theophiluschambers3628]

"one day im going to make a bot that beats you at any game" I am glad im not the only one that has thought that before....

[@SirajRaval]

so true

[@RahulKumar-yh4ui]

What if I wanted to make an AI for an emulated game, say Pokemon FireRed emulated on any emulator say VBA? How should I go about it? Any ideas?

[@tristant9686]

Nice video! Cool libraries, never heard of them.

[@SirajRaval]

thanks Tristan

[@victoryuwaoma6533]

COOL!!! I subscribed today and i've learnt a whole lot

[@ivysly]

hey siraj. i'm a pretty amateur programmer and I don't quite understand ALL of the concepts employed in the video and the code. what should I do in terms of messing with the code to better understand what everything really does?

[@SirajRaval]

read 'learn python the hard way', watch all my videos and download and run the code locally. you'll get really good really fast

[@ivysly]

isn't that book strictly Python 2?

[@hanyuliangchina]

If do not have your video, others may need to learn over 50 hours. But with your video, opening the door to AI in 5 minutes .

[@SirajRaval]

thanks tony

[@LassiY]

Can anyone help me with universe. I try install with pip install universe and i get install error. I looked up and it have bad support windows 10? Do i have install other packages first or what would i do?

[@OokamiKageGinGetsu]

@Siraj Raval I know diddley-squat about computer programming (other than how to use a hammer to program a laptop to become a perfect paperweight). How hard would it be for someone like me to work with OpenAI?

[@OokamiKageGinGetsu]

@Samurai Jack Okay. I think I'd like to try this. Now, how hard would it be to teach an AI to play Skyrim?

[@royroman6563]

Do you have a source for your historical explanation?

[@USBEN.]

Man you is doing great stuff .

[@joesadaka2534]

Siraj i love your energy!!! keep it up

[@baichoo0441]

Wait up, I have a few questions. What if the game requires other key input, like apart from up in this case? Edit: Also, how do you select other games? Like do I have to build my own system to play GTA for example or is there a way for the AI to support the game directly?

[@andrewkerr9438]

Human: bot, fix humanity. Bot: ok. Bot: preparing for planetary destruction.

[@Frankthegravelrider]

SIRAJ, 'dat content 'doe! All ways with that fresh code

[@SirajRaval]

ayyyy lmao thx

[@Frankthegravelrider]

Sirajology keep it up :)

[@kidpog3d101]

how do you install this library, I get: python -m pip install universe but then it errors.?

[@SirajRaval]

go to the first github link in the description, in the README there are instructions on how to run the demo bot. You'll first have to clone the repo locally, then in that folder you can run your game bot

[@kidpog3d101]

So I cloned it and put it in libs foldre, maybe wrong but i cant use any exe in there or install it with python or whatever ,the command tehy give is syntax error

[@tristant9686]

What sublime extensions do you use?

[@SirajRaval]

I really liked this article and emulated it realpython.com/blog/python/setting-up-sublime-text-3-for-full-stack-python-development/

[@evantino]

I made the code in sublime text 3 but I can't run it using Python. Am I supposed to run it with python? If i am how and if i'm not what do I use?

[@throndaxlostsoul4969]

Does this support any type of game not just the given examples shown?

[@usernamenotfound7901]

can i make a bot to make your video actually good

[@fractalsky2318]

It doesn't seem to run for me. I'm on Windows and I am fairly certain that I have all of the prerequisites installed. Whenever I run the python code, it just closes the terminal immediately. Any troubleshooters out there?

[@Dream-rc2lz]

If i understand we can only choose on this list of game. right?

[@amosnimos]

"and other environment" how do we use it on a specific game ?

[@ErinJerriOfficial]

Where is the protein folding simulation example using OpenAI?

[@SirajRaval]

this is the original one: fold.it/portal/ someone should make an issue in the universe issue, they need a starter example of how to use it

[@InfiniteUniverse88]

@@SirajRaval There ought to be an OpenAI that just focuses on the secondary structure. After that is solved, the AI can move on to receptors that are small and have a recurring pattern such as TLR. A sequence of 20-30 is the size of TLR. More importantly, TLR is already half solved. The algebraic represenation of TLR is LxxN, where L is leucine and N is asparagine. According to "Cellular and Molecular Immunology," the x is a random amino acid. However, this is most likely not true for the same reason the secondary structure is non-random. In regards to the secondary structure, certain amino acids cannot form an alpha helix, because it's geometrically impossible. Similarly, other amino acids cannot form a beta-pleated sheet. "Fold It" and the recent Google protein folding A.I go straight for entire proteins. This is not a logical approach. Only after the secondary structure is solved, does consistently predicting how proteins fold become feasible. Yet, the protein domain i.e small proteins, ought to be tackled before the tertiary structure. Note, the protein domain is composed of 40-250 amino acids. The tertiary structure is composed of multiple protein domains. Google's A.I is the best in the market right, but only approximates. It, and other inferior protein folding A.I even try to predict how quaternary structures fold. These are the largest structures, composed of two dimerized tertiary structures. Of course, the largest and most complex structures ought to be saved for last. Computer programmers ought to heed the protein structure hierarchy mentioned in thousands of textbooks. Only then can proteins be solved.

[@brpawankumariyengar4227]

You are awesome ... funny and informative at the same time

[@RyanRife]

How hard would it be to make the "reward" just to have different pixels on the screen (ie see something different)??

[@SirajRaval]

Ryan that's possible, the whole image recognition system for retrieving the reward is open source, you'd just modify it.

[@RyanRife]

I get that I could do the image recognition, but how do I make a particular frame, or frames, the "reward"? My only thought is to give certain images, like the 'game over' screen a weighted value under/over other non-game over screens. And if that is the case then it seems like there would be two learning machines....one to classify what is on the screen, then another to use those classifications to play the game.

[@bennburke6328]

whoa, was anyone else sent to a completely blank page with just the video as well?? in the right bottom corner was a logo of an escape-door icon, upon clicking it, a dialoge pane asked why I wanted to leave this version...?

[@SirajRaval]

whoah that needs to be fixed

[@Bikumori]

I get an error that says gym isn’t a module.

[@GenAITutorials]

Can I use these Libraries (Universe, Gym) with Python installed on Windows 10?

[@Coolguy123456789859]

There is no official support for it.

[@GenAITutorials]

Okay, thanks. But if I still want to do it, how do I go about installing these libraries in Windows.

[@williamlangdon2511]

I'm not sure yet about Universe, but for Gym, you can just do 'python -m pip install gym' and it'll work!

[@SirajRaval]

dual boot with linux

[@McMurchie]

In 200 years, this will be a youtube video by Sirajology's digital conscience for robots on how to make robot like A.I for their pet humans.

[@SirajRaval]

haha probably

[@RussellTeapot]

"Would you like to make your own pet human? It's super easy, just a few lines of code: import brain import skeleton import muscles"

[@gongaga-jj3ig]

T R A N S C E N D E N C E

[@ma_man]

im not sure if you will see this but i got this situation. there is a game on roblox, i want to farm the same level over and over again with a bot but im unsure how do i make it click stuff like choosing the correct level and moving from point A to point B

[@isensmith]

this is fantastic,

[@SirajRaval]

woot thanks!

[@msorin74]

Question: does this code also work for custom made games in unity engie?

[@BrandNewByxor]

3:51 is strangely hilarious. It's the kind of 2 second clip you could download and use as a shitpost for almost anything.

[@tottiegod8021]

Hi Siraj, I have taken data mining and soon to take AI next semester. I understand the the basics, but I don't quite get why x does y and a does b. In other words I don't have any practical experience besides iris.txt I can relate to. Where can I start making the connections to different techniques used and where they fit?

[@SirajRaval]

wait for my new series coming out in a week

[@nisarullah7734]

hey siraj i can't install the package of universe in pycharm i don't it shows error

[@bossxero]

can we use it with an android game running inside an emulator on windows?

[@bonehawk1562]

If I built a bot that hacks other bots to help my bot learn could I win that competition thing?

[@machapuis]

I saw on LinkedIn that you went to Colombia University to study artificial intelligence. Do you recommend this path? or is university overrated and I can learn with resources online?

[@SirajRaval]

University is overrated and expensive. Find a way to allow yourself the time to study and just consume every online resource you can. Many online courses and blog posts.

[@machapuis]

Sirajology awesome! thank you

[@RyanRife]

The only advantage I could see in going the university route is that you, hopefully, learn how to do the boring math (I can hear the math & statistics people yelling at me already) on paper and you truly understand that there isn't any magic behind "machine learning".

[@ggGalaGaming]

How am I supposed to learn and create AI softwares on windows ? Pls help

[@yourinfoteacher]

hello i am advanced bot programmer and i use for that Autohotkey Language... which is the simplest and most useful language to program bots... i have some videos about it in my channel... if you want freelancer or online teacher i am here.. just comment any of my videos

[@tesohh]

Is there a way to make it work with a game I made myself?

[@XxUSMCForceReconxX]

Could you perform a simple action for King Of Avalon? I need to create bots for my farms

[@yourinfoteacher]

i am bot programmer and i use for that Autohotkey language i work online as bot programmer freelancer and/or teacher if you worried about that comment any of my videos ... i have some Autohotkey videos in my channel you can watch them :)

[@PrimaDel]

how to run it on windows?

[@RussellTeapot]

unfortunately, on the github page only Linux and OSX are listed. So..I know it's not on Windows, but one option could be use a virtual machine

[@tarunbirgambhir3627]

can it be done on a wsl?

[@nano7586]

Oh man, i was hoping you could apply this to applications on your pc too (not just flash games)

[@AnonymousAccount514]

What about the bots in fighting games like Mortal Kombat...do those use the same if/then logic?

[@curiouskid1547]

Well I was searching how to make an AI for my game. Is there a way to have the bot as part of the game the users can play against?

[@b_xcon4428]

hi can you make a bot that hits 80% of his shots and moves and dodges shots automatically?

[@willscarcast]

How can I get this bot to play a game that I have downloaded?

[@state_of_the_Art712]

whats the game @1:00?

[@Michael-hw2mp]

File "demo.py", line 8 action_n [[('KeyEvent', 'ArrowUp', True)] for ob in observation_n] ^ SyntaxError: invalid syntax help i dont know how to fix this

[@josephwhite4933]

Can I make a bit that talks and free thinks if I’m super advances

[@omarpasha2968]

I wrote the code exactly as you demonstrated: import gym import universe env = gym.make('flashgames.CoastalRacer-v0') observation_n = env.reset() while.True: action_n, [[('KeyEvent', 'ArrowUp',True)] for ob in observation_n] observation_n,rewrd_n, done_n, info = env.step(action_n) env.render() I then ran in in my terminal, and nothing happened! What did I do wrong?

[@himself99]

Your humour is awesome!

[@Shogoeu]

Technically it's not a 10 line code since all the functionality of your bot is implemented by an external library, what you made is the interface that connects the game to the actual "bot".

[@ciberglo]

Siraj, what do you think would be better to classify a group of sensors captured each second? I.e., their values and the latest 10 groups (seconds) might interfere the interpretation.

[@downthelead4386]

loving the revolution 9 part in the beginning!

[@SirajRaval]

haha thanks!