AI Cars learn to drive - UE4 Blueprints

Using UE4 blueprints, machine learning and genetic algorithms, I created a car which learns to drive a track.
It uses a neural network with 6 input nodes, 2 hidden layers with 6 nodes each, and 2 output nodes. Each hidden node and output node also has a bias.
A population of 19 cars run simultaneously (but do not interact with each other). After each round, the top 5 cars are chosen based on their fitness score. Their neural networks are mutated randomly by 10%, and they form the next population.

[@SynxVII]

would really like a good tutorial on how to make something like this with blueprints

[@dankpotato9578]

This is probably not blueprint based.

[@bingbongbangbingboom]

@@dankpotato9578 It is.

[@_FLOROID_]

@@bingbongbangbingboom the machine learning part isn't

[@bingbongbangbingboom]

@@_FLOROID_ oh

[@joantonio6331]

Honestly that does not sound too complicated, line traces then orient the car where the trace do not hit... If none hit the keep straight

[@TheEclipse1989]

Did you ever think about scaling rays according to speed? So if it drives faster it can detect the walls earlier on

[@lucasromano2795]

This reminds me a Genetic Algorithm. I once implemented something similar but individuals should learn a way to escape a labyrinth without going through no exit paths. Very interesting.

[@badrequest5596]

i did something very similar a couple of years ago too, but in full c++ which is more versatile and readable in making a neural network. but because it was being a little slow to understand to drive in a straight line instead of zig zagging i fed it some recorded data of me driving and let it run through that data and decide for itself. much faster results

[@davidestiz9672]

@slothfulstudios are you available for new projects?

[@yannmassard3970]

u can t do machine learning with Bps only (unless you go full math). That s a very, very cool video. I wish UE had python support.

[@badrequest5596]

u can write the neural network into c++ as ue4 classes. that will take some time though. i did that from a c# neural network i had for unity and re-wrote it into c++

[@travesty-studios]

Should try on different maps as well

[@giadonovan233]

But, how to do it with Blueprints?

[@maddiehad]

it appears to be memorising the track but not really how to drive.

[@xianweiwu1843]

Wanna know what activation functions you are using lol

[@tanzhang4994]

Damn,this is so cool

[@DarkRodFR]

share project for learn please :(

[@bernardosardinha]

Cool! But...What´s going with the music? O.o

[@boquangdong]

Canh you show me your code

[@mb.3d671]

How would you even start this lol

[@mp3ha]

hi very good can make video tutorial for this video thx

[@RobertAllsopp]

hey any chance you could make a tutorial on how it was made ? i cant find any good videos on machine learning with blueprints

[@neillunavat]

You can learn Neuroevolution at YT channel called Coding Train. This is Neuroevolution... Genetic Algorithm and Neural Networks... After that you should learn c# then you will get it. Its easy.

[@RobertAllsopp]

@@neillunavat This isn't a form of being selfish we are here because we are looking to learn in the first place. and yes since I posted that comment 11 months ago I have been able to recreate this and build upon it because I found more resources and learning material.

[@Simon-pi9qx]

@@RobertAllsopp can you help me to search for more information about this ? Please :)

[@neillunavat]

@@Simon-pi9qx bro i just gave all info u need. Search the terms on google and youtube. Ull find your path.

[@HaloDude557]

@@neillunavat you gave terrible info. Genetic Algorithms are not very good. I am interested in if the video uploader used back propagation. Also, this is UE. No C# at all.

[@FINALFORMSTUDIOS]

Would love to try this out. project files by any chance?

[@williambeaulieu2046]

How Do you calculate the fitness score to know which 5 are the best

[@AVANLOR-qx1cf]

How to make?

[@MrMoonwalkingBear]

I liked the song and also want a tutorial please.

[@LuukAsh]

kzbin.info/www/bejne/l3SZhJKMqreBfc0

[@mikethegamedev]

@@LuukAsh it's tutorial not music!

[@NR_5tudio]

BRUH try to make a simple tutorial ....

[@UnrealSolver]

Dang mate, that's hella cool! 🔥 Was working on something similar in the past but instead of learning the vehicle was just 'seeing' its surroundings and was setup a way that it will react to the environment and finish the race, but your Machine Learning thing kicks such idea up to the sky!🔥🔥🔥 Great job!😎

[@sedatbilece]

can you share doc. or project file please ? for the analysis

[@hasanrizvihr]

This is amazing. If i may ask when are you releasing the tutorial? 🙏

[@mike_gread]

little advice : make the car spawn at random locations on the map

[@NOTORIOUS4545]

But will it drift?? …

[@marcthornton2900]

Another request for more info / tutorial on how to do this in bp's or project files. Thank you.

[@xianweiwu1843]

neural networks lol