OpenCV Python Neural Network Autonomous RC Car

[@tanvirchowdhury1518]

never wear a green outfit infront of this car

[@randhir4278]

Tanvir Chowdhury lolololololoooloo

[@science_mbg]

but it recognizes rectangular traffic light shape and recognizes green light later. Not all green things. It should be under that shape

[@ThatGuyDownInThe]

@@science_mbg what is with programmers and jokes flying 3,000 miles above there heads

[@science_mbg]

@@ThatGuyDownInThe coundt get it that he might be sarcastic my bad

[@ThatGuyDownInThe]

@@science_mbg now I feel mean :/

[@pedroam7218]

Fake. There is a small person inside the car

[@HaiPham-nv3yb]

lol i'm dying

[@warclown9419]

😂😂

[@rocking1833]

Oh! Are you in that car?

[@kermitinmountain6371]

🤣😆😂🤣😆😂🤣😆😂

[@TintuVlogger]

😁😁😁

[@henson2k]

Perhaps the only self driving Range Rover out there ;-)

[@landroverfriends]

I am studying Embedded System Development and I would find it awesome to go working for Land Rover. So maybe in the future there will be ;)

[@TheGrayWolf81]

Lucid Gaming No please don't work for that awful car company. I'd rather work for a company which makes reliable cars.

[@landroverfriends]

TheGrayWolf81 Whats the problem you had with the brand?

[@TheGrayWolf81]

They're just unreliable cars. My friend got a brand new one not too long ago and it's already having problems. Any other person I've known who has one has had problems with it (although some older models are nice and don't really have problems). I've never had much luck with English/British cars :/ But there are probably other people who love them and haven't had any problems yet. If I were to buy or do anything with a car, it'd be a Toyota or any other Japanese engineered car. They're the most damn reliable car I've ever owned and seen.

[@Jadanti6]

Why do you have a verification badge

[@tarunalakhramsing7861]

The Car is a paid actor

[@kakulmeow]

Can confirm. I was the camera

[@AniketDEV]

*why don't you make an udemy course on this topic!!*

[@kressckerl]

Because udemy is a platform that isnt to creators advantage, find a different platform

[@jayamankrah4328]

Sound pretty good

[@hdang1997]

@@electronicsengineering7375 Thanks mate!

[@centaurirobotics87]

Hey, check this tutorial series to make your own autonomous mobile robot centaurirobotics.in/learn/

[@HalloweenJoni99]

There is a github repo linked in the description. Just read the code

[@Tymczaq10]

imagine making few of these cars and making mini city, then upscale this

[@animee2003]

It takes more time

[@geryfabrega6749]

The impressive part is that this was made 5 years ago before all these easy to use libraries.

[@KevinMsyah]

How did they managed to build it back then??

[@tecxtreme]

They mentioned Opencv

[@Grensom]

Great Job!

[@deepL0]

Im your follower and like you

[@cybercodes369]

This game is amazing . Check it out kzbin.info/www/bejne/g33Gpmapd7Cbmqc.

[@benitokim1793]

@@cybercodes369 Why should I trust a Microsoft Spy?

[@cybercodes369]

@@benitokim1793 ok then keep sucking 😎

[@apoorvpathak5378]

This Guy: I finally did it. Stackoverflow: [Leonardo DiCaprio DRINKING MEME]

[@Jaxenormus]

PewPewZee LawL I'm not sure if you were joking or not or if you are a programmer but trust me, this was a joke lol and is probably correct

[@dragonlordsaviour7005]

nice

[@Rether16]

Wow awesome work! Seems simple to most people but there is a lot of logic going on behind the scenes! Love it!

[@shiva9989509341]

please make an instructable

[@anubismva]

Shiva Kumar Read his paper.

[@harshitsomani1717]

Where can we read the paper

[@TehDanny]

@@harshitsomani1717 It's the last link in the video description.

[@NaturalKiller]

People like you who perhaps do not have all the technical and financial support that could have, are the ones who truly make the future since with less they do much more, the truth my brother I congratulate you

[@toadiri]

congrats for this project dude. it's really brilliant and thx for sharing your work. u rock !!!

[@darshank9659]

Wow first I was getting old videos in recommendation and now I am getting the same video that I watched years back giving me LOL and nostalgic feeling altogether.

[@fengyouliu8937]

1:43 the fact that it knows that there is space in between the obstacle and itself is pretty great, I though it had to wait until the obstacle was out of the frame.

[@haroonrehman8156]

It's using Ultrasonic sensor to measure distance between obstacle and the car itself

[@illuminated2438]

I absolutely love the fact it's a red Range Rover. The most awesome vehicle out there and quite possibly its best color.

[@171Manoj]

Excellent work , image processing at its best . May I know how did you measure the distance between the car and Signal post ??

[@wangzheng7526]

Measure the distance between the camera and the bounding box of the detected object.

[@EliteCubingAlliance]

Distance is one of the easiest things to do

[@AryanKapur0605]

@@wangzheng7526 Can you please make a tutorial on this

[@MuhammadBilal-lp8xx]

i am computer vision engineer myself but this work that too 5 years past,,, this work of your astounds me

[@reyou7]

Can you make step-by-step video tutorial for this? This is just amazing.

[@kratikapatidar336]

yes plz send step bystep this projcet

[@pperez1224]

Sure , you just have to pay the price , you beggar!

[@joelapin953]

kzbin.info/www/bejne/fZ_Rd6xmqquYaac

[@reyou7]

@@pperez1224 🙄🙌🤬

[@kirangowda624]

This is the genius . Keep up the good work. This kind of videos motivates young programmers .

[@centaurirobotics87]

Hey Kiran, if you plan to make your own autonomous mobile robot you can check this out centaurirobotics.in/learn/

[@eldhokurian5781]

Please make a step by step video on how to make this

[@birdost4872]

Yes such tutorial will be a big step for the losers like us

[@limitless1692]

step 1 learn python step 2 learn aboun artificial neuronal networks ( the algo behind it ) step 3 code it , make mistakes , find them and solve problems easy !

[@zes3813]

Bir Dost no such thing as l /w, just you are loserx or step by othersx, stupidx

[@RobDawsonjr]

Looking at the source code, i believe its a Haar Cascade

[@elprofessor7000]

@@limitless1692 i know python ....and some of it frameworks...i want to do AI but i don't where begin

[@AyushSharma-dn5mo]

So who made this is a "man of culture as well". P.s. The song in background is "Holding a Card File" from Hunter X Hunter Original Soundtrack.

[@ibrasome4492]

Yeah, it's in the description!

[@colegartner3339]

This is the task that many beginner python programmers feel like they're ready for after making a "Hello World!" program

[@AhmetOmerOzgen]

Arduino, sonar range finder, camera, opencv, pwm, lots of effort knowledge and intelligence. Nice

[@devansh8095]

Me: still Print("hello world) Output: Error EOF while scanning Computer shutdown Edit : oh need to edit this ... Guys I am trying to make a dumb joke and u guys are replying that" this is correct this is wrong"....... I know

[@kennydiaz3080]

print() can’t be capitalized. And I did get the joke.

[@devansh8095]

I know guys what the error I am just kidding. I am also a python programmer, And about 'p' it's is becoz yt comments

[@EigenA]

Wait I got it........... you are passing a double float. Please convert to cell array and import fun functions. Can you believe I failed my programming course work?

[@lowrhyan567]

def Print(text): print(text)

[@pmunozuio]

Which is the program in that's compile the program the raspberry??

[@Qimchiy]

Now you can recreate that GTA SA mission with the RC helicopter carrying barrels.

[@hardikshettigar1644]

That was in vice city 😂

[@hardikshettigar1644]

@Hot Dog Oh, one in VC was to carry bombs.

[@OmkarShinde22]

This is awesome! Please make a detailed video series on this project.

[@raghudatheshgp6231]

Nice work Wang it's good to see that you are sharing your knowledge with world.

[@centaurirobotics87]

centaurirobotics.in/learn/

[@cherubin7th]

Looks like it only stops for obstacles, because of the ultrasound distance sensor at the front not opencv.

[@annaanna3260]

Imagine having like 20 of these cars you could simulate road traffic with it

[@TobiasLeininger]

They would all interfere with each other as he uses an ultrasonic transducer on the front that can't handle that. And the car doesn't look for other traffic at the intersection. And so on ...

[@lvladimirov]

Looks great! Next step would be to get rid of the IR proximity sensor and detect obstacles via the camera alone.

[@lissobone7635]

I am just so happy that there is no Windows.

[@zivcaspi4996]

Is the sterring made with a servo motor?

[@riteshmaheshwari5882]

stuart little was there in the car.

[@shobhitgupta1119]

I am working on a similar project to build a 1:10 scaled autonomous robotic car. I am finding difficulty in choosing the camera for our car, Can you please let me know about the camera that you are using, is it a monocular camera? It would be a great help to me.

[@wangzheng7526]

I used a raspberry pi camera module. Yes, it's a monocular camera.

[@shobhitgupta1119]

OK thanks for your suggestion. Actually our car will have a speed of 5-15m/s. Will the capturing speed of raspberry pi camera will suffice for our case?

[@wangzheng7526]

I think that really is up to the processing power of raspberry pi. Using a lower resolution can help a lot.

[@barraolivier2582]

No, no, no. An R34GT-R will never be an obstacle in front !

[@nicethobababro8262]

True

[@sidneybernardin6484]

Finally, technology and Hunter X Hunter combined.

[@truthinck8853]

I'm curious to know why you chose mono vision instead of stereo vision?

[@Aterrebgnuoy]

He probably wanted to use that Raspberry Pi which only supports one camera at a time. Therefore, he used the ultrasonic sensor to detect depth instead.

[@freezerbdn8358]

Aterrebgnuoy you can use 2 camera using USB

[@Dxeus]

Distance Measurement Raspberry Pi can only support one pi camera module. Using two USB web cameras will bring extra weight to the RC car and also seems unpractical. Therefore, monocular vision method is chosen. zhengludwig.wordpress.com/projects/self-driving-rc-car/

[@x218_ch]

There was no need for stereo vision. Stereo vision of for depth sensing and wider FOV. The ultrasonic sensor does the depth sensing while the FOV is good enough. So no need for stereo vision. FOV- Field of view

[@farazmehdi9019]

Yes it stops at red and goes at green. The big question though is if it speeds up at yellow! On a serious notes, great job!

[@lrw0475]

That's an incredibly great piece of work. I'm wondering what the car will behave when it sees a car with a red light or a "stop" sign on the back?

[@samanmilani5802]

That nissan skyline gtr r34 just looks amazing

[@abhishekkk95]

Plot twist : A guy was controlling the car using remote

[@AhmedAymanM]

Why did i Just start loving OpenCV and going to learn more about it?

[@YurkerYT]

Damn! you are good, Google should hire you to collaborate on their Autonomous car project. What's next? Autonomous drifting Nissan r34?

[@wangzheng7526]

YurkerYT Haha, good observation! Maybe 86 as it's easier to drift... ?

[@Ak-yz6td]

Yea they would hire if he did it 30 years ago

[@ManojFB]

Wang Zheng would you please share some tutorials. I am Python developer and I am interested in this field. please share some useful tutorials..

[@rizeadhikari5073]

Bro once you learn raspberry pi learn opencv machine learning and neural networks you will able to create this and more than this don't learn to make only a make your base strong you will able to make thousands of projects

[@rey1242]

Except that good dont meddle in such basic things, and instead research more professional and complicated works

[@GonnaLoveThis]

I love most of the demos in your video, except red light demo at 1:34. Why don't you wait for the green light?

[@sinapi6031]

In Soviet Russia, the car drives you

[@prateekpanwar646]

LOL IDK Why Russian drivers are considered very bad

[@sinapi6031]

@@prateekpanwar646 I guess that joke could be switch to Communist China drivers now In Communist China, the leadership drives you

[@matveynelson2489]

пошел в жопу

[@timurbadretdinov9555]

@@matveynelson2489 АХхахаах Бум

[@matveynelson2489]

@@timurbadretdinov9555 ?

[@researchitechindia]

Wow a plend of neural and sensors it's great to watch

[@TanveerAhmed-yi9tq]

Wang Zheng bro can you share the paper ? the link you have given is not working

[@RicoNNect82nd]

I like how this is build up. Using every single item you find in the household, ordenary cardboard, tape, womans hair bands... This is exactly how I would build it :D

[@guaren6611]

:o I remember I saw this many years ago, and it was my inspiration to do an AI course and learn a lot. I never got to do this though, hope I can soon!

[@odiljanandith3817]

There is a MIT OCW course on AI. Course Number 6.034 It is FREE. 🙂

[@bastiannenke7101]

Respect. I don't understand much about programming but i bet it was a lot of work. And it's awesome

[@mamertvonn]

"Mom, can we have tesla at home" "We already have tesla at home" Tesla at home:

[@ThecreeperKiller1234]

Only one thing left to do, make it smaller, try to fit the gear under the body of the car, I would say its hard but looking at what you have done here I think you're up to the challenge.

[@raz0229]

Incredible Peace Of Artwork There!!!

[@tdharmendra3204]

Good work! Way too good to see some of the common sensors act too smart!

[@ParadiseQ]

I found this project interesting. However, it seems that there is no motor control from the Arduino or Rasperry Pi. I guess you are transferring the wireless signal back and using the remote the control the car...

[@RachelPecio]

there is motor control for RPi ;)

[@israelgoytom6085]

NO You are not right

[@Chrrvn]

So why there is ultrasonic sensor in front of the car ?

[@dannyc3124]

It could be one of those little black box droids from Stars Wars for Halloween.

[@avy0010]

It's 2018 Now that car is flying

[@shamirafridi4734]

It's 2020.. This car is in space now

[@richakumar9703]

Its 2020 june, the car has travelled to parallel universe and came back

[@Sanjar50bay]

Great job! Excellent! One moment... In real life if there is no stop line, you should stop near traffic light, in one line. But it's a small issue)) Good luck!

[@MrJohn1966elliott]

what about keep left or right ? Like Australia is left drive, scan to left edge of road. ………. American is right drive.

[@Crucizer]

This isn't funny.

[@derschwarzejulian7201]

So he used a Hunter x Hunter Theme to describe the epicness. Smart!

[@lalala213]

I read the description of your project on your wordpress and have a question if you don't mind: For your training dataset of input image and output direction input, did you hand label each of the images to have a certain output? For example, if the track is a slight left turn, did you take, assuming 10 fps, 30/40/50 images and hand label each to make a turn when you feel it is appropriate to make a turn? Thanks and great work!

[@ThingsMihirDoes]

I am curious to know about this too.. Is the training data hand labelled or you trained it by controlling the car via RC..

[@lalala213]

I just found out via his github and it confirmed my suspicions. He trains manually, saving a training image whenever he makes a keypress.

[@oggy112]

Nontheless still an impressive piece of engineering. Whatever you do in life there's room for improvement, he can improve the training.

[@gurribuy]

what will happen in low contrast situation, will the system perform as good.?

[@twinklingstar2082]

Actually this project is quite simple. It has been just elegantly displayed.

[@shoemakerleve9]

Okay then explain the control system architecture, how the CV and image processing works. Could be easy but I'd like to hear!

[@Eonz]

Why is there hunterxhunter music in this video ?

[@TheDiamondGames]

Whoah! That is impressive! In fact, incredible!

[@ShoeAlmighty]

came for the opencv, stayed for the tunes.

[@91722854]

dayum computer science rules, I a mech eng student and seeing these just made me feel that I'm ignorant. btw I am truly interested in machine learning ai and robotics, hope to work with u in the future if we ever get the chance.

[@ashikanupamdev1768]

Great.❤️ WHY IT IS RECOMMENDED 5 YEARS LATER ALSO.🔥 🔥

[@harrymakongwa1147]

Me:Watching a Remote controlled car yet it's called autonomous at 1am . Tesla entered the chat . Elon Musk is typing ...... Elon Musk: I need you at my Tesla Gigafactory in Storey County,Nevada

[@Soumya16]

😂

[@0xbitbybit]

So the neural network part is OpenCV recognising the lights and color and the "white lines" on the road yes? Because the rest seems fairly simple with the sensor on the front just reading distances and stopping.

[@wangzheng7526]

Correct, it's a standard implementation of neural network in OpenCV.

[@r.taufikutomoiswanindrakus8538]

imagine elon musk copy his code for tesla car

[@DavidJJJ]

Elon Musk has some slightly better hardware and software than a crappy Raspberry Pi and open source computer vision software.

[@icarus7471]

Great job brother I am truly amazed. I also thought of this kinda idea but didn't give it a shot.Great job man ,great job !!!!

[@alexdeshift6733]

I am buying ruspberry. Looks really cool. Like.

[@budirahmani]

Nice work. I've made a vision based distance estimation using stereo camera. I really want to learn opencv and python when I do my research, but I learn slowly. It's look very cool. Hopefully I can learn the theory

[@vivekpal9866]

Same

[@haroonrehman8156]

If you want to detect distance based on camera you need to use two camera to perform sensor fusion, just a single camera is not enough to measure a distance.

[@yogeshkawar]

background music is lit..🔥🔥

[@amoyymalik]

Tarzan in start up? Haha. Great jobs! Its actly 5 years ago.

[@husseinalaa47]

+Wang Zheng Thank you Wang, Would you tell me you training code that you used to train you haar classifier? I am working on same project and this is my training code: opencv_traincascade.exe -data hussein -vec sam.vec -bg neg1.txt -featureType LBP -numStages 6 -miniHitRate 0.999 -bt DAB -maxFalseAlarmRate 0.5 -numPos 900 -numNeg 2550 -featureType LBP -w 35 -h 62 -mode ALL -precalcValBufSize 1024 -precalcIdxBufSize 1024 and this is my makesamples code: opencv_createsamples -info pose.txt -vec sam.vec -num 998 -w 35 -h 62 but my classifier is still wont work well. last quesion: How did you calculate minHitRate, numStages ,FalseAlarmRate, numPps and numNeg? Thanks again

[@wangzheng7526]

+Hussein Alaa Here is the training code for stop sign (on mac): opencv_traincascade -data data -vec samples.vec -bg negatives.txt -numStages 20 -minHitRate 0.999 -maxFalseAlarmRate 0.5 -numPos 800 -numNeg 400 -featureType HAAR -w 20 -h 20 -mode ALL -precalcValBufSize 5120 -precalcIdxBufSize 5120 You need more stages to improve the result, I chose 20 stages (in fact, at stage 16, the acceptanceRatio is 400 : 8.33416e-05, which means the result is good enough, a couple more stages won't help much). Also, you might want to try HAAR featureType. LBP is good if you have high quality samples. The advantage of using LBP is not very significant in this stop sign case as it didn't take very long to train. Keeping your sample size small will reduce training time dramatically. 0.999 and 0.5 are the common values for minHitRate and maxFalseAlarmRate set in training. You can read some articles about adaboost to dig more. Below shows the final training stage status of stop sign: . . . ===== TRAINING 19-stage ===== Training until now has taken 0 days 0 hours 16 minutes 1 seconds.

[@pranavsridhar5241]

Hussein Alaa I’m also working on a similar project. Can you send me the documentation for your project? I’m having problems with Numpy.

[@alexanderzawydiwski9534]

Just trying to find the right code and the right code to do it in

[@awaisahmed5489]

PLZ SAHRE WITH US YOUR PROGRAMMING AND FROM A to Z, HOW TO MADE THAT CAR

[@EigenA]

came for the engineering stayed for the song

[@gianlucagrasso620]

Can i use a normal webcam instead the raspberry one?

[@israelgoytom6085]

yes, but you should change the code in Streaming

[@brhanudegene5037]

have you tried the code??

[@brokensilence8587]

the algorithm explanation will be much better than music

[@Jezismdllin]

That’s how Tesla begin with the cars 🚙

[@woolfel]

Pretty cool, I was thinking about doing something like this back in 2015 and did some testing to see the feasibility of building autonomous racing robots with raspberry pi. The performance of python with openCV was too slow to process 30 frames per second based on simple benchmarks. I thought about off loading the image processing to a workstation, but decided to wait until raspberry pi got a faster processor. With raspberry pi 3 B+, I think it has just enough power to do it all on board without offloading the processing to a desktop or workstation.

[@___OmerAJ___]

great , it needs speed limit.

[@wesleycatlett9144]

These on a model train layout would be nuts

[@Bisofication]

That R34 though

[@mattiasconte8628]

Please build a CITY of that (kind of 30 or 50 cars going mad around blocks, stopping and going with lot of signals )

[@muhammedsajid]

Plot twist : a person is controlling that car remotely 😂😂😂😂lol

[@tnvmadhav2442]

Make an adjustment tweak to read speed limit signs and conform to that speed limit....that would be an awesome version 2.0

[@SpotTiger]

Very impressive! 🤔

[@prajwalsood1350]

The way you have designed your setup, neural network wouldn't be necessary, using binarization and the high contrast b/w the tape and wood plank can make for easy detection. I made a similar project on a AAA pc game and used only the game frames and opencv and edge detection to steer the car only using the angle b/w the two lines of the road, to determine the direction of steering, while limiting entire setup to a fixed speed. To control the speed of car, one has to go for neural network, but that wasn't required in this case I guess... Planned to write a blog but I was too lazy

[@IgnoreMyChan]

Most annoying music ever, though!

[@mehmetnuriozdemir3933]

Dude wtf, I was just checking the comments to find out the name of the song and this is what I run into :D

[@ryandirgantara9860]

its an hunter x hunter OST called holding a card file :)

[@Drill-ing]

HI *Wang Zheng* how much images take to train the model 👍👍👍👍👏👏👏

[@devintham1335]

Can anyone tell me is arduino uno necessary in this project in order to control the RC car? Thank you.

[@RaduGavry]

Please, can you show how you trained your haar cascades for the stop and traffic lights?

[@praveenkhanna783]

can you please help me on making host and port connection between computer and rasbperrypi

[@abhishekbharti8353]

really nice work bro i was thinking about it that someone will definitilly have done it and then i find this video

[@luanz.9167]

You could put more 2 lateral cams and do a panoramic vision, that see if there are objects coming in the sides.