Machine Learning on Arduino Uno was a Good Idea

More about the project: indystry.cc/ml...
The journey of teaching a robot to drive autonomously on a race track!
Tools I use:
LIDAR: amzn.to/3sFHgwH
Arduino Uno R4: amzn.to/46plJar
Breadboard: amzn.to/3Rh1sPZ
ML book: amzn.to/44Msv8P
Standing desk: amzn.to/3PAmh7q
Mouse: amzn.to/3EwTb2C
Desk lamp: amzn.to/3r7JlRI
📰More info: indystry.cc/ma...
🛠️ Indystry: indystry.cc/
🤖 OpenRoboticPlatform: openroboticpla...
📷 Instagram: / nikodembartnik
❤ Patreon: / nikodembartnik
GitHub: github.com/Nik...
✉️Business inquiries: [e-mail]
Subscriber count at the time of upload: 114 418

[@nikodembartnik]

More about the project: indystry.cc/ml-robot/ Happy making!

[@blaircox1589]

After years of having the equipment laying around, I've finally begun to dive more into creating robots using lidar. So I'm curious, is there really machine learning involved (required) here? Or is it just saying - here are solid obstacles on either side, I need to stay N distance away from it while I travel forward.

[@1islam1]

@@blaircox1589 ⚠️ God has said in the Quran: 🔵 { O mankind, worship your Lord, who created you and those before you, that you may become righteous - ( 2:21 ) 🔴 [He] who made for you the earth a bed [spread out] and the sky a ceiling and sent down from the sky, rain and brought forth thereby fruits as provision for you. So do not attribute to Allah equals while you know [that there is nothing similar to Him]. ( 2:22 ) 🔵 And if you are in doubt about what We have sent down upon Our Servant [Muhammad], then produce a surah the like thereof and call upon your witnesses other than Allah, if you should be truthful. ( 2:23 ) 🔴 But if you do not - and you will never be able to - then fear the Fire, whose fuel is men and stones, prepared for the disbelievers.( 2:24 ) 🔵 And give good tidings to those who believe and do righteous deeds that they will have gardens [in Paradise] beneath which rivers flow. Whenever they are provided with a provision of fruit therefrom, they will say, "This is what we were provided with before." And it is given to them in likeness. And they will have therein purified spouses, and they will abide therein eternally. ( 2:25 ) ⚠️ Quran

[@jongwonlee4728]

can you create Tubercle + Toroidal version fan...?

[@jeffstewart7698]

This is really exceptional work. I love how your thought process is always generating the next possible improvement, and then you just keep pushing to refine your designs.

[@rileyellis1623]

New subscriber here! This is a fantastic project. I just came to this video from the one where you raced two of them, very cool stuff. I am working on a similar project using an RP1 LiDAR with a differential drive robot as a learning platform for things such as SLAM. I am not too familiar with ML. Do you have any favorite resources or project ideas to get begin learning?

[@sendhan6454]

Haven't been doing robotics for a while and this is one of the coolest videos. I got recommended.

[@sorryboss8550]

I’m trying to start bro it’s so cool. I just got my learners kit

[@bofa722]

​@@sorryboss8550 where from

[@sorryboss8550]

@@bofa722 anywhere, got mine from a store near me👍🏽

[@nikodembartnik]

For all Polish people! I started a new polish YT channel: www.youtube.com/@prosteczesci

[@TheSelfUnemployed]

On an Arduino! I am grabbing a LIDAR module as soon as possible. Thank you for the videos.

[@kevinlind4640]

The most intriguing thing about this according to me is realisation that you could work leanly with data sets. Yes, within a certain dataset eg. maze (the square one for example) you want as many laps as possible, but for industrial purposes keeping the the amount of mazes down when you know what kind of mazes the robot will encounter should also avoid bloating the Arduino with unnecessary data. Also, truly amazing that you made a robot that could race faster by itself than you could race it manually, just by tweaking the motor speed. That goes to show what machine learning can do in terms of work optimisation, sort of like how the search function on a computer vastly outpaces any human manually searching for a document in an archive room. Thank you for making a video that clarifies so much with so little!

[@fastyrapz0]

Had a look at the RPLidar DataCollector code, what is the purpose of setting the Lidar resolution to 240? Why not set it at 360 degrees?

[@scaletownmodels]

Very cool. I've been programming for a little over 40 years but I've never had the time / opportunity to delve into machine learning. Closest I've gotten is using AI services for photo processing. Now that it can drive itself it would be an interesting progression to give it memory of where it's been, building a map of the course it travels and being able to use that to plot improved trajectories for future loops. Just like we're slow when traversing unfamiliar territory but with repeated trips we can anticipate and optimize our course. You should be able to borrow from tech such as CNC path processing which can optimize acceleration / deceleration for curves and apply that to steering. Just an idea.

[@pfever]

First time I see your channel, this is great! Awesome work !

[@droko9]

I wonder if you could set up virtual race tracks in something like Unity to collect training data. The benefits would be that you could control it with an actual controller and from first person ( so better precision ), and you could have much larger and more complicated tracks

[@conorstewart2214]

Nvidia have created Isaac Sim for that purpose, it can even generate photorealistic images on the environment for training but just using a distance sensor like this should be easy to implement. It is made for training ML algorithms so can generate the training data and train the AI and can even do things like reinforcement learning, genetic algorithms or similar.

[@aayush212]

​@@conorstewart2214That's really great 👍. Is it open to use for free?

[@user-qw1rx1dq6n]

At that point it would be possible to run ppo with a neural network instead

[@patrickjdarrow]

Great project. The reason it was able to handle the increased speed was twofold: 1) the control dynamics were similar enough at both speeds and 2) the sampling rate was high enough that the time delta didn't have an impact on the stateless prediction model.

[@micahmock3505]

5:09 "I'm not an expert... I'm just learning and experimenting by implementing some machine learning in my projects."

[@midnight121190]

“I am an algorithm I need more learning and training” ❤ cheers to you!😊

[@christophersmith108]

Watching this, I was shocked to realise that you don’t have a million subscribers. People are missing out!

[@frafracho473]

In general I just take inspiration on KZbin to make my own projects, because it’s not exactly the way I would’ve done it. But for this robot, I would’ve done it exactly the same way if I had the idea, so I’m going to do it anytime soon ! Thank you very much for this cool video, and congratulations, that’s impressive !

[@nikodembartnik]

Huge thanks for a really nice comment!

[@CraigHollabaugh]

This was awesome, congratulations! I've used o-rings for tires for 3D printed wheels.

[@nikodembartnik]

Good idea!

[@Woodrina]

Thank you for helping me ❤❤❤

[@RajveerSingh-vf7pr]

Damn it, I learned arduino nano... I should have learned uno like you, Senpai... 😂

[@JeromeDemers]

Really like the ghost version when comparing the speed. That was nice. Make a other one and see if you can train to pass slow robots.

[@dragosbogdan3450]

Hi. You can make a smart vacuum cleaner with automatic cartographer on sd card?

[@abushsemahegn2124]

Wow! Thank you for this amazing video. I was always wondering how lidar data is being used to train machine learning models. Most of the ML tutorials are object detection using images.

[@MisterkeTube]

Would it not be easier / faster to generate the features via simulation rather than you driving by hand? That way you can train on way more tracks (as they can be pseudo-randomly generated) and also have the simulation provide feedback on collisions when driven by the AI model.

[@bilaloguk8583]

We are Fatsa Science High School artificial intelligence and robotics club students. We want to improve ourselves in this field. We liked your project very much, we bought all the materials needed for the project and printed 3D prints. Could you please send us the circuit diagram of the project?

[@BeatrizPinoMamani]

Please can you tell me if the Arduino supports the amount of data from the lidar? because the arduino will have to control the motors according to the lidar data,.Really. I would appreciate your response.

[@WawanSetiawan-xn3ke]

Sukses selalu semoga ilmunya berkah pa. Salam kenal Kami mohon izin ikut nyimak videonya...

[@nunnakalyan2536]

can any one provide sources for setting up the robot (like tutorial thing) or any assistance

[@patrickrotter515]

Since I’m not playing with such things my question is: Why do you have to train it? Since it got a radar just tell it not to come too close to something. 🤔🤷‍♂️ So easy 😜

[@papa-dt1cv]

How much please. OK to advise what parts to buy or used parts and where please..eg lidar. Have u tried used vacuum cleaner lidar too?

[@havidfernando5795]

Hello sir, can you share how to convert Python to Arduino library, and how to apply it?

[@emrengineer]

hello , if I want to measure the density of traffic on a road, what kind of system can I install? i want something low cost and functional. it should be a system that can transmit this density to another device and show the density. i would be very grateful if you help me. lidar sensor is used? which one do you think is advantageous?

[@CornHub18]

Nikodem a zrobisz jakiś film po polsku? proszę

[@nikodembartnik]

To cię zaskoczę :) Od pół roku regularnie robię filmy po polsku, tutaj je znajdziesz: www.youtube.com/@prosteczesci

[@jongwonlee4728]

can you create Tubercle + Toroidal version fan...?

[@usatheesh7779]

Is it possible to make the same project with multiple ultrasonic sensors instead of ladar

[@gasior529]

Great job! It would be great to see this robot learning by itself by reinforcement learning

[@sumitmamoria]

That is doable. But, a more efficient (and less fun) way of doing it would be to build a simulator. Use RL methods in a sandbox, train the model and load it into the robot and that's it!

[@Sparecat-w1w]

Oh no, almost same as my graduation thesis😢 But I am using GP algorithm so is it ok..?

[@AirtonSilvaTV]

You have a sensor for penalty in case of the error?

[@HarpaAI]

🎯 Key Takeaways for quick navigation: 00:00 🤖 *Introduction to the robot and project setup.* - Introduction to a small robot with machine learning algorithms running on Arduino Uno. - Overview of the project's goal: autonomous navigation on a racetrack. - Mention of the steps to be covered in the video, including building the robot, creating a racetrack, data collection, processing, and a final race. 02:20 🤖 *Building the robot and the racetrack.* - Description of the robot's construction using an open robotic platform. - Explanation of using simple blocks for the robot's chassis and adding necessary components. - Improving traction on robot wheels with TPU tires. - Innovative use of cardboard for creating racetrack walls. 05:01 📊 *Data collection setup.* - Installation of a Bluetooth module and an SD card for data collection. - Explanation of recording lidar measurements and control labels while driving the robot. - Details about the data format and collection process. 07:10 🧠 *Processing and training the machine learning model.* - Discussion of feature selection to reduce data dimensionality. - Overview of experimenting with different machine learning classifiers. - Mention of using Python libraries for processing and training. 09:08 🏁 *Testing the robot's autonomous driving capabilities.* - Introduction to testing the robot's performance on various racetracks, including square and figure-eight. - Highlighting the ability to adapt to new racetracks with additional training. - Preparing for a final test on a complex racetrack. 11:40 🏎️ *Achieving high-speed autonomy.* - Surprising results as the robot successfully handles high-speed autonomous driving. - Discussion of motor speed settings and PWM signals. - Comparison of robot performance between manual control and machine learning algorithms. Made with HARPA AI

[@needyourbrainzz7686]

Very nice robot and video! ❤

[@conorstewart2214]

If you have access to, or can get an Nvidia GPU then you could train it in a virtual environment and use the virtual environment to gather training data, then you only need to implement the ML model on the arduino. Edit: you don’t strictly need an Nvidia GPU and for simple ML like this could probably get away with just using your CPU but Nvidia has a lot of support for ML and robotics. Your best bet for really good results is to train it using reinforcement learning in a virtual environment. That way you can change the track much faster too.

[@aayush212]

Can you explain little bit more how this can be done?

[@conorstewart2214]

@@aayush212 your best option is to look at "OpenAI Gym" or Nvidia's "Isaac Sim" and "Isaac Gym".

[@EvilSpyBoy]

I really really REALLY want to know how you are controlling the arduino (I am assuming) with your phone interface

[@chaituhamster1256]

Your voice reminded me of dani the game developer

[@michakurek5618]

Cool!, you mentioned that this is the first time you have used knowledge from the university. What are you currently studying? What kind of specialization?

[@herbertkleber5069]

Great work, super cool!

[@avipandey9112]

Bro Please i want all the coding part and step by step construction of the machine..............please brother , i want to stand out among all the students in my college as we have to submit projects before december. please help........also i am also good at machine learning.

[@Engr-Azhar-Iqbal]

Well done. Highly appreciated from Pakistan. Keep it continue.

[@mdeeen]

the final track should be a combination of circular, sharp edges & cross junction...

[@jeremygeorgia4943]

Can it be made to teach itself? Technically, it has a rangefinder on the top. In the square, for example, it shouldn't be running into the wall, when faced perpendicular to it. Is there a way to have it go through the course at low speed, be aware of when it completes a lap, optimize its path, then gradually increase its speed, as it becomes more confident? That could save a few minutes/hours of manual training, while also making full speed training unnecessary. You could have a routine that varies the amount of left to right distance bias, and after a few runs it could have complete familiarity with the track. Then you might be able to send a command to either hug the inside, outside, or prefer the center, while the robot is moving. Just a thought.

[@falconarea]

Very cool project. Perhaps I would have approach the training of the model via software in a simulated environment as it would be way faster to collect data always in the optimal path.

[@matteorossi5128]

(sorry, I am really interested on what you have used to concert python language to for Arduino and relative description but it is not in your comments, could you please give me a direction, thanks) found it in the link at your comment, thanks

[@caseyjordan9513]

Very cool. Any thoughts on how youd approach training a model for pan tilt camera object tracking that could out perform standard control algorithms like PID or MPC? I know I could use the data from the PID controller to train a model to do the same thing, but i wany the model to be better and feels like the only solution there is some type of deep reinforcement learning using real world setup

[@SHARAraTH]

Somehow he built the strongest shape!

[@aimaker]

감사합니다. 열심히 공부해 보겠습니다.

[@calinmoldoveanu6858]

amazing, very good!!! i like you project.

[@SAGEmania-q8s]

Amazing. I like what you're up to. Keep it up!

[@balakrishnaprabhubn3410]

Heyyy, This is pretty cool. Wouldn't adding an RL Algorithm(Maybe Q-Table or a Deep-Q) to this solve the problem of manually having to drive this around?

[@siaapetualang]

Hello bro, you are help me for my Final Exam in university.

[@artemygaming4439]

I recommend you making it so it will learn while riding by itself.

[@axlsaludo]

Hey i am just wondering to work with the same project but i am thinking of a maze solving bot. maybe it is a great idea to work on one using arduino with a lidar sensor but i havent got the materials to do it yet. i think it would be good if you work on a video like that

[@aayush212]

Great project 👍 ❤ Can we use any simple sensor system for this ? To make it cheap and simple to implement. And to all the commentors who are suggesting to train on viral environment and then implement it on robot, no doubt we get the perfect path for driving but how this will react to actual sensor data ?

[@666pss]

Could you have made a synthetic dataset for this using something like ray tracing on a 2d simulated race track instead of manually training it? I don't know much about lidar so maybe not.

[@blaxxun75]

This is a very cool project! Machine learning on an Arduino! Imagine Teensy or ESP

[@jhoo58]

Dude this is so cool!!!

[@rahulc0dy]

What are these kind of breadboards called? the smaller ones he is using in the robot. like shown in 00:49 ?

[@Z_1Y1_D]

hello, can we do it with ultrasonic sensor ?? and if please make video

[@alexandresutioso7029]

Can you make the movement using a servo motor like the fire extinguisher robot in the contest on the Trinity University ?

[@OfficialCreater15]

Great Job Brother keep going

[@kalamalahala1]

zajebist kanał stary, oglądałem aż w końcu mnie uderzyło "chwila chwila...ten akcent brzmi bardzo znajomo...XDD"

[@benjaminverbeek4232]

Super impressive! :o

[@koandres8314]

is it possible to replace the track with a room like a warehouse that has several rooms???

[@edgar9651]

Great work. You do already amazing things. And you are young. I wonder what you will do in a year or 5 or 10. Keep going!

[@Jagent]

I wonder if there are any nintendo engineers looking at this for their real world mario kart game.

[@wizrom3046]

Yery impressive! A fun project. 👍

[@Alien.Of.Mars.]

How can we use reinforcement learning instead of labelled data set is It possible>>>?

[@clamhammer2463]

Of coarse. I would opt for software training though while normalizing the data to what the lidar module outputs. then you can do multiple training sessions in parallel then upload the finished modal to the robot for real world testing. If you want to do reinforcement training, you would need in excess of 30,000 - 50,000 revolutions around the track.

[@nevaangupta875]

you should compete in micro mouse

[@majdthabit4976]

wonderfull thank you for sharing and good luck

[@badwolf4469]

10:35 A switch statement would be more appropriate

[@CibhinBharathi]

my vacuum cleaner does that

[@wszystko321]

Siemanko. Na wstępie musze powiedziec ze bardzo rzadko pisze komentarze, ale.. Twój filmik a bardziej projekt mnie powalił! =CZAPKI Z GŁÓW= pomyślałem zobacze co to za kolo, bo tak ładnie mówi po angielsku a tu okazuje sie ze jesteś z Polski.. Świetna robota naprawde! Czemu ja nie mam takich właśnie kolegów ;) pozdrawiam Marcin

[@frankdearr2772]

Great topic, thanks 👍

[@matthiasneumeister5685]

Well done! This was a very satisfying video to watch. Well explained and I totally understand the thrill of building something that actually works in the end!

[@PaulDominguez]

This awesome. I want to learn machine learning more than every

[@AndersJackson]

You could used ordinary tracking a line on the floor or collition detection to teach the LIDAR to track. And you could even use that input while learning. Then you can remove that tracking device. It is not uncommon to use extra input while doing the learning.

[@bobmcbob4399]

How about running this as MicroPython or AdaFruit's CircuitPython directly on a more powerful microcontroller called the RP2040? It's the debut mcu from RaspberryPi. I'm going to power my keyboard PCB with that.

[@conorstewart2214]

The ESP32S3 is better for ML, it has DSP instructions and has a higher clock speed and works with micro and circuitpython too. Also micropython is not a good language for microcontrollers, they are just too resource and performance limited. You don’t want to lower the performance even more by running an interpreted language on them. C is much better for microcontrollers, the programs require less storage space and they run much faster. Versions of Python used on microcontrollers should only be used for very basic prototypes or projects.

[@VARPYGAMER]

I cam make some suggestions as a 5 year in a row roborace winner. Me Personally, i would put a switch on the robot that allows for automatic learning or performing, u can use the distance from the sensor as a valid/invalid logic for keeping the data or trashing it due to a crash (too short of a distance, mean crash), also try to add a preference on the robot as far of lefty or righty robot, doing so in can also navigate maze, and i usually add also a preference for the longer the distance it measure in a direction the bettere it is, but with all of this, to proper race u need to now how to access really low level on arduino or a more powerful mc. Anyway if it's your first time, not bad. Ps. With lidar won't be common but implement a system to detect when the signal is wrong (like wall to far or too close, or a reflective wall, or sometimes also really pointy corner can cause problems, like if u have an Y too narrow. Usually i do like, of i detec for x time too similar data, do a sweep around and check if Im stuck

[@EmekaEkawuokwu]

Teach me bro pls 😢

[@sumitmamoria]

Nice Work! It would be interesting to see if one could "simulate" the movements for a rectangular track, instead of training on the actual path. I would guess, it would lead to comparable results. If yes, then the advantage with simulation is that one can design more complex paths without actually building them - making the training process very efficient and robust.

[@fireheadpet2039]

Great video and content! Love how you bring us through the journey of your experiments and the tidbits of discoveries that is available oit there. BTW, little editing features like the ghosting effect really elevates your game. I must agree with other commenter, some of your voice recording suffers in quality (when in testing area, hard walls). It does not impact my opinion but, you are competing for attention against others. I hope you continue to push this project further. Maybe like an iRobot that travels throughout the house for guard duties or identify any new objects...

[@dexterchewy]

ooo where did you buy your cutting mat?

[@alexanderyang126]

Fascinating! Thanks for posting this video!

[@imbabywild]

Im going to try this

[@bluefire5291]

damn that was so cool

[@thefreakbt]

Loved that you needed algorithm, hehe

[@todddrumheller6726]

Great channel, glad I found it.

[@369_for.design]

😮😮 مذهل حقا🤯🤯🤯🤯

[@DaveEverett01]

You data collection code includes Serial1, I thought Serial-3 were only available on the mega 2560, How are you making these work on an uno?

[@nikodembartnik]

That's Uno R4 with the new more powerful microcontroller and you have more serial ports available

[@DaveEverett01]

@@nikodembartnik Cool, thanks, I have just ordered one to play with.

[@denniswambua4471]

Try xg boost trees

[@tvinay9979]

Good video for robotic knowledge

[@simonpgw]

Interesting and very inspiring! Thanks

[@mr.washbear9747]

How can I learn to do what you do?

[@portlyoldman]

Have you got a new place to work from? Or did you throw your parents out 😕😕 Great video as always 😁😁

[@nikodembartnik]

Indeed that is a new place!

[@portlyoldman]

@@nikodembartnik - very glad to see you are progressing so well 😀