Adding AI Vision To A Robot Car Using A Huskylens - Line & Object Tracking

[@nishyu9101]

This is awesome! Huskylens, seems to be the most advanced device out there.

[@oscargonzalez6309]

Very interesting... I wonder if this could be used to make wheel chairs. Usage like that would be great for supplying specific needs at an accesible price.

[@NoName-vg1gz]

I Bet your wife was not too happy when she saw the lines drawn on the floor..... Awesome little piece of hardware, Well done.

[@MichaelKlements]

Haha. They were just drawn with a whiteboard marker, so were pretty easy to wipe off.

[@moeshickenyay]

So the Motor shield needs pins sawdered to it, wonderful, thanks great project.......

[@erniea5843]

Looks like a great module to try out!

[@jundyadlao]

can you do object follow car using husky lens, bts760 motor driver and arduino uno??

[@renukaskitchen8082]

Nice

[@Speedunique.]

Teacher how to get Robert car with using c++ program code with reading (black line stop )(white line move)

[@EngineeringAfterHours]

I do a lot of projects with larger scale RC cars on my channel, and I've always wanted to do a non-gps follow me robot. Is this something that could be realistically used for that? I'd want to be able to run in the 15-20mph range.

[@MichaelKlements]

You could probably make a fairly reliable object or person tracking robot with a Huskylens. You might need to wear something easily distinguishable like a bright t-shirt or cap etc. to improve reliability.

[@aboutcsknowledge1974]

sir please give arudino code

[@tanvirhossen5473]

Amazing project sir😍❤️❤️..

[@MichaelKlements]

Thank you

[@tanvirhossen5473]

@@MichaelKlements May i have your email id?sir

[@sphinxzapper2071]

why do i get the error fatal error: PIDLoop.h: No such file or directory

[@stephangrobler5524]

This helped alot. Want to build something like this to mount a gimbal and use it as a automated dolly.

[@TheTechieScientist]

It's very cool...but the link you mentioned in the description does not yield any results to the huskylens when i search it on the site

[@MichaelKlements]

I’ve corrected the link to point directly to the product on their site.

[@qzorn4440]

How can the Huskylens be used with the new Orange Pi5 GPIO pins in Python? Thank you.

[@IvanSantana-rv9un]

where can I get the PIDLoop library ?

[@gwb8548]

Thanks for upload the Video, I've tried to Arduino Nano, L9110 dc motor driver. Is it possible to driving?

[@nabhanhumaidi436]

can the code change to make it avoid the line

[@pacomacaw2456]

How did you attach pin 13. Soldered?

[@MichaelKlements]

I've soldered header pins to the spare IO on the shield.

[@pacomacaw2456]

@@MichaelKlements As a beginner(at the tender age of 68), I have not learned how to do fine soldering (yet). However I discovered a Screw Terminal Shield, which, when located between the Arduino and the L293, gives me access to all the pins. Very cool.

[@MichaelKlements]

That sounds like a good solution as well. You should get a small soldering iron and try it out, it's really not that difficult once you get the hang of it. You can practice on some old wires and header pins.

[@Triad3DStudio]

REALLY COOL GADGET!!! You can probably put together a gimbal from this as well, one that can video record you while following your move within frame while on a 4 axis pan and tilt, setup on a tripod, is this possible?

[@MichaelKlements]

This is a great idea. Yes, it certainly sounds possible. I've seen a couple of projects which have used these on the end of a robot arm or servo pan and tilt bracket. These aren't too different from a gimbal.

[@markrenzotayag5271]

My huskylens is going on and off when arduino is not connected to a usb cable to laptop. 😢 Can anyone explain it to me?

[@amitschachar3914]

looks good !! Do you know what is the maximum distance the camera can track an object ?

[@MichaelKlements]

It doesn't really have a maximum distance, it depends on the size of the object as well. The camera has to be able to see the object and still have a recognizable shape on the display in order to track it. So it could track a coin for a couple of feet, but would likely track a whole building that's a few kilometers away if it's clearly visible.

[@amitschachar3914]

@@MichaelKlements great you helped me a lot!

[@SURYAPRAKASHR-ch9ph]

no Way maxi below 1 meter

[@jagadeeshm264]

It is very nice..But you are suggested to make a video on both object tracking and obstacle avoiding robot car.

[@Berghiker]

The background looks a lot like kings terrace in PE. Awesome thin line following robot!

[@WEIKU-uc4ph]

Hello, I keep getting " Fail to request data from HUSKYLENS, recheck the connection! " pop-ups and I don't know what the reason is, I was wondering if you have had this problem too?

[@MichaelKlements]

There must be an issue with the connection to the Huskylens - it is likely either not receiving power reliably or the data connection is not good.

[@doctorgreatengineer6834]

can I add a wireless control to this robot, where I can watch captured video live and control the movement of it??

[@MichaelKlements]

You can add wireless control to it using a Bluetooth or wifi module. Unfortunately you won’t be able to capture live video as this isn’t supported by the Huskylens. You’d probably need to use a Raspberry Pi get get a video feed sent wirelessly from a robot car.

[@doctorgreatengineer6834]

@@MichaelKlements o i thought about that. instead of doing it myself i can find other readymade kit.

[@elizacrescini5350]

HI there , how can i adjust the distance of the object and huskylens before the motor stop, thanks :) and it also passible that i will only put 2 motor the m1 and m3 , it will still go forward left and right?

[@MichaelKlements]

The stopping parameters can all be adjusted in the code. Yes, you can use tow motors (provided their strong enough to move the car) and it will still be able to go forwards, left and right, it just won't turn on the spot like this one does.

[@bitsurfer0101]

Is there any zoom feature on the Huskylens? How much can it zoom if at all? Thanks for posting.

[@MichaelKlements]

No, it does not have a zoom function

[@aldairmontes171]

I have a problem, when i tried to upload the program, Arduino doesn´t compile due to error status 1. Can you help me, please?

[@MichaelKlements]

That's a compilation error so I'd say you've probably got an error in your code or your haven't installed the required libraries

[@aldairmontes171]

I have the solution. You need to leave your library AFMotor.h before the huskylens file That was the solution that I found, now I can run the program without issues Thanks for the support

[@bofa-zi4fj]

Can it still avoid obstacles with the husky camera?

[@MichaelKlements]

Not in the same way an ultrasonic sensor works. A single camera can't be "depth" aware. You could program it to avoid a certain object, so if the object appears in screen then the car turns away from it or reverses.

[@АльбертИванов-ц4х]

is it possible to follow a human? could you check a half-body follow ? and is it possible to add algorithms or change them ?

[@MichaelKlements]

You could set it to follow a particular part in a person. Like bright shoes or shorts etc., it also has facial recognition which you could use when facing the robot. You can’t add or modify the algorithms unfortunately. There are some basic adjustments/settings you can do to certain algorithms (like the facial recognition one)

[@donaldklopper]

Loved it! USD55 for the Huskylens doesn't seem excessive.

[@MichaelKlements]

Yes, it is pretty good value for its capabilities.

[@fro2lier82]

I read your post on 'The DIY life' But I have some problems. robot didn't move when I use your line tracing code, parts and diagram Are there anything I have to do in your code??... like changing some parameter?

[@MichaelKlements]

You’ll need to adjust some parameters to get it to run smoothly, but the wheels should at least turn without making any changes. Is your Huskylens in line tracking mode and have you trained it on the line you want it to follow?

[@fro2lier82]

​@@MichaelKlements Thanks for replying After I changed 'int left & right Speed' from 0 to 70~80, it started to move. Q1. Is this right parameters that I adjust for moving my robot?? //Of course, I think other things need to be adjusted, but I wondered if that changing those(int Speed) is right to work + I checked my huskylens in line tracking mode and I2C protocol

[@MichaelKlements]

That’s great. Yes that is one of the parameters which can be adjusted. It’s essentially a type of “gain”. So if your motors have more friction or your battery produces less voltage then increasing the speed will get more power to the motors.

[@fro2lier82]

@@MichaelKlements I really appreciated your help! Finally, I made my robot following the line smoothly by keeping editing some parameters..!! But I would like to get some more advices from you. I want to make "each DC motors to move Forward/Backward when turn right or left". Because I used mecanum wheels, I think it is neccessary for omni-directional move. But after editing "Using BACKWARD or FORWARD at Void turnRight(int duration) & turnLeft(int duration)", my robot only goes Forward... So... What do you think about this problem? Can I ask for some advices on this problem?

[@Maru-bo6tq]

@@fro2lier82 can you tell me what parameters have you edited? my car won't turn left or right :(

[@ninomharlitotampipi1266]

Hi, I just sub. this video is very helpful. I follow the instructions but my problem is power. How much voltage and amps did you use to make it work?

[@MichaelKlements]

I used a 3 cell (11.1V) LiPo battery, the car draws a few hundred milliamps when running

[@marvetoons1625]

Can I do this on an Esp32 cam

[@MichaelKlements]

Probably, but you'd need to add your own software to it. This is a hardware & software package.

[@marvetoons1625]

@@MichaelKlements Thank you

[@sphinxzapper2071]

can it do object avoidance with this?

[@sphinxzapper2071]

at the same time it tracks

[@Cyberdemon22Gaming]

Can you tell me how do you calculate the PID loop for this project?

[@MichaelKlements]

The PID loop only really uses P, so it’s not true PID control. I just used a PID library as in the example script from the Huskylens Wiki

[@Cyberdemon22Gaming]

@@MichaelKlements i tried your code but the TT motors only vibrate when huskylens track a line any solution?

[@MichaelKlements]

Try adjusting the motor speed value, check your connections and make sure that your battery pack is actually able to supply enough power to drive the motors.

[@Cyberdemon22Gaming]

​@@MichaelKlements it works now but i have an issue.. it wont turn left/right when huskylens detect the left/right line

[@fro2lier82]

@@Cyberdemon22Gaming Can you tell me how to solve your problem? I had same issue when I use TT motor.. and his code

[@CDE.Hacker]

I can see this running a little R2-D2. 🤯

[@Jerseylance1]

This is great, but using on a humanoid robot is going to be hard.

[@sohamgaud7120]

Sir plz a request from your subscriber sir plz can you make a detailed video on how to code huskylens with arduino actually I am not getting the code pre writtened so plz request can u make a detailed video on coding huskylens plz🙏🙏🙏🙏🙏🙏😊

[@MichaelKlements]

I’ll have a look at putting something together. What would you like to do with it that isn’t covered in the blog post for the project?

[@sohamgaud7120]

@@MichaelKlements Sir actually I do coding and make different types of gadgets And i am thinking to make a project on huskylens but in arduino idea the code for huskylens which is pre written I am not getting that code So plz can you explain the code because I like your teaching pls sir🙏🙏😇

[@haideraslam007]

can you help me in my project: Follow-Me Robot with Real Time Obstacle Detection using Deep Learning

[@vinsmokesanji6305]

what method is used in line reading using camera module