Machine Vision with HuskyLens

[@Dronebotworkshop]

Hi everyone - It's come to my attention that there has been someone masquerading as myself, responding to some comments here with a link to a Telegram chat to win a prize from me. THIS IS A SCAM, I am not holding a contest, nor do I have a Telegram account. PLEASE DO NOT RESPOND TO THESE MESSAGES!! It's happening on a lot of my videos, I'm taking steps to remove them manually, but as I have 162 videos, it will take some time. If you do run across a suspicious comment, I would appreciate you letting me know at [e-mail]. Thanks! Bill (The real one!)

[@SniperUSMC]

Hmmmm, 8 different microphone inputs. Being a Marine there's only one thing I can think of to use this capability for, receiving gunshot sounds and determining the direction they came from for auto return fire to that location instantly, and neutralizing the threat immediately. That would be a great project for you to work on and showcase.

[@theminer49erz]

That is actually a VERY excellent point! (can't say the Corps doesn't make a sharp tactician!) I was actually about to dismiss this for my home surveillance/AI system because of how many cameras I would like since it would make more sense to have a central processing server, BUT maybe one of these on top of the house dedicated to that cause w/ a rotating shaft that could use those mics to determine to override the direction it is pointing would be nice? I bet I could calibrate it a bit manually and then update it by asking where hunters were when they blasted and what they used(surrounded by a State forest and know most of the people with hunting camps around me). By knowing the type of gun and distance, one could probably use the average decibels etc for that type of round to calculate the distance of the shooter as well as direction. Then it could scan for movement, track, provide range, and record etc. It has to also be possible to train an AI algorithm to determine the type of round from the sound which could help with automatically determining distance as well if it can be tagged to decibel data for that round. I mean if I can tell roughly from my limited experience I'm sure AI can. Anyway, thanks for the idea! Who knows if it is practical, but it would be an interesting project for sure!

[@g2m_mattis488]

Just like in Fortnite

[@rickhunt3183]

Sorry I missed the party. You could easily build something to detect the direction of a gunshot. Once direction was determined it would be a simple matter to use trigonometry to calculate a distance. No consumer or industrial components meet the required specifications for military applications according to the Government Accountability Office. Those specifications are outlined in the United States Military test specifications as determined by the Department of Defense. You must use components designed specifically for either military or aerospace applications. Those components meet the required minimum specifications. The cost those components are going to be upwards of 20 times more than their consumer cousins. Thats why military electronics cost so much. A prime example would be a military laptop or radio. Those devices have more than just a robust case.

[@Puffie40]

​@@theminer49erz with a PTZ camera that uses the PelcoD protocol, it would be pretty simple to have a computer send a set position command to the PTZ in the direction of the microphone input. One other thought would be to use remote "beacons" that send out a wireless signal when a attached microphone detects a loud enough sound. All the camera controller has to do is send a "call preset" signal to the ptz camera to look in the direction of the beacon that sent the signal.

[@jamespletcher7574]

Fascinating device. And, as is always the case, extremely well presented and documented. Thank you!.

[@mineken360]

This guy is a pure legend. All his explanations are so clear; I understood everything! Keep going!

[@ThermalWorld_]

The only so clear explanation was HuskyLens "Board name" 6000 tims 😅

[@Nobody-Nowhere]

This is really nice & simple, really simplifies integration with arduino projects when its a separate unit with its own microcontroller and just gives out easily usable coordinates & data back.

[@RIC414]

I would like to thanks dronebot teaching. Very clearly and appreciated

[@PhG1961]

Nice video Bill ! I watched it completely ! Looking forward to see the result on the robot build in progress !

[@KC-nd7nt]

Great info . Thank you for investing your time to share this with us . 1 year into arduino and mini pc . My first build was for a sonic alarm for parking pad . Hidden with outdoor speaker material in an old bose outdoor speaker . Saves me from security camera psychosis. Big help brother !!!! Thank you

[@alexandrpetrov1110]

HuskyLens is an AI Machine Vision sensor based upon the powerful Kendryte K210 processor. Today we will take a look at this amazing device, both by itself and with an Arduino.

[@safcon8614]

Thank you for your great content. You are a great presenter,and really simplify the whole process and application.

[@GaryMcKinnonUFO]

"It's an AI-opener of a lesson today" :)

[@electro9480]

Well done Bill, another magical video.

[@rubialugattimoreira1978]

absolutely the best tutorial on the internet

[@1607rosie]

Pretty neat ! Pretty powerful kind of curious how far away it can recognize.

[@lodecafmeyer7793]

fantastic teacher

[@stompreaper]

Very excited to see this, I got in on the Kickstarter for it but have not gotten to trying it out.

[@littlejohnny4759]

Great tutorial! Hope you will follow-up with the audio equivalent....

[@paultakoy7091]

Great video, thanks for creating and sharing. Love your videos!

[@roeyasher1396]

will the object classification work if i need it to see the difference between orientaions of the same object? can it see the difference between up and down?

[@yv6eda]

Great video, as usual... Amazing to have this technology in our hands...

[@Yorumcu63]

Like was clicked at 5.second .Amazing video like others.Thank you

[@tubeDude48]

Very interesting video! Thanks Bill.

[@petermolnar6017]

Thanks for pointing this out! As always a superb video!

[@gregorymccoy6797]

A lot of possibilities here. Really interesting. Thanks for answering all the questions I would have.

[@lorcster6694]

could you use this to detect movement of metal? it must detect movement, not just presence, but the difference between present and moving, and present and stationary.

[@mehulajax21]

Just a correction: Object regognition is not same as tracking. The word you are looking for is detecting and recognizing.

[@yvesinformel221]

This thing does almost everything, but what would you use for object avoidance in a drone ?

[@manavt2000]

Thanks for the detailed video!! Definitely going to buy this soon!

[@Umtree]

Can the camera be extended away from the board with a longer ribbon cable?

[@eugy2008]

Can the HuskyLens somehow store information about the image/object it detected and then bring up notification stating the image is sees now it saw before?

[@compubyte2010]

ALso, If you mentioned it, I didn't notice.. but.. IS there anyway to tell which version you have? 2M or 5M camera? ( without the box anymore) .. cuz didn't realize it came in two different type cameras when I purchased it??

[@miguelangeloassuncao6727]

dear sir, I new in your classes. Have you ever thought about creating a controller for a solar system, where there is a temperature probe on the panel and a probe in a tank, where you can give an order to a circulating pump. Or a control of a three-way valve, where there is a hot water inlet and a return of cold water, where a water temperature is set on the way. The valve control is done by a 24V AC servo motor or other type.

[@alexandrsoldiernetizen162]

'blank function' is known as a 'prototype', typically placed in a header (.h) file.

[@esquiche]

Can you use this camera and create a function from scratch for color reconigtion or form reconigtion? and then run it on arduino r4 wifi?

[@microduty6190]

So squirrel is not on the list of objects in the Object Recognition mode. I know I can't add new objects but can I use the Object Classification mode instead? If yes, will it work if I press and hold the learn button, then flip through a bunch of photos on the computer screen? How long can I hold the learn button for? Thanks!

[@lipinskirl]

Do you think the HuskyLens is sensitive enough to track a star or planet? Trying to find a way to have Arduino track stars for my telescope.

[@____________________________.x]

Can the screen be removed and pointed to face away from the camera?

[@compubyte2010]

Just purchased one.. waiting on it to be delivered. , I noticed you showed baud rates for serial speeds, but when in I2C connection, you didn't mention ( or I missed it? ) I did notice I2C was set to 115200 in the code? ( cuz you said 9600 should be used in serial? ) But can you set the baud rate in I2C? or is leaving it all in AUTO mode to let it decide how fast to go , a better idea?

[@christobritz5358]

Nice video. Thanks. Can I use the Husky for detecting/identify plants or maybe rodant holes in the ground.

[@yudasetiabudi1123]

How many different face/object that Huskylens can save?

[@israelgiron9089]

Thank you for everything.

[@HFSoluciones]

The dfrobot webpage says that huskylens has gesture recognition, but I don´t see it in your video. Did you have the chance to see if it's true?

[@deadly_dave]

Right ordered my HuskyLens, it's gonna take like 6ish weeks from China but it's on the way :)

[@Chaga1314]

This is A Eye opener . Love it

[@stephenconnolly3018]

Another first rate instructional video.

[@jp15sil24]

can we change the mode over arduino code. Example: i choose the face recognition then i want to change over an arduino code into the object recognition, is it possible ?

[@ahmedsamy1575]

Thanks for your great tutorial and I hope to see a complete project using this lens as you said, until this thank you so much!

[@davidferneyhough8167]

I had bought a Pixy Cam. The Husky Cam looks improved but I'm not ready to buy. I have 4 cats so I'm interested in cat recognition. Is this function planned for a future release?

[@applefriend22]

hello, i just bought this item, and i have being trying to recognise texts on a lcd screen but they all apear as ID1, is there any way i can make it work?

[@NachbarFizgo]

Thank you for this phantastic video! 👍👍👍

[@pieterrossouw8596]

Is there an alternative to this device that doesn't include the camera interface? I'd like to feed it images/frames programmatically but I really like the features of the SoC in this board.

[@powerbeast5691]

Can you make your own computer vision software using HuskyLens that will start upon boot, without the user needing to press anything?

[@ThermalWorld_]

Thanks for mentioning HuskyLens 6000 times 😌

[@dubeytrontechnologies1390]

Wow! That's a great presentation!

[@theminer49erz]

Do you know of any security issues using this? Meaning will it try to transmit data to a server? Granted if I used it, I wpuld have it on an offline network, but a clever "malware" could prob find a way out of a VLAN. Also have you ever built something like this from "scratch"? Like using dedicated IP cameras on a network that do this sort of AI on a PC? I have a pretty powerful home server PC with multible half decent(for lower end AI) GPUs. I was wanting to set up a VM using those GPUs to do a home AI server. These would be awesome, but for the amount of cameras I would like(around the property, chicken coupes, etc) that would get expensive and seems superfluous. A video on that would be awesome! Unless you have one and I missed it. I've only been watching for maybe a year when I can sit and pay attention. You are an excellent teacher BTW! I have learned a lot from you and gotten MANY ideas! I can't wait to have to time to give them a try! Hope you have a safe and happy new year!

[@Demolition2024]

I've been working on replicating the Kiva robots that Amazon uses. I saw this and was thinking it was what they used to follow the lines on the floor and read April tags on the ground and under the shelves. I guess this lens can only do one at a time. Do you think they use 3 of them or something else?

[@dibyojyotibhattacherjee4279]

Hey, can u do a video on how to get started with iot, electronics and stuff!

[@eizzuddinnawawi5349]

Hi Sir, may i know which program include the modify name?

[@0tispunkm3y3r]

Do you think I could use this to monitor selected gear on a dashboard? I'd be looking at picking out P N R D - but of course on some vehicles, they show only the current gear, some others will always show P R N D but with a highlight on the current gear (either light up, coloured, bolded, border drawn round). It seems like this would be a quick route to the ability to do this, but I do wonder if the problem will be lack of distinction between different gears i.e. P chaning to N withouth any other changes or change of view point. I wonder if the "tag" function would work for this.

[@amrishhirani6096]

Thanks 👍 Happy Diwali have good year ahead

[@justanotheranonymous4381]

Question: Can you connect a higher resolution camera to it? Is its source code open source?

[@drawmaster77]

hot dog/not a hot dog. What are applications for HuskyLens? I cant think of any tbh

[@조기연-r7t]

wonderful job!

[@rumingjiang9645]

is this better than the Pixy2?

[@akshaybhawar842]

Allways helpful

[@burner_account_yaromyr]

great explanation, thank you

[@billiardmedia]

I would love to create something to track pool balls on a table. If it could track each players run of balls in each inning that would be huge. How hard would it be to create something like that and where could I find someone to help create something like this?

[@tehbing6332]

Best tutorial ever

[@S4l4m4nder36]

@DroneBot Workshop: Do I have to train the HuskyLens with live footage or can I also use previously made recordings to do so? Great video btw. really makes me want to buy one of these also.

[@vhertrontechvlog]

vey nice work sir...

[@mauriciobailey4725]

@ DroneBot Workshop How does does the HuskyLens compare to the Pixy2 Camera? (besides to the LCD screen of course) I'm particularly interested in object tracking (of new objects I select) & line following

[@עידןקרבציק]

What is your os on the computer?

[@HardCoil]

Amazing video as always. The price on this thing is insane, I was expecting it to cost hundreds of dollars.

[@ziad_jkhan]

Can we know how much it costs? I don't want to watch an entire video to find out.

[@mr.grieves6662]

@@ziad_jkhan $60-ish us.

[@ziad_jkhan]

@@mr.grieves6662 Not bad but, at this price point, it's probably better to wait for OAK-D Lite coming up at $85 in April with much better specs

[@ziad_jkhan]

Well, I just checked the price and it seems like this was the early bird price which is no longer available so it looks like it's at $125 now :/

[@Mr.P539]

Ca you do rubik solve from this?

[@saamwork8233]

This camera is better than pixy2. Change my mind

[@ace.mccloud5425]

How to Track an Object in the Shape of an Ellipse using Computer Vision (CV) ?

[@RodrigoPacheco-Ruiz]

Cracking tutorial! Many thanks

[@nethostinc.1670]

Long time you released a video.

[@hanspeter639]

Great Video! Could you do an episode about load cells? That would be interesting!

[@ripplerxeon]

Awesome Video .... Thank you :)

[@rdyer8764]

Geez this thing sounds a lot like the PixyCam (CMUCam) on steroids!! Obviously didn't have the object recognition or display, but it did do colors, it did have a training mode, LEDs, object tracking, etc... I wonder if some of the same people worked on it???

[@qzorn4440]

this would be an interesting Click BLE PLC automationDirect industrial or home budget project vision addon... 👍👍👍 thanks a lot.. 🤔

[@typingcat]

It costs $50 for non-pro version. I don't know what other people's criterion for inexpensiveness, but to me, it does not seem inexpensive.

[@danishjaved7597]

I think it's about right, For a person who works on it/needs it etc. $50 isn't gonna be expensive, for a person whose messing around with it, it would be expensive. It's like Arduino Vs raspberry pi in UK, A Uno could cost £8 or so while the Pi would cost around £60 Both compute but do different things Dude did a video before about a microcontroller that had a camera and low level AI and cost I think about £20 but did nothing compared to this Edit: it was the ESP32 which is $10 and with some programming recognised people

[@paarthsstudio]

Thanks a lot sir

[@p2v622]

could you do a nrf24 vs hc12 comparison .

[@RixtronixLAB]

Cool video, keep it up, thank you :)

[@robertobrenes5283]

I was thinking about the PixyCam, is that device too old?? Or is it still somewhat useful??

[@martinwhitaker5096]

I have a PixyCam2. This device does a bit more than the PixyCam, so might be a bit more useful. In the end I only ever used PixyCam in some novelty Lego projects - I never found any real world uses.

[@robertobrenes5283]

@@martinwhitaker5096 I have a Pixycam too, I think the same, thanks!

[@ziad_jkhan]

But how much does it cost??? I'll only watch if it's worth it.

[@wishicouldarduino8880]

This is a cool one.😁👍

[@MisterkeTube]

Why is this so limited? A device like this should have an sdk allowing you to develop your own algorithms for it. I don't know whether that is possible with this device, but at least you did not mention it. As it is now, it is more of a gimmick than an actually powerful and versatile tool. Ex. the hardware should be perfect for running an algorithm to detect 3d printing failures (read: spaghetti detective), but that would require putting your own neural network on it. Something like that would make it worth the price (which is not so super-low if you compare it to a Pi Zero 2 + pi-camera), but what use is detecting car or bikes or faces or lines? The algorithms for that aren't so complex that a Pi Zero 2 wouldn't be able to do it - probably at a lower framerate, but what use is high-framerate if there's no usecase needing it? So really, this thing needs an SDK instead of the standard firmware with this limited functionality.

[@unloquitocualquiera9213]

Say hello to the Solid Eye 🐍📦

[@parthsinghrajput2475]

Is this open source

[@benjaminreynolds3659]

Disappointed it can't by default object recognize Hot Dog, Not a Hot Dog.

[@webjoeking]

Great video! Would love to see this compared to Luxonis OAK (OpenCV AI Kit) line of products and their upcoming OAK Lite that had a successful Kickstarter campaign.

[@r4z-0rs.ed-9e]

Me two, got the OAK-D Wifi and a Realsense aswell. Thanks for the vid, it was straight forward as always.

[@RIC414]

I'm very new in arduino

[@Lorenzo0077]

another great video with excellent explanations ! 54€ is not a lot for all the functionnality. don't say "colored objects", it's better to say objects of color ^^

[@williamhuang5329]

Hanzhen harmonic gear , robot joint gear over 30 years experience

[@the_n0mad]

first doesn't really matter but am still gonna say

[@adamderbent6986]

I got it...

[@smokino9387]

Hello Sir, I need help with something, I will pay. Thanks in advance