Jetson Nano: Vision Recognition Neural Network Demo

[@user-uw1wq9rj8g]

The best explainer on the KZbin is only Mr. Barnatt!! Thank you sir.

[@oskimac]

plot twist, he puts a jellyfish and the ANN detects it as "green background".

[@ericschleicher]

came here for SBC demos, got masterclass into to machine learning. good simple explanation for those not already steeped in machine learning

[@laminlevrai1758]

This is the most accurate and beautiful recognition I've ever seen, I wish you teach us some basics in AI in the next videos.

[@waynerobarge8543]

Thank you for covering this topic with the promise of more in depth looks in the future.

[@9ColorZebra]

Thanks Chris. I enjoyed the presentation and forwarded it to my friend in case he didn't see your notification. He went and bought a Jetson Nano.

[@rv6amark]

Watched this video twice simply because the subject matter was so interesting and well presented. I can see similar processing going on in my "Nest" doorbell's facial recognition, which works amazingly well on its tiny processor. Thank you, Christopher, for another great Sunday morning watch. Now I can spend my afternoon exploring the links you provided.

[@geoffreyjohnstone5465]

This is really clever. I know it can be done on much more expensive equipment but this is soo cool in that you can carry it in your pocket. I would never even think to try this kind of thing.

[@1974UTuber]

Great video and demonstration Chris. I found it interesting that it identified your background as a jellyfish each time you removed all the items from the shot.

[@JohnyDays69]

Man, you are AWESOME. You should teach some courses for all of us we don't have great knowledge in this field. Your explanations are clear and understood. I think I will buy one of these boards and try to dive into this advance step.

[@PabloZumba]

Thanks for make videos about basic AI. I hope this continues with a little more of complexity each time. Amazing video!!!

[@pulesjet]

WoW, I found the IA's Vocabulary alone amazing. I'm still having issues understanding how the Internet truly works . World Wide Neural Nets and Nodes. How so much information can be compared in uSeconds from my mind, to key board to the entire complex of the net, back to me as fast as I can type. Boggles my noodles it does. To think Our minds do the same thing all located between the ears. The Creator had it's chit together for sure. Our minds are nothing more then Yes and no''s being compared in a gray jelly substance we pretend to control. When you think about it , it's i truly amazing we can do what we can do, eaaaa? Yet again Your gray jelly teaming with yes and no's prevail Sir ! One of the best video's I've seen from you. Thank You !

[@ExplainingComputers]

I so agree.

[@ГригорийЕрёмин-ч4й]

very happy for the fact that such videos are released. Thank you very much for this. I hope that such highly specialized videos will be released!

[@mickybee3247]

Fascinating video - superbly presented. I'd love to see two of these setup so it can truly 3D determine whether it's a wooden spoon or drum stick, and distance to object. Powerful and complex technology that (like most technology), will be used for good and bad.

[@salilsaxena9529]

Loved this Video. The only concern I have is that in Section where you explain the ANN's is that there exists no Neural Network with 2 output nodes (as in terms of Binary Classification a single node can do this task by simply indicating 0/1 with the help of Sigmoid or SVMs). Please continue spreading Practical knowledge the World needs it.

[@ExplainingComputers]

Fair point. A went for too simplified a graphic! :)

[@rahuldharyt]

Sir, you are one of my favorite KZbin content creator.

[@ExplainingComputers]

Many thanks. :)

[@risquefiasco1305]

I wish you had explainers for every computing question I have, but thankfully you answer many on my favourite subject; the single board computer. Thank you

[@resrussia]

Excellent presentation of neural networks and Jetson implementation of one. I am looking forward seeing how it can trained for working with specialized domains of knowledge. Excellent video and keep up the excellent work!

[@NicoDsSBCs]

That's amazingly well explained Christopher. I wish you had explained me the first time they tried to explain to me. It took a while before I understood. With your explenation everyone can understand it in a the first 3 minutes. I also had books with those pictures of the neural nodes. In multiple configurations (multi-layer networks...) It's amazing seeing how things have evolved. In the early 2000's we had to write all library's ourself. And it wasn't used for anything media like this. No pictures nor video, only text. And the output was a library of data that we had to try to interpret. What had cost 1 million dollar 19 years ago is far surpased by something of $100 dollar now. What's the future going to bring next :) Amazing video, I loved every second of it. I haden't heard about neural networks for years after CELE went bust. Now it's everywhere. Have a great day Christopher.

[@NicoDsSBCs]

It was an Indian elefant. It's got small ears :) I'm watching it again :)

[@ExplainingComputers]

Hi Nico. Fascinating to put this in the context of your previous neural network experience. This technology is going to grow and grow.

[@RocktCityTim]

I remember when a Smalltalk app could recognize a phrase that you typed. It took it long seconds and would consume a 286 CPU platform that cost over $15,000. Many won't realize how amazing what you just showed us is - but it is f-ing AMAZING for $99!

[@ExplainingComputers]

I totally agree. Even the cloud AI vision recognition you can try for free now -- eg at cloud.google.com/vision/ -- takes a few seconds to process a still. And this board is delivering 17fps. It really is staggering.

[@El_Grincho]

It's a b... It's a b... It's a small, off-duty Czechoslovakian traffic warden!

[@ThinkinThoed]

Hahaha, that was a good reference! Now I've got to go rewatch the show, thanks. 😂

[@jonathanmaybury5698]

@@ThinkinThoed Love it LOL

[@ethzero]

Came here to make or like this comment!

[@AmazingArends]

A lot of people don't realize what a remarkable achievement this vision recognition is, and how long it took them to achieve this level of accuracy. As Marvin Minsky once pointed out, in a 2D photo, a box can have an infinite number of "shapes"depending on how it is held, so the ability to recognize a wide variety of objects at different angles is a huge achievement!!

[@weerobot]

Fast Forward 30yrs....Say hello to T 800......

[@ExplainingComputers]

Exactly. That is my thought here. I am amazed that a 99$ board can already do this.

[@spuds6423]

@Richard Addison what was that movie where Robin Williams plays an Android that becomes more human as it is upgraded to the point where he is legally a "sentient being" and allowed to have relations with a human?? It was "Bicentennial Man"

[@floydlooney6837]

No, T-800 says Hello to you, Puny Human, all glory to Skynet!

[@Fred_PJ]

98 . 50% Sarah Connor

[@henson2k]

@@JamecBond Unlikely, look at self-driving cars or space exploration. Stuck for a while...

[@niallwood]

Thanks for another great video! I have my GCSE computer science exam tomorrow and Thursday, wish me luck!

[@ExplainingComputers]

Good luck Niall. :)

[@marksadventures3889]

I like how it sees the background as a jelly fish . That was fun Chris, thank you for uploading it.

[@XSpImmaLion]

Super interesting! Also, the fact that you went offline for this Cris, matters a lot... I'd be pretty interested to play with this tech around a bit if it's not creeply connected to something else. Thanks for sharing!

[@freesaxon6835]

"Not named after a fruit, but can recognise fruit " 😁

[@perrymcclusky4695]

Free Saxon The best quote of the video!

[@briancrane7634]

Very nice demo indeed! Fascinating! Thank You! I must add that in order to understand confidence intervals and Deep Learning in general one must have A-levels in MATHS! In particular being able to differentiate a DL equation with respect to a matrix is key. Many, many videos and courses available at no cost on the internet for anyone with the vision (pun intended) to study them!

[@armisis]

I can't wait to try this, I want to get it to learn the family and then greet the people who it knows when they come in the house and question new people as a type of security system.... Should be a fun project.

[@freesaxon6835]

Considering this V.R is classed as 'hobby class' it's impressive!

[@MarkoVukovic0]

Very interesting, thank you for sharing this, Chris! How silly that it confused your tea mug with a coffee mug :D

[@JaimeDeFi]

"Is not a coffee mug, is a tea mug" you have my thumb up! XDDD

[@apoch003]

That was a fun one, Chris. I could have watched it trying to recognize things all day.

[@stevensexton5801]

I'm still looking for the jellyfish. All I can see is a cow eating grass in a very large field.

[@leeoliver2969]

Very interesting well done video, in the second half you sounded like you were having great fun.

[@AurioDK]

I am really scared now, the world is full of jellyfish, I knew there was something between heaven and earth. Now it´s been confirmed.

[@KomradeMikhail]

But can it recognise a Raspberry Pi ?... Or a raspberry pie ?

[@ExplainingComputers]

Sadly not. I've read the list of the 1000 things it knows. It can identify a raspberry, though.

[@statorworksrobotics9838]

You beat me to it

[@brianwesley28]

Make it look into a mirror.

[@jim5461]

Steps taken to make the first command work : adjusted resolution for my camera (3280, not 3820), and lowered fps value to 15. Then the command worked.

[@stanrogers5613]

It needs an olfactory sensor module. It's high time someone made something that can definitively tell cheese from petrol.

[@motogee3796]

check this mini spectrometer...it can identify foods, medicines and their quality as well. kzbin.info/www/bejne/j3zZaniJgbKCe6c

[@totalermist]

@@motogee3796 You know that's a scam, don't you? It *cannot* work. Professional equipment that's orders of magnitude more expensive and -bulky can't do what those scammers claim their product can achieve. If it seems too good to be true, it probably is...

[@motogee3796]

@@totalermist I actually believed it...thanks for pointing out. They raised 3 million $$ on kickstarter

[@totalermist]

@@motogee3796 To be fair calling them "a scam" was a bit harsh - they at least released a product; albeit one that was several years late and very underwhelming. The problem is not so much the product itself, it's the hype and unrealistic goals. I genuinely believe the guy behind it wanted to make it a reality. But reality just didn't play along...

[@mikeorjimmy2885]

@@totalermist Does Reality ever play along? I have noticed that in my 65 years only half of the time. No flying cars, no moon trips no fusion for power.

[@srtcsb]

This is really good stuff. I guess if they ever figure out how a computer can define smell and /or feel, Skynet can't be far behind ;-) . But this early tech is fascinating to see and work with. Thanks for another great video Chris.

[@Skynet_the_AI]

Ha

[@wlorenz65]

Only still image recognition of independent single frames. True vision recognition from videos would know that objects don't change their identity if you rotate them.

[@Giblet535]

Not bad for a tiny board. Inference success will drop rapidly as the background becomes cluttered, so its usefulness is limited. Nvidia used to have some excellent DNN examples on their Cuda developer's site, combining tedious OpenCV Haas object training and an inference engine to improve the success rate. Those examples ran on workstation class systems, and still weren't all that useful.

[@IndiandragonIn]

@10:29 Chris is a madlad, he needn't worry about demonetisation!

[@Alex1891]

This ExplainingComputers upload is the most interesting-to-date for me, because of both the topic and the presenter (hey Mr Barnatt!). Near the beginning of the video, it is explained that artificial neural networks have an initial training phrase. The example of showing one multiple pictures of rabbits is used. This is wonderful. Furthermore, unless my understanding is incorrect, it is implied that the artificial neural network would have to be told what it is looking at during the training phase. This allows it to return something understandable during the inference phrase. Within the context of this video, it is able to eventually tell us that an input picture is likely a rabbit. I would like to pose the question of whether it is an inherent, necessary step for artificial neural networks to be told what they are looking at during their training phases. What if you showed one multiple pictures of rabbits, but did not tell it that it was looking at rabbits? Surely, upon being shown a novel picture of a rabbit in the inference phase, it would still be able to tell that it was looking at something it knew about? This ties into an example later in the video. When Mr Barnatt is showing the camera the ExplainingComputers mug, it is likely a "novel" experience for the artificial neural network. However, can it remember the appearance of the mug such that it would be able to usefully respond to a future request for, say, "all known images of $this", where $this might be a sample picture supplied by the user? Could this eventually go deeper, with there someday being the ability to get a useful output to the request, "Please show me all known images of $thisSpecific.", where $thisSpecific might be a sample picture supplied by the user, with the output being images of one, specific ExplainingComputers mug, identified by its unique possible cracks, discolouring, grease, and/or other possible attributes? Thank you for your erudition, Mr Barnatt. Edit: For clarity, I would like to specify that this comment is wondering about the identification of specific things. I am aware that it is possible today to do a reverse image search in Google; however, it returns images similar to the uploaded one. I am looking for something to return images showing the same thing as what was uploaded, possibly from any time that a public picture was available. Imagine the scenario in which someone in the distant future scans an unearthed ExplainingComputers mug, and, in return, receives images (and possibly video) from a massive archive of public media, possibly including photos of the person who owned the mug holding it. Then, you could take that person's image as input and see other images of that person, and learn about their life, knowing they were an ExplainingComputers fan. :-)

[@ExplainingComputers]

Great post, and your understanding of the training process is correct. Today, most neural nets are trained, then used for inference (in part because training is a far more resource intensive process). But there are self-learning neural net AIs -- such as Google's Deep Mind -- that do not have to be fed known training data (ie told what they are looking at, as it were).

[@BuceGar]

Your mouse IS a joystick....amazing demo!

[@darkholyPL]

I love when there's nothing on the screen the AI just goes: 'Umm, yup that's a jellyfish right there!' lol

[@edrymes3653]

Fascinating, and also a bit scary. First of all the power of the SBCs is incredible compared to my first PC, an 8086 with 720k of ram. Put that together with the AI software and you start to get a taste of the near future. Facial recognition for your front door? The possibilities are endless.

[@ExplainingComputers]

Yes. It is not what a $99 maker board can do today that is important, but what it signals for the years ahead . . .

[@MohammadAminAbouHarb]

legend says innocent jellyfishes were mercilessly slaughtered on that same desk. you can still feel their torched souls yearning for justice to be served. poor fellas

[@chroma7247]

I finally figured it out. Chris is Robert Fripp, but with less guitars.

[@trevorford8332]

I've always been fascinated by neutral networks, when I had a mini stroke it was a good opportunity find out how brain works inparticular when parts of the Neutral network dies as with the brain functions you can find many examples in life!! 😊

[@vvwording4844]

A stroke has its advantages: one of the main jobs of my brain after my stroke has been finding those advantages. In stroke-land curiosity and a touch of humor are good allies in the war against Big Nurse.

[@trevorford8332]

@@vvwording4844Oh god yeah, definitely recommend a good sense of humour!!

[@MicrobyteAlan]

Good topic. Interesting and well presented. Thanks from Florida’s Space Coast

[@gpalmerify]

Howdy from Houston 🚀

[@joeyhillers9460]

Smack dab in the middle of Missouri

[@jerrygundecker743]

Your AI could be named Mr. Magoo. "Oh, AI, you've done it again!"

[@allluckyseven]

Very interesting. I don't know exactly how do they work (or this specific implementation), but seeing the wooden spoon suddenly turn into a drumstick makes me think that the AI should consider not just the current image it's seeing, but also the previous ones. Not all of them necessarily, but the wooden spoon hadn't even left the screen and it thought it was something else. So it should consider tracking the objects, the history of images analyzed, and maybe it could work better with a second camera or depth sensors to read what's in front of it.

[@ExplainingComputers]

I like your line of thinking here. The demo I imagine interprets each frame in isolation.

[@robertparenton7470]

Thank You! Will now buy one from Amazon!

[@elviraeloramilosic9813]

Great! Hello Chris! 👋🏻 Beautifully done! Amazing demo of AI recognition software! Yes indeed, I could play with it as well all the day. And with all this repository/cloning/making/compiling software preparation! Exciting!

[@ExplainingComputers]

Hello Elvira. Here we are again. :) I look forward to trying to train a neural net . . .

[@elviraeloramilosic9813]

ExplainingComputers Yey! And somehow I thought this is going to be your next idea to try...

[@ExplainingComputers]

Our great minds clearly thinking alike there! :) Soon an AI will beat us to it though . . .

[@elviraeloramilosic9813]

ExplainingComputers 😅😬 Me: HALL, open the main door to computer core. HALL2000: ...

[@rayrayray63]

To name it after a fruit when it can recognize fruit is just nuts.

[@mickelodiansurname9578]

And of course nuts are technically fruit. So now its just confusing.

[@spuds6423]

@@mickelodiansurname9578 but it certainly not a vegetable. 😃

[@AngryRamboShow]

You're awesome! Thanks for the Jetson Nano coverage. Hope you keep it coming! You have the greatest channel on KZbin for cool tech.

[@Qoow8e1deDgikQ9m3ZG]

actually NN is a classifier .... of the present 1000 object in this example.

[@Tangobaldy]

Yay an explaining video. Noice. This single board reviews don't interest me. But what they can comment great to learn. I wonder what the dnn recognised you as?

[@ExplainingComputers]

I never tried looking at the camera! :) But there are no people in the list of 1000 things this sample net can recognize.

[@Gdolwell]

As much as I love the specs of sbcs, use cases are much more interesting.

[@qzorn4440]

well at least working with the raspberry pi opencv is a great exercise in downloading soft-stuff to the nano..:) thanks, great hello world neural video

[@TheNZJester]

That darn ghost jellyfish was always there hiding, but the computer spotted it. ;-p

[@BharatMohanty]

Nice and informative video sir 1. neural network image recognition with terminal on looks like a scene from Hollywood movie 2. Neural network needs to learn that Englishmen prefer tea over coffee on any given day. 😀

[@prasadstech4033]

Nice video.A very nice presentation on a sophisticated topic Well Done!!

[@junkmauler]

Would love to see you take this a tad further and actually show the learning/training process of adding new objects for detection.

[@ExplainingComputers]

I may show training in a future video.

[@mack_solo]

considering a wooden indian elephant was presented, being 60% confident it was an african elephant, was rather specific and amusing. this highlights how A.I. being not competent enough in generalisations can be a threat to humans (case in point: a stop sign, with duct tape stuck on it, not recognised by driverless vehicle) still nothing beats seeing a jelly fish :D

[@user-vn7ce5ig1z]

As a jellyfish, I am quiet concerned that AIs are already programmed to recognize us at all costs. The future does not look good for jellyfish-kind. 😲

[@ExplainingComputers]

:)

[@mrkitty777]

Cats like fish too.

[@billfield8300]

VERY interesting topic. I am looking forward to learning how to teach it new items such as faces to identify people at my front door. Or so my robot can address guests by name and know what drink to offer them...

[@shahnoorhossain]

Great video, but honestly at times I was expecting bungle and zippy to pop up from somewhere 😂

[@kokopelli314]

Add a text reader and you have a prosthesis for visually impared.

[@xdxfxzx]

Would love to see more videos with this board. The gpu on it makes it infinitely more usable than the Rpi

[@ExplainingComputers]

Next Jetson Nano video on Sunday!

[@geofftottenperthcoys9944]

Thank you for another great vid mate! Cheers from Perth, Western Australia.

[@ExplainingComputers]

Greetings back from the UK! :)

[@steve6375]

Great video! I would like to know how to train it to recognise new objects and how to train it to distinguish between very similar objects such as different types of apples or human faces or breeds of dog, etc.

[@ExplainingComputers]

There is a training demo: see developer.nvidia.com/embedded/twodaystoademo and the section "Employing Deep Learning".

[@FailsafeFPV]

Do you plan to take a look at the Atomic Pi x86 sbc? I have just brought one.

[@ExplainingComputers]

I have not managed to get hold of one . . . Yet!

[@Hopefu11y]

Great video as always! Had to chuckle at 9:24 though...jellyfish xD

[@SuperU2tube]

It didn’t guess “wooden elephant” so I wooden trust it!

[@RocktCityTim]

12:42 - Dumbbell and then a nematode! What are you not telling us, Christopher??? :D

[@SaccoBelmonte]

Fascinating, you should make it harder with reflective objects such a metal ball, mirrors, crystal objects and see what happens.

[@ExplainingComputers]

Yes, I should try to confuse it! Although the teapot was reflective.

[@SaccoBelmonte]

@@ExplainingComputers Trying to confuse it will make for a great video :D

[@SaccoBelmonte]

Keep the good job man, you rock!

[@panvrek8952]

Wow you know, it's my first time seeing something like this. Thanks

[@hans_____]

that was the most beautiful jellyfish I've ever seen.

[@magefront1485]

DNN is a bit confusing, it could be referred to Dense Neural Network. I think in this case the architecture of the fruit recognition network should be the well known InceptionVx(might be 1-4) trained on the dataset imagenet. Nice video Chris, hope to see how this little beast performs on face recognition.

[@ExplainingComputers]

I take your point on "DNN"; I used the term in part because it is the one NVIDIA use.

[@suvetar]

I wonder if the console output could be tweaked for it to say what it thinks the alternatives are; I mean - I know it flashed up snorkel when showed the water bottle for example, but for when say it was 60% sure that the object was an elephant, what was the other 40%? I don't know if the software works like this, but perhaps that 40% could be used at back-propogation data? Just a thought anyway! Thanks for the great video as always! Fascinating subject and you introduce it in a very painfree manner!

[@sevdev9844]

Interesting. Another program on top of it needs to recognize that something is still the same object, if it didn't disappear or had been transformed. So a spoon is still a spoon, because it looked like one some second ago and didn't disappear.

[@АлексейГриднев-и7р]

Should not be too hard to implement. You could just write a code which, once an object is identified with a high degree of confidence, just sticks to the same label until the degree of confidence for this object drops to a very low level, let's say 5% (which will happen if the object is not in view anymore).

[@menghuajiang3509]

It cannot seem to handle transparent object... I wonder what if you show it a mirror?

[@cloudcloud1]

*Again* a great video.🌺 Curious what KI will do in the future? Paradise for technically interested people. I assume NVIDIA will make a lot more possible.

[@angelg3986]

It'd be interesting to compare with recognition run on the new RPI4 (on-CPU execution of the NeuralNet)

[@ExplainingComputers]

Yes, Pi4 AI performance will be interesting to assess.

[@jeanphilippeardrone5135]

I can see you have good wine tastes. You picked up a bottle from my region.

[@chriholt]

Fascinating technology, and well-presented as always. Thanks Chris!

[@GervasitorSpaceman67]

Nice video ! Now I want to get one, it's nice to be able to play with AI for that price.

[@AZZapper1]

Thanks. Great video. What video capture you used in the Jetson... and what steaming software.

[@ExplainingComputers]

All capture is done using an external HDMI recorder -- here a BlackMagicDesign 4K. No streaming software.

[@PrasannaRoutray97]

Thanks for the video. Is it possible to have some information about FPS during inference and simple tracking?

[@ExplainingComputers]

You can see an FPS display at the top of the Window I think. I will be posting another Jetson Nano AI video fairly soon! :)

[@Jayenkai]

Did anyone else catch the "Nipple" during the water bottle bit?!

[@Rich-on6fe]

Yes, at 10:30 - it shows how highly trained and optimised our tiny minds are. Good to see that he was wearing clothes when showing the teapot.

[@jamesrosemary2932]

How about the consumptions and temperatures of the board when running this AI?. I'm planning to recognize my car when I aproach my house to open my garage door and other things. Yes, it's a silly project but fun to do, and I wonder if I can do this with batteries.

[@ExplainingComputers]

I like your idea! :) I am thinking of doing a benchmarks/tests video.

[@jamesrosemary2932]

@@ExplainingComputers Thanks!

[@林宜宏-m4e]

hi chris : quick and clear, i think that jelly fish may be mean your hand !

[@kingmarviemarv]

Great video on the Jetson Nano. I've enjoyed watching this video as a first time watcher and subscriber. Can the Jetson Nano be used as a 3D scanner as well?

[@ExplainingComputers]

Thanks for watching and subscribing. There is certainly 3D scanning potential here, although the Jetson Nano only has one CSI port.

[@marathonmanchris]

This is great video, thanks, can hardly wait to try it!

[@splyit]

this is very facinating

[@twmbarlwmstar]

Really old school Clive OU feel to this week’s episode. Have you seen the prices of some of these Jetson’s- I think mainly for educationalists (they get a discount) and enterprise? A million miles from a Raspberry Pi (although the Foundation will shift a few cameras thanks to it). Amazing the power in such a small form factor but completely beyond me, my bank balance and my fumbling.

[@DavidIFernandezMunoz]

Given the list of videos on the way, with over 40 in the pipeline, it certainly is bold of me to request an update on 2019 Linux distros but, well... there you are...

[@ExplainingComputers]

May well happen! :) I am likely to focus on Linux quite a bit in the second half of 2019 as Windows 7 support nears its end.

[@srowley85]

I’m wondering if this technology could be used to detect color differences or intensity. I’m thinking that it could have applications in the monitoring of chemical reactions that involve color. Any thoughts?

[@ExplainingComputers]

Almost certainly. I strongly suspect that colour and texture information is being used in the vision recognition we see in this demo.