YOLO Object Detection on the Raspberry Pi AI HAT | Writing Python Scripts

[@WATCHMAKUH]

Very lovely channel to stumble upon when searching up info for the AI Hat….finally a super simple and clear host explaining the code in parts and how it functions and how you can use it to the real world.

[@algobit6011]

Love all your videos, keep up the great content! I’ve had the AI hat for a while now. I ran all the demo scripts from Halo, but found them “difficult to adapt” to simple use cases such as you demonstrated. Finally i can start using the AI accelerator instead of having it collect dust in my parts bin! I’m looking forward to your next AI tutorial, and hoping that you can show face recognition technique with AI hat, like in one of your recent Pi4 with open CV tutorials. Thank again for sharing your knowledge!

[@user-ue7mw7hg7n]

5 likes time to give us an update on your progress

[@AnakChan]

Awesome! I just received my Pi Hat+ & my Pi Camera AI from Core-Electronics today this is a good intro on how to install the req repositories to get starting. Very useful!!

[@SuperAdventure11]

I love you man 😭 literally saved my life

[@gearscodeandfire]

Great episode, new fan

[@damanivu]

WOW! What a great video. Found you on IG. Thank you.

[@ec11368]

Thank you very much for all the information

[@matthewkolb9950]

Great content! I would love a video showing us how to create and implement a custom model. Thanks!

[@Core-Electronics]

Its on our to-do list!

[@adarshshaji4329]

Is it work on multiple object detection with facial recognition in projects like real time ppe monitoring system

[@Eriiiiiiiick]

AWESEOME. THANK U SIR

[@BrawlStars-sm1el]

Can't wait when you will show, how to scan QR codes on raspberry pi 5.

[@PhatTran-cp8yf]

please help for full screen displayed in Hailo detection app. I am appreciated for any support!

[@zullakai9274]

Do you think it possible to create model that can detect sign language and use the hat at the same time

[@Core-Electronics]

It might be possible but it would be a very involved task. You would need to start by training a YOLO model to detect sign language which may be the hardest part to do reliably. If you can achieve this though, you can convert the YOLO model to the .HEF format and run it on the HAT.

[@tuncfreeman]

🎉 Thank you for informative video. I have a question about: Is it compatible with Raspberry Pi 4B 8 GB?

[@Core-Electronics]

Unfortunately it isn't, this uses the PCIe slot which was introduced with the PI 5.

[@Unrealizedlosses]

This one is SO much faster than the models in the last video. Do you know if there is a relatively easy way to pull in the yoloworld model here instead of Yolo8 or whatever its using? Or a way to leverage this speed with the way you demonstrated Yoloworld in your last video?

[@Core-Electronics]

Unfortunately we are out of luck here. There is no way to usual Yolo method with the HAT as it uses a completely different workflow and needs a model format called HEF. You can convert normal Yolo models to HEF with the Hailo Dataflow Compiler, but it is a little bit of an involved process - not impossible though. You may have some issues with converting Yolo World as well, and once you convert it to HEF, you have locked in the prompt. To change the prompt you would need to re-convert it to HEF. This may change though! The HAT is still relatively new but lots of very clever have access to it, so maybe in time!

[@ywhenry]

Can we connect to security camera via rstp?

[@Core-Electronics]

We do not cover that unfortunately, but it can take in a variety of input sources so there is bound to be a method or library out there that can serve it as an input.

[@germancruzram]

Hello, excellent content on your KZbin channel Do you know any option to adapt the 15-pin cable of the raspberry pi5 camera, to connect via USB and dispense with the flex cable (sometimes very short)?

[@Core-Electronics]

Hmmmmm I can't say we have seen one of them before. As a 2nd best, you can get longer camera cables, here is a 0.5 meter one for the Pi 5: core-electronics.com.au/catalog/product/view/sku/CE09777

[@nutsandbolts432]

Can 2 cameras be ran simultaneously on 1 pi with the AI + hat?

[@Core-Electronics]

We have seen examples of it being done, but we weren't able to successfully do it with the Python pipelines. There may be a way to dig around and modify the pipeline to do so, but out of the box and from what we set up in this video, unfortunately no 😔

[@SA-oj3bo]

Hi, do you know how to use webcam and ip-cam with RP5 + Hailo?

[@Core-Electronics]

When we run the --help option to see all the pipeline options you should see the option to instead use a webcam. In the basic_pipelines folder, you will also find a script you can run which detects your webcam name to use with that pipeline option. In terms of IP-cam that might be a little more involved, and if the setup won't natively take an IP-cam as an input, you can definitely find a library to do so. If you need a hand with this, we have a maker forum where you can post this question, we have a lot of makers over there who can help. forum.core-electronics.com.au/

[@jaimevalerio359]

Can I count the number of green cars the camera sees ? Or the number of red skittles in a bag?

[@brunofilipe7310]

Can we use the new AI Pi Camera ? If yes, can we even acelerate the processing with it ?

[@Core-Electronics]

Both the camera and HAT need different model formats to run. We haven't tested, but its likely that you could run the AI camera and the AI HAT at the same time on the Pi, but they would both be running separate models. It is extremely unlikely that you could use both together to accelerate the processing even more. We also don't have a solid figure, but I would guess the AI camera is around 4 TOPS (a measurement of computing power). The AI HAT comes in a bigger 26 TOPS version so 4 extra tops wouldn't do that much.

[@brunofilipe7310]

@Core-Electronics Yes we can, i tested but i wish that were somehow campatible to accelerate even more the process

[@cherianmpaul]

Is there a pipeline code for facial recognition, so I can use the AI hat for face recognition?

[@Core-Electronics]

Right now we haven't seen anything, Hailo has only provided ones for object recognition, pose estimation and segmentation unfortunately, a good bet you'll see more from the community in the future though!

[@cherianmpaul]

@@Core-Electronics Thank you for your response! :)

[@halbgeboren1291]

There is an error when you type ./install.sh

[@peiboldans6339]

How can it be used to detect let's say Pikachus? Probably we have to train the model; but can you help us on that?

[@Core-Electronics]

You will need a custom model, but thankfully someone may of already trained one for you as there are Pokemon detection models on Hugging Face: huggingface.co/models?other=yolo&sort=trending&search=pokemon The next step is to use the Hailo Data Flow Compiler to turn it into the HEF format that the HAT needs. This can be a bit of an involved process, but its not impossible. If you don't wish to go through converting the model, we also have a guide on running the YOLO model directly without the HAT. It is slower, and doesn't use the processing power of the HAT, but its very easy to use custom models. kzbin.info/www/bejne/jnysnpKIlNd8m7M

[@shirin.b1238]

how do I train the model to only recognize chickens?

[@Core-Electronics]

Using a custom model with the HAT is unfortunately quite involved - not impossible, just not easy.Y ou will first need to train a YOLO model to detect chickens, then use the Hailo dataflow compiler to convert the model into the .HEF file format the HAT uses. A good first check would be to see if anyone has already trained a YOLO model to detect chickens, hugging face is a good repository of models and here is a link to pre-trained yolo models. huggingface.co/models?other=yolo

[@shirin.b1238]

@@Core-ElectronicsMy raspberry pi just arrived and i tested it and it recognized chickens as "birds" so would that be good enough for my automatic chicken feeder??

[@Core-Electronics]

If it works, it works. Didn't know it recognises chickens as birds but helpful info, cheers!

[@kritikusi-666]

hide pies, this guys coming after them. LUL

[@Core-Electronics]

Are we talking meat pies or Raspberry Pis? Cus ill take both.