Edge AI with a Coral AI Google TPU on a Pi 5. | Full Project Tutorial with Demo.

[@M4XD4B0ZZ]

Damn i was hoping to use the coral TPU to set up local LLM's maybe with crewAI or similar 😕 are there maybe alternatives?

[@AdvancedHobbyLab]

The Hailo-10H claims to be able to handle LLMs and should have the same M.2 form factor, though I don't think it is released yet. You could also look at one of the Nvidia Jetson dev kits.

[@M4XD4B0ZZ]

@@AdvancedHobbyLab I'll have a look, thanks for the heads up

[@ccnppro]

@@AdvancedHobbyLab TY for this answer, I spent far too long looking for videos of using the hailo with a llm before seeing your comment here!

[@alimohsen7071]

thanks for this tutorial . I have questions about how you operation the camera and how install picamera2 with edge ?

[@AdvancedHobbyLab]

Thanks for watching. In my video, I just used a USB webcam so I didn't need the picamera2 library. Fortunately, picamera2 and tensorflow have python interfaces so connecting them shouldn't be a problem. I might do a tutorial in the future about how interface the picamera2 library with the TPU.

[@BlockVilleSalazarJr]

Hey man I have a question about kinematics you designed for a spot micro project what is the best way to contact you?

[@AdvancedHobbyLab]

For quick questions/comments, the KZbin comment section is great. For longer discussions, you can message me on facebook. I try to respond as quickly as I can.