LEGO EV3 Raspberry Pi Tensorflow Sorting Machine

This is a sorting machine based on the EV3 45544 education kit sorting machine. The colour sorting camera is substituted with a Raspberry Pi with the v2 camera. The EV3 is controlled over wifi via RPyC and the object recognition work is done via Tensorflow.
This is a relatively simple project to make with all the libraries and parts readily available. It is a great project for schools and hobbyists, and can easily be modified and expanded into more complex tasks.

[@珊珊李-h5n]

Hello, I am going to build a lego model that will also be controled by EV3 and RaspberryPi. And I meet some difficulties. I would like to know how to create communication between EV3 and RaspberryPi? Could you send me some instructions? I would really appreciate if you could give me a help. Thank you.

[@ebswift]

As an update, during the last week I had a year 10 student replicate this design. It worked perfectly and he left with a solid sense of achievement. Any school can bring very modern AI and robotics into the classroom with little investment for a very rewarding activity.

[@trp79]

Great setup and showcase for AI :-) Can you share links about how to train a model on the PC and move the trained model to the Pi?

[@ebswift]

Glad you like it :). Training the model on the PC is following the guide for Tensorflow for Poets codelabs.developers.google.com/codelabs/tensorflow-for-poets/. All you do is install Tensorflow on the Raspberry Pi, clone the github repository onto it and copy the model you trained from the codelabs article onto the Raspberry Pi to run the classifier as per step 5 of the codelabs article. Onboard image capture on the Raspberry Pi is just done using picamera. I used a tensorflow version that a user compiled for the Raspberry Pi from here: github.com/samjabrahams/tensorflow-on-raspberry-pi/issues/92. I might do up more of a general step-by-step sometime on my site, I'll report back if I can get that up and running.