Building a Touchscreen Smart Robot Remote

[@ellabun]

James: **carefully designs and prints perfect fit for display** Also James: **designs and prints additional 15mm bezel around display**

[@lazermaniac]

It's like a thicker, heftier version of a Switch - you've build the Nintendo Breaker!

[@StarScapesOG]

I would call it the Super Nintendo Switch

[@jdmeesey]

James you j need to interface a tablet/Surface with some joy cons and build a switch-inspired chassis solution!

[@zh9664]

The switch sets a very very low bar so yeah id say this thing is better

[@bobdagamer640]

Thicc

[@JaredConnell]

Hopefully no joy con drift on this one

[@AllDayBikes]

The everything remote is to you what a lock is to LockPickingLawyer, or a pulse jet to Colin Furze. I can't imagine your channel without it. Love the upgrade haha

[@swamihuman9395]

"I don't wanna be driving at 500 meters per second."!:D Delivered in perfect deadpan manner:)

[@thomaslowe7816]

Arduino: Lets sponsor Jame Bruton! James:*Using teensy in literally every project*

[@Dread_Nacht]

What

[@faeranne]

Just so you know, versions of the pi after the original b don't need those i2c wires for the touchscreen. They are already routed over the DSI cable.

[@marco_gallone]

I love the transition into the py for more industry standard robotics development! Keep up the amazing work!

[@MagnusDangerMagnus]

Thank you so much for publishing the source for this.

[@jamesbruton]

No worries, I'll update it as I go.

[@TheEngineerC]

Ive been working on almost the EXACT same project, except with a pi 3 and a waveshare monitor and some pcbs similar to Nintendo joycons. I'm actually powering mine with just a cell phone battery bank that shows the percentage left on the pack.

[@joyleencamielleg7257]

I love the way you explain ROS, thank you so much... never thought of it was a network before :)

[@motbus3]

so cool to see things coming like this together. congratulations and thanks!

[@tncowboybuck]

I love all these projects and that you make them available open source. Just one thought though: It would be nice if you could also provide a BOM. Like what are the joy sticks? What are the buttons? Where did they come from? Keep up the awesome work!

[@AlanPieroway]

i like the way the background is being cleaned up... and looking more professional. but, that being said, i don't care what the background looks like as long as the content continues to be so highly interesting and well done.

[@cad_man]

this fella deserves 1million subscribers. Surely!!!

[@jameshamaker9321]

I agree. I happen to be one of the first people, to have subscribed to his channel. I'm a huge fan of his.

[@LoyvanBeek]

Instead of publishing a Twist and some separate topic for the buttons, you might want to just publish a Joy-message, specifically made for joysticks. There's a joystick_teleop node that ingests that and outputs /cmd_vel. That setup allows for remapping of the buttons and axes. Also takes care of the deadzone, scaling etc. There's a joystick node that uses in a Linux joystick device to publish Joy-messages. Then, you can make your handheld controller act as a normal joystick device via the Teensy. That way, it'll also work as a joystick if you plug it into a Windows machine, as it's then just a normal plug-and-play joystick device

[@eknut28263]

Now that's a badass remote! Endless possibilities, Nice work!

[@vrohh6310]

1:52 nintendo switch Look at this dude

[@laxmiibhele8376]

Congratulations 🎉 James now 😀 you have sponors like the great Arduino 🔥🔥🔥🔥🔥

[@SavageSmithy]

ROS sounds like it could be a pretty good base for a home automation project, cheap easy touch screen control panel in every room which can all share data and then you can either pass that data to other services or set up "robots" to control appliances/lighting.

[@jamesbruton]

Yes it's pretty much just a framework, so you could control anything with it.

[@swamihuman9395]

Thx. Always over the top; and always explaining things so well. I love all the details you offer, and insight into your design thoughts.

[@jakekeip]

I love this idea and would like to reproduce it for my own projects. Is there a parts list for the components that are used in this build?

[@BenjaminK123]

i love your videos but it makes me realize just how simple i am lol, i have tinkered with this stuff but you are on another level

[@wafje]

I would publish values from 0-1 from the remote. The subscriber (in this case the robot) should then map these to speed values.

[@fred-9929]

A dedicated hat with the Teensy and all I/Os and connectors (I²C, SPI...) could be nice, to avoid USB cable (by directly using the serial port on GPIOs), and allows further developpements.

[@RingingResonance]

I don't know much about the ras-pi hardware/software, but having direct IO access might also help reduce latency.

[@roseroserose588]

This ROS stuff is looking amazing! I'd never have imagined that a distributed OS would be fast enough for real time controls but apparently not! One thing I'd be a little concerned about is if the remote runs out of battery while controlling a robot, in case the robot disappears off into the distance with no way to stop it. Implementing a heartbeat/watchdog timer from the remote to say "hey, i'm still here!" that the robot subscribes to, and automatically shuts down if it doesn't receive the message after a timeout?

[@jamesbruton]

Yes that's a good point. That could just be another ROS message on repeat.

[@akshaypadmanabuni2075]

I want to build something like but have the device function both as a game emulator and a controller any leads on it?

[@cjdoesyoutube6148]

James every single episode: Oh yeah, it’s big brain time

[@mertcapkin7263]

Where can I get those joysticks?

[@DylanMatthewTurner]

Maybe I missed it, but why did you use the teensy to connect to the buttons and joysticks instead of just using the GPIO already on the Raspberry Pi?

[@danielh.8836]

The raspberry pi has no analog inputs. The joysticks need them so he needs some kind of "converter"

[@jdwg5]

Hey James! There's a ROS topic called sensor_msgs/Joy that has an array of floats for the axes and an array of ints for buttons/switches/states. Might be something that could be pretty useful for this application!

[@StevenIngram]

I like it. It reminds of the controllers they used in the movie, Real Steel. :)

[@danielfernandezgarcia4159]

How do you power raspberry pi?

[@Nordseeluft]

Is there a video about the everything remote? i cant find one unfortunately.

[@jamesbruton]

Somewhere in the start of the openDog (original) series

[@Nordseeluft]

@@jamesbruton Thank you!

[@TheRealFrankWizza]

Do you have any code showing how to move motors on a client requesting servo angles from a server via tcp or udp? for example, I am trying to use a pi as a webcam, do some color tracking on the jetson nano, and send the angles back to the same pi with the camera, which is attached to the servos. A remote tracking cam. I have the video working, and the servo angles outputting. I can bind the socket, but my while True loop locks up when I try to create a data connection. I should know this, but I should also learn ros. This looks very practical.

[@vihangpathak9759]

In love with the amount and quality knowledge you share with us thank you❤

[@WistrelChianti]

Such a strong Lemmings vibe from the printing music this time :D

[@deemaagog]

What type of wireless connection do you use? wifi? bluetooth? Is it possible to use nrf24l01 or LoRa?

[@bizzehdee]

Another advantage of 1, 2, 4 and 8 being bits on an int, is that you can press multiple buttons at the same time, and would send something like 3, which would be 1 and 2 being pressed together. Where if you sent 1,2,3,4 for each button, you would never know if 3 is button 3, or 1 and 2 at the same time, so you could never combine buttons.

[@Flynn3778]

Hey @jamesbruton have you any plans to update the remote?

[@SeerOfVoid]

Why not use HID to send the joystick and button values over USB natively?

[@bbogdanmircea]

Amazing idea for a controller! I have a suggestion, it would be really nice if you could make some diagrams to show how the RPi interfaces versus the Teensy over serial with the rosserial as protocol and so on, it would make the understanding much more easier. Looking forward for you to push the designs!!!

[@jamesbruton]

The Rosserial Node runs on the Pi, it talks to the Arduino/Teensy over serial using the Rosserial Arduino library

[@bbogdanmircea]

@@jamesbruton Some nice diagram with devices and protocols would help, you can take some tips from Andreas Spies, he is a master of concise and simple explanations.

[@maalonszuman491]

hey first of all thank you for your video i realy like them, juste wanted to know what os run on the raspberry pi in the remote

[@atticuscorbitt8199]

Something like this would also be great for making a portable RPI emulation console, just swap out the joysticks for ones from a regular game controller and maybe tweak the design a bit to accommodate a dpad.

[@balazsszegedi5524]

Hi! How can I learn to program things like that?

[@michaelmbutler]

@james: What was your source for the three-axis joysticks?

[@svenbbb]

I was thinking how great it would be if you would make a Puzzle Box. Like the ones on the channel of Chris Ramsey. That would be so fricking awesome. To see your mechanical skills in a Puzzle. Maybe you could do a collaboration!

[@nevillecreativitymentor]

I hope to do this in my upcoming Open Source Hardware GIS Drone (Fixed Wing)

[@ConspiraGoose]

Why not hinge the keyboard and or trackpad/mouse off of the workstation?

[@fpvnafret]

thanks for sharing all this knowledge with us, you are the best! :)

[@4.0.4]

Never heard of ROS Serial before. Sounds neat! Also you could use the power of 3D printing to make it more ergonomic than that shoebox shape lol

[@elden4267]

do you ever hear about i/o expander ic you can even make a controller with attiny85 and a I2C io expander

[@rikschaaf]

You should add a d-pad, one extra button and shoulder buttons. Then it'd be a good retro pi handheld :D

[@manoi2010]

How much cost your robot dog RTR with controller and preprogrammed? Please let me know thanks have a good day

[@mihumono]

You do not need the sda and scl wires. I2C goes over the DSI cable. You just need 5V, GND and DSI ribbon connected. EDIT: only pi 1a and 1b required separate I2C connection.

[@postualin6551]

Thats how world makes beter and beter ! This wil be useful for my other robots

[@slacksthegreat]

Nice clean prints compared to when i started watching your videos. I spend way too much time aiming for perfect quality for final prints.

[@mpovid]

I probably would've stuck with a dedicated radio link like the nrf chip so that when you pipe lidar or image or tf data to the pi screen it doesn't delay your control inputs

[@RingingResonance]

Or have the option for both.

[@aaravsamtani5499]

He is very talented.

[@InSsSaNe1337]

How is the information from the joystick, computer and robot transferred? Is the ROS system "conversing" over WiFi? Or Bluetooth? Or something else? I'm relatively new to ROS and I've only sent information over USB and Ethernet cables.

[@simonvandenbossche9804]

What joysticks do you use?

[@KylePapili]

When do we get an update on ROS robot butler!?!?!?

[@jamesbruton]

Next week!

[@MuhammadDaudkhanTV100]

Very good work and cool

[@this_time_imperfect]

Nice looking JoyCons

[@CShand]

Where did you get the joysticks from eBay on returns gaming joysticks or PS2 ect

[@mehulsahu3683]

i want a circuit diagram of remote

[@maximepolydor6446]

you could also put a microphone and do vocal instruction trough the pie

[@roedyhellyeah]

i've worked with Tkinter for some things and that worked great. i also saw some nice things made in Dear PyGui

[@GmanBB]

You can use ESP32 with micropython firmware. It has analog and digital pins, which can be assigned as inputs or outputs. Check also M5 stack core 2 or other ESP32 boards.

[@antonwinter630]

great upgrade to the remote. what are the details on that touch screen? do you have a link

[@jameshamaker9321]

This is really good stuff. I'm curious as to wether or not this controller could be used, for driving a small, electric vehicle. Like a remote control, go kart. 😊

[@lolous-studio]

Ho, A new video ! Bam, Instant like !

[@mrwhiskers8951]

Could you recommend to me a 3d printer?

[@Thuliolima2008]

Very Good!

[@CyberSyntek]

Looking good. Man I should have used those joysticks on my robot controller. Any idea on how easy they are to mod into throttle style sticks by extracting the tension springs? Needed throttle sticks on my 34 analog input controller but would have been nice to have a bit larger sticks like what you are using.

[@starblastershooter2444]

Need to make one of these myself

[@legender576]

Love your work!

[@mohitarora1701]

I think you are one who didn't believe in small size is great projects or to look cool, large projects are also look cool 🤟🏻

[@albertolr98]

Where could I buy the 3DOF joystick??

[@Scott_C]

I just put "3 DOF joystick" into Amazon and there are tons of them.

[@albertolr98]

@@Scott_C thank u 😁

[@Scott_C]

@@albertolr98 also eBay may be a good source www.ebay.com/i/302526181730?chn=ps&norover=1&mkevt=1&mkrid=711-117182-37290-0&mkcid=2&itemid=302526181730&targetid=934793862176&device=m&mktype=pla&googleloc=9008143&poi=&campaignid=10460106669&mkgroupid=106723175187&rlsatarget=pla-934793862176&abcId=2146001&merchantid=118841012&gclid=EAIaIQobChMIqvqTtsW-7QIVDYrICh1fBAe3EAQYASABEgJ14PD_BwE

[@viswadeepkopalli6160]

So im assuming that you are using ros melodic on the workstation are you having any problems if you use kinetic packages in melodic ?

[@jamesbruton]

I can't say I've specifically tried it, Melodic support is pretty good.

[@viswadeepkopalli6160]

@@jamesbruton thank you so much for replying pls do more amazing videos like this 🥺.

[@richardlincoln886]

The generalisation ROS appears to provide seems to make everything else overly complex.

[@OleZZ222]

Ob my first projects I used PyGame as well. PyQT with QT Designer could be a better option for you programming an GUI instead.

[@poseidon8526]

would you ever consider building D-0 from star wars ep. 9?

[@hansdietrich83]

Aragafar everything is so chunky! My brain is crying everytime

[@hsmptg]

Great Controller!!!

[@hsmptg]

Can you share the link of the joysticks?

[@cgirishvarma2466]

Quality 🤩🤩🤩

[@pd.dataframe2833]

Hi James, Can we use arduino ros library directly on teensy boards?. or is there a separate fork for that?

[@jamesbruton]

Yes, but by default it only works up to Teensy 3.2. Use the one I hacked for the RUR which goes up to Teensy 4.1: github.com/XRobots/ReallyUsefulRobot/blob/main/arduino/ros_lib_modified.zip

[@pd.dataframe2833]

@@jamesbruton Thanks a lot james! what is the main issue for 3.2 + above boards that needs library upgrade.

[@Morphexe]

Omg you made a nintendo switch :D This is looking sleek :) Cant wait what you do with it.

[@muhammedcoskun8697]

Amazing

[@dans-designs]

Hey James, great video! Have you heard of RemoteXY? its an app based remote control for bluetooth arduino devices with a customizable gui..

[@thorley1983]

Which joysticks are those. they look like really good quality kit. have you got a link to them online?

[@jamesbruton]

Just look for '3 axis joystick' on eBay - they cost about £10 from China

[@thorley1983]

thanks bud i found them. im think theyll make a great thruster controller for elite dangerous. sort of NASA style

[@clementferry6122]

Do you have a like for the joystick 🕹?

[@g0935260205]

why don't use the teesy serial to rpi serial、this sol may be more reliable

[@TulipsxJasmines]

Isnt this just a nintendo switch?

[@santosvella]

You can get a 3/4G and SIM hat for the PI.

[@googlyeyes3237]

**comes to comments*, *sees people typing numbers**

[@vallisparmentier9764]

> sees people typing Are you sure those aren't *bots* typing?

[@googlyeyes3237]

@@vallisparmentier9764 are u sure ur not a bot ?

[@thomasre8073]

Awesome.

[@zihagamers4073]

So cool

[@ei23de]

Hi James, if you connect the Teensy directly to the Pi GPIO Pins you could use one of the internal UARTs for serial connection. The Pi 4 has enough of them ( www.raspberrypi.org/documentation/configuration/uart.md ) and you could save space and a usb cable ;-)

[@luqman._munir]

oh hey! can you make a robot that move exactly how you move ur limbs?

[@RockingKT]

Why not hack a old PSP to run a ROS Node. You get a screen, a joystick, a d-pad, XO buttons etc and Wifi