Robot Dances so You Don't Have To

[@integza]

The project is awesome but Ive seen you dancing and you're pretty good at it

[@rayyankhan4737]

Well integza is interested so WATCH OUT!!!!!

[@JohnDlugosz]

You could make an infuriating piece of art that shows an image that draws your attention when seen in the peripheral vision, but blanks out when you look directly at it. How about an automatic "boss key" for your computer?

[@lucachacha71]

Fucking genius man

[@FHBStudio]

I've been thinking there should be a horror game like this. Monsters appear exactly where you can't see them.

[@ezrarichardson279]

This would be awesome!

[@Francois_Dupont]

Absolutely Demonic!

[@Dysgalt]

There's a book I read once about a necklace that makes it very difficult to look directly at the wearer, would be cool to see those two used together

[@albertweber1617]

There's a security vulnerability to your priority code. If someone comes in the field of view with a giant paper mâché head, they can steal control of the robot from anyone at much greater distances

[@glowytheglowbug]

XD ah yes the new weapon for hackers the paper mache head

[@GreenJimll]

Ah, the famous "Frank Sidebottom" attack. :-)

[@NickCombs]

It will become an arms race to see who can emulate the largest head.

[@mozkitolife5437]

Nerds be taking their security seriously these days.

[@monmagog]

Or make a regular sized paper mache head with the eyes super far apart

[@grahammcnally4799]

Smoothed out eyes makes it look tired. Eyeballs don't decelerate like that.

[@serversurfer6169]

Yeah, look into saccades. 💜🤓👍

[@StefanPetter]

This is really awesome! You make it look so simple :) Using the DMX/OSC/MIDI stuff to control the robot is brilliant! Would've never thought of that myself

[@newmonengineering]

Nice use of pre-existing technology!! That saved tons of dev work. I may have to look into using that!

[@Jon.S]

Random idea and I know it’s just a test bot, but I reckon you should add random blinks to the eyes, just to make it even more immersive.

[@naysaykiller928]

They gotta be fast too. To look realistic.

[@Geeksmithing]

+1

[@ericlewis3444]

Agreed, but his does have an endearingly drunk look.

[@richardsuckerson49]

Yeah a quick delete on the servo smoothing only on the eyelids and randomized actuation would be neat

[@stevenfaber3896]

GREAT use of FOS and great use of different aspects coming together and working

[@jtjames79]

I wonder if this can be combined with the head tracking apps that use VR API? Then you could have full body tracking VR without the helmet.

[@StormBurnX]

I know it's such a minor thing but I love how your protoboard almost perfectly matches the color of your filament! really ties the whole project together :)

[@Bigfoot_With_Internet_Access]

Humans have all this technology but still can't find me in the forest smh

[@OrangeJani]

We can we’re just to lazy

[@willexco2001]

It would be quite funny to see your expressive animatronic doing "Baka mitai"

[@stocchinet]

Dame...

[@danisob3633]

dame na no yo..

[@papalevies]

Cringy af

[@Kallichore09]

@@papalevies no u

[@Stoneman06660]

Great stuff. Your generosity with your hard work is brilliant.

[@TehBIGrat]

That's Brilliant using DMX/OSC/MIDI to control a robot. We use QLC+ at out church it works great for controlling a dmx universe and pixel mapping from a single simple interface. I even built a custom midi controller for it.

[@adayinthelife5496]

This guy did more work in a week than a team of engineers could do in a month. And I couldn't understand the monologue.

[@maxxsteele9396]

Just because you don't make videos of you work doesn't mean that you don't do good work. A lot goes into being a KZbinr. A lot goes into being whatever type of engineer you're referring to. I feel that you're going to need to be very specific with the engineering team that can't do what James does in what you think takes a week. There's different types of engineering. Therefore, one size does not fit all. Also, speaking from experience, many people can't and/or won't record their work InProgress.

[@Korosha43]

Awesome to hear your 3D printer running... I know it may not be entertaining for everyone, but I first subscribed because of your shots of the 3D printers without crazy music.

[@holopengin]

You may want to experiment with decreasing your smoothing IMO. The current lerp parameters makes it take a far longer to reach the target pose than is probably necessary

[@epicrodtezla3228]

😳😳😳 wow the smoothness in movements of this robot is very epic 🤝🤝🤝 this by far the coolest thing I have ever seen looks straight out like an animation

[@maxxsteele9396]

This is the answer to why it's important to take your math classes seriously.

[@ernestasgrimas4367]

why?

[@maxxsteele9396]

​@@ernestasgrimas4367 Programming requires everything from binary math to algebra, statistics, calculus, and discrete math. This is why someone with a computer science degree, like my wife, was one class off from also having a mathematics degree. The other class would have been analysis mathematics. I'm self-taught because back in the 70s and 80s we had to know how to program computers to do anything with them. And for some incredibly awesome reason, computer programming was a graduation requirement at my high school in 1988. I was also in a gifted program so I got to be excused from my classes for part of the day to use computers. I mostly just played videogames or made videogames. Yes, math is unavoidable but if you work on projects that you're passionate about then it won't seem like a big deal. And that's one to grow on - *TING!

[@Mrcaffinebean]

@@maxxsteele9396 I disagree, I’m a developer, I suck at math. I think the fact that I suck made me a better developer because I generally want to write things that did the math (and all other tedious work) for me/others.

[@maxxsteele9396]

@@Mrcaffinebean I don't understand what exactly you're disagreeing with me on. I gave a very long winded response to Ernis Grimas' question to my comment.

[@bbogdanmircea]

You are either crazy efficient or really put in a lot of work to be able to make all this in just one week! Really astonishing!

[@franciscourrutia599]

I see that robot and i think of Tobor, the robot from Shakboy and Lavagirl. Very cool video.

[@jaysonbunnell8097]

Teasing us with a non opendog vid!!! Love your content.

[@Im_Derivative]

I love this project and it’s simplicity. I took it as an opportunity to learn fusion 360 better :) - I’m adding a 8x8 LED matrix to the front for a mouth with a small microphone that will be right next to a docking station for an Amazon Alexa. That way it can either use the voice of the person purporting it or pick up Alexa’s voice while it’s running idle animations. I can’t wait to see how it turns out :) I thought my addition might be an interesting way to give the bot a little personality- I guess we’ll see!

[@EngineeringSpareTime]

That’s a really nice addition - seems almost straight forward to implement. I should definitely get a jetson for my robot Thanks for sharing this :)

[@WistrelChianti]

glad you got to take the performance bots somewhere during the beforetimes. Was thinking how typical it was that the moment you have these ready, a pandemic comes along and stops all the fun happenning!

[@wootboy4201]

I would guess that using a kinect camera somehow would help with mapping 3d depth as well which would probably work with the other robots that aren't just on a 2d plane with the arms

[@Nathanboi211]

as someone who had to make a servo work with DMX, thank you for using OSC... lol

[@masterimbecile]

0:45 my man busting a move over here!

[@BoredBoy888]

At the end of the video i noticed the Bender head, how awesome would it be if you would implement those robot eyes in the Benders head so it would be rolling its eyes around while you talk in the background .

[@cho4d]

idk if it was set up this way, but if you are facing the robot, the robot should raise it's right arm when you raise your left arm. proper mirror like. imo.

[@twitte0king]

He said he flip the video of him in editing this video

[@justinberdell7517]

I've commented on this at this channel in the past. I am a graduate student researching new intended motion systems for exoskeletons. My team has created a table-mounted wrist prototype to test our system, but I have created a backpack frame and shoulder that will one day hold the arm. For now it is a geometry test to make sure the links have the proper range of movement, so it is not actuated, but I'm creating the design so that actuators can be easily added later. So since all the joints are passive for the moment, and since I need it to be able to hold the weight of the succeeding links, I need to make the passive joints of the shoulder resistive, so they can move freely but hold their position when not moving, a lot like a laptop lid. Right now I'm using rings of magnets around the bearings but there has to be a better way. Anyone with any knowledge or ideas, please let me know! Thank you!

[@skug978]

I'd love to see this robot mirroring Ricky Gervais' "monkey dance" from The Office, tracking David Brent character on the TV screen.

[@beautifulsmall]

Nice work, just used RS495 with profibus protocol, interesting to hear about the audio protocols.

[@korishan]

Anyone else getting the Hugh Jackman Real Steel vibes?? Obviously this is very early prototype. But could imagine if this robot was larger, servers moved faster, and the camera was tracking a fighter in a control cage to fight another robot???? Robot Fighting Begin!

[@Hybrid.Robotics]

This is awesome, James! You never cease to amaze me!

[@Neumonics429]

I know this is old, but if you use two cameras you could do the 3d trig a bit easier for the arms. You could get the two dancing robots to each have a camera placed on them and combine the data to find the relitive position in 3d. Then use some projection mapping to find the angles of the arms, and then place that onto the servos.

[@electronic7979]

Excellent 👏👏👏

[@Shadow__X]

If you end up using buttons, make them self sanitizing with cloths that wipe them every few minutes if no one is present

[@TacoMaster3211]

Hey James, as another non-touching control, maybe you could use on of those step on piano mats. If you could find one that has midi outputs, you could do that. Or if not, tap into the wiring of it, and use each key as a button press. That way people would just be able to tap the control with their foot.

[@jamesbruton]

I think I featured that in the clip of my Performance Robots

[@ayme9153]

"It dances, so I don't have to!" That's certainty one way to go about it...

[@linkenparis9562]

the eyes and eyelids are too smooth

[@BlueScreenCorp]

This is truly Mechatronic art!

[@objection_your_honor]

Skynet is coming along just fine.

[@TheGreatArloMan]

Man's one bad day away from becoming William Afton. Very cool project!

[@naiyahp]

I like how no one controls it. 🙂🙂🙂🙂🙂

[@Sorrentino_Gianni]

Why don't you use a xbox kinect as a camera? The tool provided for Windows contains different demos, 3D skeleton included.

[@BootlegHuman]

There's a similar webcam software but it's for VR to give you full body tracking using webcams only

[@bustabenson]

Bruton's got moves! 0:58

[@LordCinders]

I've been doing something very similar for my major project (more dofs) and now youtube wouldn't stop recommending people who have done it better. i feel so stupid fml.

[@tremor6160]

😄

[@richardsuckerson49]

Thank you for teaching ai in such a digestible manner. 🦾

[@ArtamisBot]

I love your little robot, it's so cute 💚

[@mozkitolife5437]

3D motion capture just requires more cameras to triangulate positions or use a Kinect.

[@klikfloristpalembang4053]

I hope this project get upgrade

[@risinghead5820]

Would you please show us any replica of your projects done with your viewers.

[@jjohnson71958]

put the cameras in the easy gesture characters eyes and upgrade to usb webcams that can zoom in and out

[@Fantomel1283]

bro was getting sturdy 0:45

[@akashraut3581]

U can try some 3d pose recognition models from rgb input. But getting them to work optimised on jetson inference is hard

[@GeeTheBuilder]

Great video as always James 👏👏👏 THIS COMMENT IS **NOT** AIMED AT JAMES. The very fact James has needed to adapt to think about covid and “not touching anything” is sad. Ok, you could argue that adversity drives innovation. Such as wars. And this video could be viewed in this light (that’s how I choose to judge James’ video, positively) But other large companies are using covid to introduce technological changes that are bad. Such as a cashless society. Anyway, loved this video. That nvidia thing looks awesome.

[@gmergulhao]

thanks! learned new things. Time to buy a Jetson :D

[@giorgioelgar2272]

You should still keep the buttons for accessibility reasons

[@starblaiz1986]

This looks like the top half of one of those Endoskeletons from Five Nights At Freddy's, and we're nearly into October... Are you building an actual functioning Freddy Fazbear animatronic for Halloween?? O=

[@bubbafett2700]

Is it possible to use this type of tec for a animatronic type mask that moves its eyebrows when you move yours for a little bit of expression?

[@MarcosAlonsoM]

Hi, do you know if it would be easy to recognize facial expressions? happy, sad, surprised...

[@HemonDey]

Blown away!

[@firefly2472]

you know those keyboard on the ground you can play music with ? would be perfect for you show aint it ?

[@landroveraddict2457]

To sort the camera mirroring point the camera at a mirror?? I am quite inspired by this. I work with children with special needs this would be an interesting use of ict some of the pupils would love.

[@Jerseylance1]

Great video

[@easyBob100]

Could you use a second camera to make 3d movements?

[@Gotenham]

" whoever has their eyes the furthest apart gets control"...im sure that wont cause any issues later on at /s

[@jaym5602]

The robot looks like Jonny 5 from short circuit

[@Jkauppa]

how about that bench, the fun ride seat, with total freedom with control sticks, to control robots, remotely, or inside one, both are fine

[@Jkauppa]

also leg position/movement, seat on a stick, climb pole

[@Jkauppa]

you can do all demonstrations, no need to touch, or let anyone come too close

[@Jkauppa]

just have it look and point at the closest person, should be spooky

[@ytraidtem]

That is straight up bonbon

[@ericlewis3444]

Uh oh, James is making cute robots now. Time to work with look mum no computer.

[@jamesbruton]

There's a collab with LMNC in my channel from a while ago

[@nick-ti8on]

Is it possible to put the camera in the eyes

[@rob57898]

Is this possible to do on a raspberry pi as I don't own a jetson nano

[@mohammadsedaghat6100]

In this clip, your work is awesome but in two-dimensional mode If you want to control the robot in the 3D mode, how to In the webcam image, get Z?

[@Yoshicraft]

Can you mirror the video before it does the tracking, to solve the mirror issue?

[@ashishachar9386]

Hi James, I have developed similar program for 7dof arm in 3d space.

[@zephgaddielp.sanchez8914]

What kind of servos are they

[@AlbiesProductsOnline]

Simply have each person put on A pair of rubber gloves before touching the knobs and buttons and have a box for people to donate a $1 towards paying for them then you can have both ways

[@bknesheim]

Could you combine the data from two sets of cameras at 90 degree to get a 3D representation?

[@jamesbruton]

Almost definitely

[@reggiep75]

Switches camera on and........ starts robot dabbing!!

[@WistrelChianti]

crikey this is next level...

[@JamieG0303]

Make a 6 or 7 dof robot arm

[@lasprangh6380]

Make one that look like baby groot from guardians of the galaxy

[@vaisakh_km]

Can you make that to ooguye, his smooth motions seems like that

[@MarthinusBosman]

I think the smoothing code is too prevalent at the moment, I'd halve the smoothing factor

[@Scrapyjape]

Could have swarn that your robot dog was at the NEC today lol

[@jamesbruton]

Yep, I was at the NEC today!

[@Scrapyjape]

@@jamesbruton Haha no way must have missed you, I just had a quick pass though as i was doing Interplas today, going to have a better look at the printers tomorrow :-)

[@skrame01]

Awesome stuff. How do you pay for all of this??

[@tremor6160]

I'm guessing from the ad revenue from his youtube videos? Am I wrong?

[@nathanielsantana403]

I wonder what your neighbours were thinking when you were posing and casualy fist pumping mannequin heads to test the code.🤣🤣

[@AliasnodeFP]

Awesome!

[@r.iyushofficial5318]

Awesome

[@divyanshsrivastava7312]

Sir, my team and I are working on making an autonomous rover, we have an Intel Real Sense, an RP Lidar, and few other sensors. Do you think it is worth using a Jetson Nano for the processing as we are planning to acquire one? Thanks 👍

[@divyanshsrivastava7312]

We are using ROS Noetic as the middleware.

[@project-hq]

This is epic

[@MisterFanwank]

Is it Open Dog v3? No? Then I don't care.

[@john2759]

Now that’s cool 😎

[@TheActualMelon]

3:04 Slowly making part

[@venjsystems]

brilliant! ❤

[@rustyscrafts]

Is it necessary to use a DMX shield if you are only controlling one Arduino and no other DMX devices? Or put another way, can QLC+ control the servos through the Arduino but without the DMX shield (or similar hardware like a max485)? I tried searching online without success, but maybe I'm googling the wrong terms.

[@jamesbruton]

You need something to interface to it, you could use MIDI or one of the ethernet protocols maybe

[@rustyscrafts]

@@jamesbruton Thanks for responding! I will probably give in and buy a shield, as I'm not having luck with the other options I've tried.

[@rustyscrafts]

​@@jamesbruton I think I was interpreting the set up incorrectly. I assumed you were connecting the Arduino (with shield) to a computer via usb and the shield just allowed the Arduino to function as a DMX device. After rewatching the video, I see a DMX cable plugged into the shield while the robot is dancing. Now I get it!

[@andyb2339]

"Basically it dances so I don't have to"