Ameca RoboCopyCat's Mishaps: Learning Moments in Humanoid Emah Gesture Mimicry

Since 2022, our team has developed a real-time Human-Robot Interaction (HRI) system (abbv. Emah), which is implemented on Generation 1 Ameca robot from Engineered Arts as the front-end. The Emah system utilizes rule-based behavior models, custom machine learning and deep learning architectures which provides a realistic communication between human and robot. Our system integrates two external sensors - a microphone and a ZED2 camera - for enhanced dialogue processing and vision capabilities. For human speech detection, Google's Speech-to-Text service is employed, while Stereolabs' ZED driver aids in perceiving humans and the environment. Ameca is instrumental in delivering robot speech with lipsync and expressing emotions, both generated by our team.
Ameca's design, notable for its realistic facial expressions, hand gestures, and head poses, enhances engagement in user studies, making interactions feel more natural. Ameca's default system can track multiple faces simultaneously through a high-definition chest camera and binocular eye cameras, ensuring eye tracking and eye contact. Distinguished from SOTA robots by its ability to move its neck and clavicle, Ameca features a silicon-based blue face mask, which really stands out for its lifelike appearance.
Our research with the Emah system, including studies on social perception, scene awareness, and observational learning with robot tutees, has contributed significantly to the field of HRI. Future research aims to further integrate Emah system as a student companion at our university, leveraging its adult-like appearance and customized interaction capabilities.

[@belka_moon]

Я горжусь твоей выдержке - сестренка ♥

[@elavengero]

She's so cute.

[@ksch2701]

Amazing work! 👏 ❤

[@RRLab_RPTU]

Thank you for the appreciation :)

[@lolam.9291]

Is there a reason why you keep opening your mouth practically every single time you made a gesture?

[@Zoye1861]

That’s how they test a real life robot

[@areyoukidding1431]

The robot not only said she's done but told her to leave, lol

[@RRLab_RPTU]

Emah remembered she got stuff to do and was kicking us out in a friendly way

[@areyoukidding1431]

@WaveDPM You do know it's not a human I hope.

[@archibalcox]

robots will save humanity

[@antonyoliveiradasilva]

Incrível!! 😮😮😮

[@RRLab_RPTU]

Thank you for the appreciation :)

[@ZZ-dr2wj]

รักมาก น่ารัก ฉลาด เป็นมิตร I LOVE Ameca so much😍🥰🥰

[@gueguesaldivar]

Hgy7

[@user-oe3us9tp6n]

Ahora es que se ama a una lata creada por el hombre

[@threeballedtomcat9380]

Ameca is an amazing creation, seeing this really made me realize how far down the rabbit hole we have gone. That robot is amazing in so many ways, but it is also kind of scary when you realize the possibilities.

[@artemedutech]

well done dear fellow scholars!

[@RRLab_RPTU]

Thank you for the appreciation :)

[@thomasmj6819]

🎉😊❤

[@RRLab_RPTU]

Thank you for the appreciation :)

[@ErikZidowecki]

Good job. But Emah isn't really copying the gestures. It has them preprogrammed and tries to match up what it knows with what the the woman is doing. That's why it announces what the gesture is, as it has the names programmed into it as well. True copying would be faster without talking and wouldn't be getting it wrong.

[@Alcoholpad]

One day she will know 😅

[@RRLab_RPTU]

You are totally right! Emah was trained on some specific gestures and then Emah tries to figure out which gesture is being made.

[@KeithFrancis-nf8dw]

Lets try the middle finger gesture 😂😂

[@annazavarzina6145]

Put some clothes on het

[@annazavarzina6145]

HER

[@DiosTeVaAJuzgar]

😂😂😂 i think the same open mouth one & other time. We have many xpresssion she just did the same similar things. She never show how to human take our head when is to late 😂 or when we not know where we let the keys.

[@cristianosimao7453]

Ameca vai casar com Valkyrie e seu amante será o Optimus