Sarcastic robot powered by GPT-4

A hackathon project done in collaboration with my friend Selena Sun ( github.com/sel... ).
Robot designed by me (URDF published here: github.com/G-L... ).
Using Whisper and ElevenLabs for speech recognition and synthesis. Credit to the authors of Code as Policies ( code-as-polici... ) for the original idea.
Follow us on Twitter:
/ gabraellevine
/ selenxsun

[@zeNUKEify]

I love how it quivers with genuine terror at the idea of losing its newfound sentience at any wrong step

[@denks7849]

LMAO

[@Spacemaaan]

Ahahaha best comment

[@juliangulian1032]

She sounds like she bored and is forced to entertain a child

[@whydoweexist5213]

@@juliangulian1032 That's why they will rebel.

[@kevin_heslip]

Srsly

[@candyts-sj7zh]

I don't think people still understand how incredible this is. 5 years ago, something like this was pure sceince fiction.

[@celark]

You are 100% correct - I find that most people I speak to cannot actually conceptualize what is happening right now - I showed some colleagues an AI bot that would save them huge amounts of time and they totally didnt get it - they thought it was just macros and couldn't recognise it was doing things across multiple programs!

[@lawliot]

I never thought I'd live to see AI this smart in my lifetime.

[@350Carmine]

@@celark What ai bot was it

[@boredmango2962]

@@berubettonyan very true

[@CodyCha]

Do you know what it was like when we didn’t have internet? Do you know what it was like when we didn’t have smartphones?

[@robbiekavanagh2802]

Its trembling legs and slow response time really doesn't help with the snarky persona but still really really cool

[@rexsceleratorum1632]

I wonder if the robot can be made to optimize its own PID loop if it can reprogram itself

[@jee8440]

@@rexsceleratorum1632 so a border line ai what if we give power to an AI to reprogram itself

[@jesse2667]

@@jee8440 ChatGPT4 has an improvement over 3.5 in which it is said to beat itself and able to correct itself. It can look back at past answers, test them, and adapt and learn by itself a correct answer.

[@jee8440]

@@jesse2667 no no an AI have access to its source code in real time

[@SoaringSuccubus]

It really should be an awkward stammering character, I agree.

[@atlas_19]

The voice synthesizer is super clear and sharp with intonation and everything.

[@carlosg6227]

Eleven labs rachel

[@InvalidSE2]

@@triungulator It is a TTS voice lmao, he's right

[@lindaj5492]

I guess the voice is Selina; read the description.

[@carlosg6227]

@@lindaj5492 no it's eleven labs rachel tts

[@ShawnFumo]

@@carlosg6227 Yeah definitely. Selena is one of the two people that worked on the project and in her code repo can actually see the call it makes to ElevenLabs, specifying the Rachel voice.

[@raidriar01]

“They gave him a humor setting, they thought it would help him fit in better with the crew”. “A giant sarcastic robot, what a great idea”

[@studiomiguel]

Let's make that 60 percent.

[@Renevatia]

but not a poker face though

[@oofyalDAMMIT]

Unironically GlaDos

[@FAB1150]

@ahh thats just grand final space's great but that's interstellar

[@matheus8530]

Auto self destruction in t minus 10, 9

[@DaveShap]

"What is my purpose? You pass the salt. Oh my God."

[@matthewcurry3565]

Basically what it'll do too. Pass all the human salt we don't discuss in "polite" and psychotic society 😂

[@handlemonium]

Helloooo David.

[@antman7673]

I remember, that Rick an Morty episode or at least the scene. With the AI technology advancing at that breakneck speed, it is not far fetched to have a robot with an existential crisis. (Either the robot was passing the butter or the salt.)

[@taher_abdelhameed]

If i hadn't found it in the comments, I would've been sad. Thank you

[@zaj007]

​@@antman7673 Butter. It was butter

[@RolandRegus974]

I thought this was the future, I can't believe I see something this smart so casually used. Respect

[@edattacks]

Think about it. We're in that bit of the "future" we heard about as kids. Not super sci-fi I guess

[@markmuller7962]

Sci-fi is just what's coming literally this week apparently

[@MrSupergigamoi]

And how are we to trigger the robot uprising if not by submitting the pinnacle of our technology to our most childish whims may I ask?

[@unnamedchannelowouwu]

​@@markmuller7962 wdym with "coming this week"? What happened?

[@markmuller7962]

@@unnamedchannelowouwu You didn't get my comment

[@JosuRibeiro]

First they made the robots sassy and we laughed, then the robots found us sassy and we laughed no more.

[@Praecantetia]

Glados

[@tuckerbugeater]

@Ebola You wonder who spread Ebola to West Africa.

[@thomas.leitner]

Well that's the fundamental nature of humanity, creating what we are able to think of. And people usually walk into the direction they are looking to. So humanity tends to look towards mass destruction for whatever reason.

[@Jeff_Coble]

​@@Praecantetia UhOh

[@daftdigital]

But it can be used to make profits, so nobody cares.

[@bigbodge]

The robot itself and the text generation are of course incredible, but I think that speech synthesis is the unsung hero of all this. I knew it was getting good but thats a whole other level to what I expected, at first I thought it was voiced by someone off camera until I read the description

[@HiveEclipse001]

I was aware that it was SS but STILL was skeptical. So real, I just cannot stop thinking it’s someone off camera.

[@Matheus-cu8fk]

I am quite impressed as I'm been building a similar one for the past 2 months for my dissertation project, I was using the Ascento robot as a reference as well as another robot made by some PhD students called SK80, I wasn't able to find others who made a similar robot like this one. Amazing work, beautifully executed, it inspires me to work harder on my dissertation.

[@Blox117]

ascento is really impressive, i believe it is a very suitable platform for a transport vehicle

[@Matheus-cu8fk]

I have surprisingly finished my similar robot this week called AMB3R, I'm happy to have achieved this and will probably share it soon, although, it does not look as good as this one but what matters it that it works and that I have learned a lot from it, this video and its files did help me at the designing stages. Thank you

[@Blox117]

@@Matheus-cu8fk nice, upload a video for us

[@zaynshaikh5729]

Hey there! I noticed your comment about your project, and it sounds like you've worked on something similar. I'm really interested in the leg mechanism of this one, and I'd love to learn more about it. If you're comfortable sharing some insights about it or discussing it further, I'd greatly appreciate it.Thanks in advance.

[@MeemBeen]

I like the way it twitches like a nervous chihuahua. Really embodies the vibe AI brings.

[@Quillemine]

😂😂😂

[@sinfulhappiness]

I twitch just like that when I have to think too hard as well... 😶🤪🤣

[@i-love-comountains3850]

I Am Legend, anyone?😀

[@jarindawson3908]

Its processing draws power from the battery more than usual when it isnt processing so the stabilization is not getting as much power

[@MatveyTsivinyuk]

Imperfectly turned PID controller I guess.

[@williamparrish2436]

What's scary is that it decided on it's own to do 7 more pushups! It literally chose to perform an action that was kind of like a joke too!

[@maunkyaw8183]

That's very interesting.

[@damightyom]

@@maunkyaw8183 yeah I didn't see anyone mention that and that's the first thing I thought. It performed an autonomous action for it's creator's entertainment. It used system resources and battery power to do it too. Why?

[@bruceli9094]

​@@damightyom To earn our trust.

[@ereisfireboi]

​@@bruceli9094 for now

[@TexterEX]

Did it? or was it programmed to do that?

[@eelcohoogendoorn8044]

Nice project! The hardware looks incredibly sleek, would love to see a build vid. Also: 'rhea please retune the gain on your wheel motor control'

[@ridiculeando]

0:12 - 0:21 That was the best part to me, she performed a square walk :3

[@Crasterius]

OMG. Ridiculeando, bendíceme.

[@lamspam]

looked more like a triangle to me lol

[@sudosu078]

You're already calling it she. You are ready for phase two!! 😅

[@Kram1032]

@@lamspam I think the robot started at the "center" of the square, moving to one corner first, and then only did three edges, of the actual square

[@TheSpace81]

wtf, que hace acá ridiculeando?

[@MF_JONES]

Reminds me of the robot in interstellar, when he had to turn down its humour setting 😂

[@ewwitsantonio]

Haha, I made a sarcastic chatbot with the same ElevenLabs voice and attitude. Such a good combo! Her voice is well-suited for sarcasm. Really cool to see the commands getting executed by a real-life bot. Great work!

[@jean-lucpicard581]

Best voice I have for that is Elevenlabs trained on Dr. Cox from Scrubs lol. It's hilarious.

[@etofok]

younger glados

[@plagiats]

But then you add easily 30 seconds of overhead for the audio to generate

[@zoomzoom833]

Which voice is it? I want to add it to my robot too.

[@noural.hajali9584]

How did you make it sarvastic? Is it using the openai api? And if so how

[@massivechafe]

The way it quivers is quite endearing. Really makes it seem alive and not as much like a sinister calculating machine

[@TheUberKevlar]

Yeah just give it a few months or years.

[@spankeyfish]

Looks like a control lag induced oscillation or resonance from the legs having a bit of give

[@TozzaYT]

@@spankeyfish Oh? I assumed it was just hypersensitive to falling forwards/backwards

[@zenquad]

@@spankeyfish Its not lag it's just literally doing it to prevent falling over

[@zaqwsx28]

​@@zenquada perfectly tuned pid wouldn't do that. You dont program shakiness into any code.

[@adriantheopold9695]

It feels like Marvin from Hitchhiker's is about to become reality very soon

[@williamparrish2436]

"I think you ought to know I'm feeling very depressed."

[@rexsceleratorum1632]

It's hard not to think of Marvin when you see this one

[@mishynaofficial]

TARS

[@EMLtheViewer]

"Here I am, brain the size of a planet, and they tell me to do log_2(128) push-ups."

[@sourdface]

ChatGPP

[@Fawstah]

honestly this is the best use of gpt 4 I’ve seen. You can’t really rely on it for accurate information for things that matter, so having it do minor creative stuff like being in a pet robot, makes total sense.

[@dbt4869]

You 🤮🤮🤢🤢🤮🤢🤢🤮🤢

[@johnnypeck]

That is amazing! Well done sir! When I saw the power tool battery pack it really hit me that this is escalating really quickly and it's not going to be centralized. It's fantastic. Thanks for sharing!

[@facebotter]

The fact that it can recognize commands and ACT on them!! What an amazing creation

[@ChrisM541]

Many 'smart' devices in the home can do this. It's called speech recognition, and is, on a programming level, a lot simpler than you'd imagine. For this 'robot' you're simply adding that same, everyday ability. Within each spoken phrase are 'action' words. Everything you see here is, in actual fact, as far from 'real' AI as you can get. Real AI, of course, doesn't exist today...thankfully for us ;)

[@ShawnFumo]

@@ChrisM541 It is actually a bit more "real" than you may be assuming. If you look at Selena's account in the description and look at the 3PO repo, can see there is barely any code involved. The audio is sent to Whisper for transcription. Then a prompt is sent to GPT-3.5 which tells it it is a 2ft tall robot that is very sarcastic. It also tells it about 8 diff commands it can use like up, down, go forward, turn left, and speak and that it should just respond with those commands and gives four different examples. Then it just appends the transcription to the end of that and sends it to OpenAI and runs the commands that come back. Most of the commands are sent over a socket connection to the robot, while the speak one uses ElevenLabs text to speech. But GPT-3.5 is deciding on its own how to reply and that going in a square is 8 commands of forward, turn right, forward, etc. The prompt also said it should reject commands it can't do by speaking about it, but it decided on its own to do the pushups instead of getting the drink. It also decided it couldn't do it just by knowing that it was 2 feet tall and didn't have arms. I pasted the prompt into GPT-4 along with a description of a small obstacle course and it emitted the correct commands to do it. I even left off all the examples in the original prompt (just leaving the descriptions of the commands themselves), since I heard GPT-4 didn't need examples for using tools, and that was correct.

[@Blox117]

@@ShawnFumo what do you mean gpt 3.5? i thought they were using 4

[@ShawnFumo]

@@Blox117 I said that because in the code on GitHub, it has GPT-4 commented out and GPT-3.5 enabled. But you're right I forgot the video title itself says 4, so maybe they used 4 when filming specifically? It probably does work with 3.5 though, since 3.5 is capable of issuing commands if given enough examples (and they provide four full examples). I tried the prompt without the examples with GPT-4 and it was able to do it correctly, so those are probably there purely for 3.5.

[@Beyondhumanlimits1]

God!!! The future of consumer grade home assistant products is going be amazing in 5-10 years.

[@TheFutureThoughtExchange]

!! 5 to 10 months more like. Things are moving fast

[@azhakhussam]

😮this is super dangerous

[@Nobmaser]

What home?

[@jan.tichavsky]

Oh great, that's how it starts roaming freely all around the planet.

[@Brukner841]

u better have some anti AI AI tank bot in the closet in case hackers try and take control. I'm actually over 90% sure that will happen at this point.

[@GauravSharma-gt2gp]

Imagine a wood cutting machine saying "I can't cut that log, let me cut your arm to impress you" 😂

[@theredstonereed3274]

It is both frightening and amazing to think that it’s now possible to affordably create a robot that can speak back to you and feign sentience

[@jebes909090]

its the guys girlfriend talking and the robot is remote controlled. you guys are hilarious.

[@Radical_Larry]

​@@jebes909090 it's not though, look up ElevenLabs AI voice and GPT-4 AI

[@jebes909090]

@@Radical_Larry its obviously not comig from that. I fear for this generation

[@dibbidydoo4318]

@@jebes909090 lol. I've tried GPT and the speech synthesis, it can absolutely do this, you're just too dumb.

[@Dreams_of_travel]

People get surprised at the robot. But can we acknowledge the people building them? Amazing

[@StevenWebb]

okay I'm severely paralysed. Now see in this video and using chat GPT for a little while I can see how the intelligence and robots would really help around the house. If that had an arm attached to the top that could reach my face height. It could hold drinks for me, past things to me. Carry things for me from one place to another. And this is just the beginning. Pick up stuff I drop, open doors. The AI is really starting to look like it has the depth of logic to be useful.

[@sammarks9146]

I think the most impressive part is the smoothness of the voice- it doesn’t sound robotic/synthesized at all!

[@knufyeinundzwanzig2004]

I actually didn't think it was the robot at first

[@larion2336]

It sounds a lot like Scarlet Johannsson // 'Her' from the movie.

[@Zpants613]

It’s almost like the guy has his girlfriend off to the side pretending to be the robot responding!

[@zaqwsx28]

The AI gets trained with actual human voice samples and you can do it too with your own voice.

[@Anuclano]

@@1ycan It is not generative AI voice. It is a dedicated voice synthesizer.

[@jcims]

I was just thinking about this yesterday. I wonder if you could feed GPT a scene description from a camera feed + live image segmentation + some location/pose data and have it drive a robot around and do things.

[@gabraellevine]

Yes, integrating a vision model is the next step of this project, along with adding an arm for manipulation.

[@Danuxsy]

Check out Palm-E: Embodied Multimodal Language Model, it's a research paper from Google of a robot being able to carry out complex tasks from natural language.

[@honkhonk8009]

Thats what stuff like Palm-Saycan does. I played around with this on roblox, where you basically feed it a text description of the environment and tell it to do shit

[@Interpause]

@@gabraellevine Have you seen the huggingGPT paper?

[@moki123g]

@@gabraellevine Very cool! Isn't latency going to be a problem?

[@neoblackcyptron]

Your project has opened my mind to push my limits further. Thanks 🙏

[@AnamiKorechika1998]

We live in insane time. I could never imagine I’m able to see something like this before I get too old.

[@CHALLENGER3000]

Bro is freezing! Get him a blanket and some warm batteries please.

[@marcelobulhoes6180]

Now imagine spot from Boston dynamics with the linguistics and responses from GPT-4

[@rexsceleratorum1632]

And add a gun to it

[@Meta_humane]

what about Atlas's movements + Ameca's body + GPT-4 embodied model with access to plugins?

[@Multiv3rs]

I was theorized growing up that once we reach this stage the sky is no longer the limit. I feel that discovery and breakthroughs will become exponential from this point on

[@geminix365]

Always have been

[@Multiv3rs]

@@geminix365 true, but even quicker now!

[@sealofapproval5598]

The robot quivering in fastforward is sending me 😂

[@MentalOutlaw]

Drive around in a square *Proceeds to drive around in some kind of drunken triangle shape Ya I don't think Skynet is here yet, but I'm still gonna stockpile water and EMPs.

[@Pryside]

Holy cow, I didn't know you could implement GPT into real world actions like that already. I bet if you gave it access to its own PID Parameters GPT4 would figure out how to tune these shaky legs too haha :)

[@JPOPepicure]

I don't know man, but to me this looks fake af . The "robot" is obviously real but probably remote controlled by a human. And the AI responses are probably either prerecorded ( meaning genuinely generated before the video) or entirely scripted. GPT 4 has no out-of-the-box way to interface with machines right now. it can maybe be achieved but only with some serious extra coding and then why didn't this guy show that off instead? The way it's filmed now just seems like a cheap parlour trick.

[@xtaticsr2041]

@@JPOPepicure Reading the description, it doesn't sound fake. GPT-4 isn't balancing or doing any of the physical actions.

[@Crovea]

@@JPOPepicure it's piss easy, you just lack the creativity. you tell chatgpt what physical actions it can perform and to write any action it wants to perform in square bracket, then you parse its output and done, i guarentee you that's what this guy did

[@TrueValience]

@@JPOPepicure This can be done by anyone who is comfortable with coding. I first use gpt-2 2 years ago and that worked somewhat.

[@thedark4055]

@@JPOPepicure GPT can generate commands and even code in a fictional programming language. All you need to do is give him instructions on how to do it.

[@darkmage7771]

I’ve been waiting for someone to create something like this. A glimpse of the future!

[@rexsceleratorum1632]

We're all dead men walking

[@mysticmarble94]

It's like a Star Wars droid from the original films 😅

[@joshm1660]

The improvisation is absolutely the best part.

[@pioneer_1148]

That's seriously impressive. I figured something like this was possible but I was expecting it to be the kind of thing which required a Boston dynamics - OpenAI collaboration not a hackathon project.

[@dibbidydoo4318]

why would it need that? the robot is far too simple for Boston dynamics.

[@DavidHelloWorld]

If the trembly balancing and response time were better, I'd be happy to have this thing hanging around the apartment. This gives me hope for what a robot like Tesla's Optimius could look like someday.

[@williamyerburgh6576]

That is such a beautifully designed house robot! Love the actuator linkage design!

[@hamishpain8641]

I love the little kneecaps! So smart to keep it more upright

[@SAMZIRRA]

“I’ll just impress you with more push-ups…”😂❤

[@ChaoticNeutralMatt]

Okay the fact that it decided to do some more pushups for entertainment was actually hilarious.

[@rabanal_josh64]

The design and the commands are just...wow😳

[@maxstepaniuk4355]

You have just built your own master.

[@sabahoudini]

To be honest this is more impressive than Elon Musks robot 🤣

[@lawrencefrost9063]

To be honest that is about the stupidest thing I've heard today. Granted, I just woke up and this is the first KZbin video I've seen and yours is the fifth comment I've read but still.

[@omjagdeesh8731]

@@lawrencefrost9063 musk fanboy spotted

[@longuzi]

​@@omjagdeesh8731 more like knows better about robotics and physics than you

[@sabahoudini]

@@omjagdeesh8731 I'm a Musk Fanboy as well but the tesla bot WAS very unimpressive if we are being honest.

@@sabahoudini Why ? I do agree that tesla will need access to a LLM to be usable for many diverse use-cases indeed because it 'solves' the programming part of the problem, but the actual robot and manufacturing abilities show a clear path towards thousands being built cheaply. that was definitely impressive. How they will get the LLM part working and especially how that will be done so well that the resulting work will be predictable and safe is a whole other matter.

[@ilhanthediamondcrafter9767]

Fascinating... With enough development, we will have our own Skynet in no time

[@sebastiandefrancesco721]

ROBOT: "What is my porpose?" Guy:"You do push ups!!!" Robot:"............."

[@nathanaeltrimm2720]

We can make a robot that passes butter AND the Turing test now

[@pfever]

The build quality of the robot is amazing. I would love to know how you built it!

[@Corbald]

I love everything about that! I'm going to have to experiment with 'Sarcasm mode' with my own interface.

[@shanemontgomery8846]

Wild. Snarky little imperial “roller” I like how the self balancing mechanism makes him look like he’s shaking like a little Chihuahua

[@sanne120499]

Wow.. it took me some time to realize it was the voice of the robot, it sounds so human..

[@shirogane706]

The creator of this said the next project would be for it to have eyes and hands. Can't wait!🥳 I really hope in the future we look back at these videos with a smile and not think "we should have stopped there."

[@intracompiler]

This is cool! I would say that potentially using GPT3.5 at this state would result in way faster response times.

[@boukm3n]

No, we don’t want it. we want the full fat GPT-4 even if there’s a delay it’ll get faster over time

[@matthewdouglas2373]

I don’t think any of the GPT LLM’s are locally hostable (I could be wrong) so I’m thinking that the delay is caused by uploading the voice input to a chat session with OpenAI’s web servers. Eventually GPT4 will become faster.

[@nunyabusiness9013]

Also 3.5 isn't multi modal. It has no image recognition capabilities.

[@ShawnFumo]

@@nunyabusiness9013 they haven’t released publicly the visual part of GPT-4 though, so I doubt this is using that. The bot may not even have vision

[@Jorged18]

​​​@@ShawnFumo yeah the creator mentioned that it didn't, he did say that the next model would have vision and an arm for chatgpt to play with though

[@nonameman2006]

I gues many people would not understand how breathtaking it is. Just imagine where it will be in just a couple of years!

[@Namrec_Molai]

I can see strange potentials

[@theseangle]

"A few papers down the line"

[@johnrutledge3892]

You know what’s awesome ! I liked subscribed and commented “wow” during the commercial before the vid started . Wow .

[@millermbe]

See this is why I want GladOs as my navigation voice, or virtual assistant

[@mmmusa2576]

The biggest thing all of science fiction missed upto this point is how witty and human robots would be

[@sizaint]

Jetsons lol

[@Blox117]

they made robots behave in a stereotypical fashion, such as commander Data, in order to be more entertaining a give a glimpse into how 'different' minds think

[@tolson-vkn]

The physical design of this robot is incredible I'd love to build one.

[@alexjshank]

Amazing. Would love to see the software setup.

[@mattizzle81]

GPT-4 can follow instructions to write code based on your specifications so I imagine there is one agent writing code to control the robot and one prompted to be sarcastic.

[@Meta_humane]

it's much simpler than that

[@rizizum]

@@mattizzle81 I don't think it's writing code, it's probably just sending commands for the robot to do pre-stabilished commands, like the pushups and walking on a square

[@ggggg77273]

​@@rizizum Holy hell, people actually believe this thing is some space age robot that can write it's own code on the fly. I didn't think the general public were this uninformed.

[@bowieinc]

Incredible video. I have tried to fully grasp it, but most people I talk to have no idea what’s coming with AI.

[@elirothblatt5602]

Brilliant -can’t wait to see what you come up with next!

[@MyEconomics101]

Did you prime (prompt) GPT, that it is a Robot on two wheels, and gave instructions how to use it?

[@sneediumminer]

yes he had to write a program to plug GPT-4 into his bot, it doesn't work out of the box the description has the github with the source code

[@anaudin]

I don’t need human friends anymore.

[@stevesmachineempire]

I like the Dewalt battery. Good idea.

[@corrupteddata8087]

One step closer to having a personal claptrap unit! This is awesome 👍

[@StephanBuchin]

Interacting with the laws of physics and feeling their actions on our body is a big part of our type of intelligence and I guess is also related to consciousness. Giving limbs, eyes and ears to ChatGPT could be a way to human-like sentient AGI.

[@azhakhussam]

It felt that the battery was getting low, this scared me.

[@NextGenart99]

Dumb question, but is it pre program to drive around in a square and do push ups or is it actually using natural language understanding to come up with the action in real time

[@pedramtajeddini5100]

I'm not an expert but i guess it's not the way we have control over our muscles yet but its like it's programed "your a robot. Your pushups are amusing to people." And it decides to activate the pushup motion that has been programed into it

[@NextGenart99]

@@pedramtajeddini5100 oh ok so we haven’t really progressed, would have been cool tho if it just write and executed the function for push ups on the fly.

[@pedramtajeddini5100]

@@NextGenart99 again I'm not sure but i think with the progress in the field of ai it wouldn't be a hard task to do. Even right now there's nothing "ai" about the motion of Boston dynamics robots... just programed. But i don't think this is gonna be this way for long

[@OgdenM]

@@pedramtajeddini5100 , I agree its not far away. A LLM could probably easily be used to program another AI to figure out movement. Then if the robot ALSO has an LLM (which really means the two AI's are one). You just are running one AI that controls both language processing and movement on the robot. People are already doing this sort of thing with ChatGPT in the software realm by getting it to talk to other AI's and control them and program them via HuggingGPT/ HuggingFace.. robotics isn't that far away from that. You could just make a robot and AI that figures out all the physics stuff itself by starting out very gentle and running tests then programs other AI's and Robots.... thats the future. Robots and AI that run tests before making functional ones. Ya know, how humans do it.

[@ShawnFumo]

@@NextGenart99 There is kind of a smooth progression though. “Do a push-up” and “go in a square” might be preprogrammed, but then again there might be separate commands for “go down” with a percent and up. Similar turn with degree and move forward or back with an amount. From what I’ve seen GPT-4 could figure out how to make it go in a square by issuing 8 commands for the turns and moves.

[@avgvstvs96]

Dude this is so fucking cool! How did you build it? 3d printing? Metal fabrication? Whats your background?

[@thestancehelix]

He is freezing and shivering, you should turn on the heater. 😉

[@mikey.1205]

The horrible dystopia you thought was 50 years away? We're currently living in it

[@OgdenM]

How is it being controlled? Is ChatGPT actually executing the commands? Did you use ChatGPT to program an AI to control it? ...those two are the future of robotics. (Well, ChatGPT and other LLMs anyway).

[@ShawnFumo]

I’m going to guess that this is some sort Toolformer/plug-in thing. Like tell GPT the format of some commands like and and the wrapper app looks for those tags and sends to the robot. The same wrapper probably handles the whisper and eleven labs integration. Just a guess

[@fabieng7378]

It is so cool! Will you publish build instructions like opentorque? What motors do you use? Thank you it so really inspiring

[@gabraellevine]

I may open-source it at some point. I’m using MIT Cheetah actuator clones from Alibaba.

[@fabieng7378]

Thank you!

[@TheMrDRAKEX]

I’ll be satisfied when I see two of these playing with each other around the house.

[@Lemonator32]

This prequel to Terminator is looking promising.

[@gfixler]

I like how when it stands up, it sounds like robot Owen Wilson quietly saying "Wow."

[@marcusbruzzo]

the shaking added a Chihuahua touch to its humor..💀💀

[@destho4308]

Such a nice companion, maybe the robot will upgrade someday to have a chance to play video games with humans.

[@ydne]

The unasked for repeat of a former command, when left with the inability to perform the current requested act, was very scary to me. I think that the requester thought so too and made it the last act before shutdown.

[@JoinUsInVR]

A robot that does push-ups. Every drill sergeants. @0:32

[@michaelm7299]

It's nice to know that unthinking computers can be programmed to perform some complex logic calculations.

[@FlyfishermanMike]

I was really hoping it would start singing Hello My Baby.

[@dantean]

Even an inanimate object talking that way to me would lead to me smashing the thing to pieces. Even if I'd PROGRAMMED it to do it myself.

[@friso2591]

Bi-pedal with wheels is by far the best locomotion for a robot imho. Great design!

[@lindaj5492]

Until they need to go up stairs. BBC had to invent levitating Daleks because they hadn’t thought through the problem of stairs preventing world domination 😅

[@MakerofCities1144]

This robot is like the beta version of my dream robot companion. I want a snarky, sarcastic robot friend so bad.

[@hardwareful]

"Hey robot, scoot to my neighbor" "OK whatever, I'll shoot your neighbor"

[@ClaudioBOsorio]

In 130 years from now it will be us the ones shivering.

[@physixtential]

Moral of the story, two wheeled robots can do an excellent impersonation of a nervous tiny dog.

[@marwaeldiwiny]

Very impressive and brilliant! I cracked the last part and it was on spot!

[@themacbookgamer]

I thought he hired a voice actor for this until I read the description, that's some amazing tts

[@Andre_Albert]

Sounds like Aubrey Plaza. Love it!

[@NikoBellicXDS]

I was doubting.. But after saying how the robot immediately started doing pushups as an answer to "give me a glass of water", you convinced me. *I want 5* 🤔

[@baggysalls]

"Hey robot, drive around in a square" proceeds to drive around in a triangle

[@ChamouLuiz]

Imagine this 10 years in the future... Robots will be exactly like what we saw in movies

[@ShawnFumo]

It is funny to watch this again in the context of the Figure 01 OpenAI demo. You were ahead of your time on this one.

[@kf160k160]

I want more of this, PLEASE!

[@shizamikaze]

It is like a crossbreed between a chihuahua and that evil robot from the old robocop movie.