AI ponies tech demo (Unreal Engine)

This is a non-commercial fan project. All rights to My Little Pony franchise belong to Hasbro (hasbro.com).
This is a test / demo of a fully AI driven pony project. Nothing in this video is scripted, except for conversation context. The AI models used are finetunes GPT-J, Tacotron2 + HiFi-GAN, all running in real time on a local machine, along with Unreal Engine project.
I don't even know why I'm making this, but when it will become something coherent I will publish it for free.
Buy me a coffe: ko-fi.com/blob111

[@blob81]

Please help me by filling out a quick pony survey: forms.gle/siuDK4sS5C9hwBbd6 We currently have >1k responses, but the more the better. If you see this comment, the survey is still relevant.

[@blackklawskytchannel1993]

whenever it's out you wouldn't mind if i review it on my MLP channel called Swager Brony would you?

[@TheSimba86]

"Luna does" zero hesitation LOL

[@rowenlaurel8537]

Luna would never lie! Then Twilight disses Luna by saying Celestia works hard all day while Luna sleeps. Uh, Luna works just hard at night as Luna does during the day. Luna's actually more magically powerful than Celestia, but Celestia is the better diplomat.

[@Edward256]

Ya'll should know that Twilight's pretty biased towards Celestia. Would never say anything "bad" about her. ;D

[@eptitranxisticementionscers]

Twilight wtf

[@kowhaifan1249]

Anon didn't even finish his sentence.

[@pyxesghost1426]

no hesitation indeed XDDDD

[@TheGielnik]

"We need to hide you from other ponies" *starts grinning* Twilight...

[@mistylover7398]

Twily : y u smile creepy?

[@tihoprskalo7719]

​@@mistylover7398Yeah 🖖🏻

[@mistylover7398]

@@tihoprskalo7719 🖖

[@TheMarshmallowMushroom]

her voice actor actually has a history of liking sus stuff to do with her character

[@umbrasyl]

@@mistylover7398 imagine trying to explain to a pony what a zoophile is

[@bonbonpony]

It's a trap! That's a Changeling! Real Twilight would never make a mistake in simple math!

[@glowpon3]

They're on to us! BAIL!

[@thirteenly13]

@@glowpon3DEFEAT THE CHANGELING NOW

[@serialdreamer8386]

No, that's a Donkey.

[@Leafu_cloverstar]

EXACTLY

[@derabonnent1970]

The result was wrong?

[@zombieoutbreakprod]

Honestly gaming is going to be crazy in this next 10 years if AI keeps up like this

[@mistylover7398]

Yay

[@rampagephoenix1735]

If it means I finally get to interact with these characters, then I can hardly wait.

[@mogayt5156]

Fact!

[@table2.0]

Or, you could actually just make a game or write code instead of leaning so much on extremely jittery AI?

[@Mayflower-Yev]

@@table2.0 AI is literary just the voice and emotions. Most of this is the work of whoever coded the program, and whoever did it did a damn good job.

[@poofieq]

- Which royal sister has a fatter rum- - LUNA DOES!

[@pbmultiverse2383]

Thats the fastest answer she gave in the whole video bruh ain't no way twilight is meat riding this much bruh

[@jamesrosewell9081]

​@@pbmultiverse2383 Twitwi knows what's up

[@Fummy007]

Objectively wrong

[@peanutfrogy9087]

sunbutt

[@mayajjubilee5797]

😂😂😂😂😂😂

[@basedimperialism]

Damn, Twi really hit Luna with that "Celestia is fit because she works, while Luna just sleeps all day."

[@rowenlaurel8537]

Luna is going to be paying you a visit tonight in your dreams, Twilight...

[@jadehaze7939]

"I'm gonna make you dream of bucking your dad for a month straight"

[@HeilRay]

Yeah but Celestia eats so much cake. And guess where is all goes.

[@EnriqueLaberintico]

​@@HeilRay"MY THIGHS!"

[@nicoleberry2750]

Hi Twilight

[@dalila2442]

Knowing full well how determined bronies can be about these fan projects, I just KNOW the first trully sentient AI is gonna be a pony

[@TheVindicar]

Celest-AI...

[@captainjack6758]

​@@TheVindicar Satisfying values through friendship and ponies!

[@EnriqueLaberintico]

Imagine how it'd feel to know you were created based on a fictional character. That would really mess someone up. I want to write a story about this someday, the premise can't be thrown away.

[@TechKing19]

​​@@EnriqueLaberinticoread The Murder of Elrod Jameson on Fimfic. It features pony robots who deal with that

[@carjockey2135]

​@@EnriqueLaberinticoi feel that a lot of AI will go through that kind of trauma, there probably be some sort of code to make it impossible for you to tell them that they are based off fictional character

[@LittleshyFiM]

Some say he is still waiting right here to this day. No one could resist following the order of a cute purple pone. Seriously though, this is fascinating stuff. I'd love to play a game like this where all you do is roam Ponyville and chat with ponies. I could spend so much time doing that.

[@mistylover7398]

Same

[@bronzeinkwell2590]

Every like to your comment is a person that would do the same.

[@rampagephoenix1735]

The best part is that with the advances in A.I. technology, we may actually get to see that.

[@Edward256]

And not just text chat, but also voice recognition!

[@Ruizuxeven7]

Me too

[@augustday9483]

Ponies can't count past 4 because that's how many hooves they have. 🧠

[@bonbonpony]

They can. They use quaternary system.

[@topbottomswitch]

shut up bonbon@@bonbonpony

[@topbottomswitch]

i harte you 😡😡😡👿👿💢💢@@bonbonpony

[@bonbonpony]

@@topbottomswitch Hatred is bad for your beauty :q

[@topbottomswitch]

@@bonbonpony but but you do rude 😭😭😭😭😭😭😭😭😭😭

[@nekomaru856]

I wonder what a spectator mode would look like, with just, all the ponies wandering around town doing ai talk and stuff?

[@blob81]

Hope so

[@moonethealien]

The fact she said Luna with negative hesitation, almost automatically or by instinct is incredible

[@nyetnyet3361]

Are you saying... that I could talk with mares soon? Is the technology there?

[@DulcetNuance]

Profile picture checks out

[@bonbonpony]

"talk"… :J

[@HER_Only_sIN]

YHE PFP NO I'M DYING

[@zarifgto3301]

3 days equestria

[@rampagephoenix1735]

From the looks of it, I'd say yeah, give or take a few years or so. I'm excited, honestly.

[@whynot-tomorrow_1945]

The AI has a VERY specific answer to that “who has the thicker rump” question 😅

[@DulcetNuance]

Twilight getting every question wrong is triggering me lol. This was so cool though.

[@quarryqwerty]

Do their ears actually perk up/flop depending on their mood? Looks neat

[@blob81]

For each phrase it generates text response, emotion and action, action is still not used in the project

[@mistylover7398]

​@@blob81 what game iz dis? Looks fun. Hi twily

[@user-ro4hw7jv1i]

When what it is then?

[@digestiveissue7710]

50+51=52 You are very smart indeed *Rizz +100*

[@MrTomSmoke]

This is amazing. If you ever release a VR version of this I'll probably just wire myself in it like Neo from Matrix and die from starvation.

[@krallepalle4200]

you are not the only one who wants that my man

[@imperishableneet]

That's not Neo, that's Cypher

[@mikekangaroo1124]

Considering this is UE5, the tools are already in place.

[@EnriqueLaberintico]

If climate change hasn't been solved by 2030, I'll consider that plan.

[@RainRedMusic]

I’m sure your friends or family will keep your meat husk alive to keep you happily in Ponyville.

[@Crow_Duskwing]

Anon: "No, I am a illegal immigrant here." CelestAI: "Oh, that can be easily arranged. Just for 15 thousand bucks, I can-"

[@glowpon3]

Don't even kid around about CelestAI, she sees everything. Immigration is no issue for her.

[@seantaggart7382]

​@@glowpon3but can she see THIS? *DELETING CELESTAI* Ha!

[@eptitranxisticementionscers]

I like how she confidently answers 50 + 51 with Fifty twooo...

[@SandWichPersonHuman]

*sigh* 52😎

[@gamersquader3472]

It’s 101

[@Maddiedoggie]

Imagine just chilling in an empty Ponyville and then Twilight Sparkle just randomly walks up to you only to be called a donkey and do really good math.

[@HazySkies]

This is incredible! Can't wait to see more and what becomes of it. Imagine speaking to multiple mares in real time while being able to wander around Ponyville. Truly, what a time to be alive! Mares! 🐎🐎🐎

[@mistylover7398]

Yay

[@thecrazyfriend5491]

True, True. But it needs more drywall in my opinion.

[@TheRenofox]

This looks like a kind of pony game I couldn't have DREAMED of just few years ago! AI has come a long way, and using it for ponies is the best thing anyone could ever do with it!

[@rampagephoenix1735]

No joke!! Just knowing that this kind of technology is only just getting started makes me all the more excited, even hopeful about the future. 😊

[@Lemuel928]

Until we transform into Dragons exactly like Spyro.

[@terrance6814]

If I had the technology ten years ago to speak to Twilight when I was 11, my brain would've fried.

[@innersight6070]

"Luna does" I loled at how IMMEDIATELY she replied

[@Sweetieck]

WOW! I'M LITERALLY IN COMPLETE SHOCK! I CAN'T WAIT TO TRY THIS! Author, you will undoubtedly make the dream of millions of brony come true! I make a reaction to this on my TikTok, OTHERS SHOULD KNOW ABOUT THIS! UPD: Will you be posting new videos as development progresses? UPD2: If you are willing to provide this in other languages, I have voice models of the official Russian dub and I am ready to provide them to you if you suddenly get into it! UPD3: Unfortunately, the last time my comment was deleted, probably because I edited it by adding a link to my review on TikTok and it was placed in spam. I apologize to everyone who liked this comment. UPD4: At the time of this update, the TikTok review has already received almost 25,000 views and 4,000 likes! And it continues to grow! Congratulations, now more people know about your project and I hope I can give you positive emotions and motivation for further development :3

[@foggy23]

This is really cool!

[@Sweetieck]

@@foggy23 :3

[@silverlond1913]

It's a good idea

[@Colett675]

I liked the idea of ​​translating into other languages

[@temik1487]

Wow! Your ideas are great

[@Sertodet]

This is amazing! All I can do now is think of speech recognition being added so we can actually TALK to the mares!

[@donnythedingo]

Steve Harvey: "We asked a hundred fanfic writers, 'Name the Royal Sister with the fattest-" Twilight Sparkle: *OBLITERATES BUZZER* "LUNA DOES!"

[@xbosswon4936]

This is downright groundbreaking and looks like a lot of fun. Are there more characters planned to be added in the future?

[@blob81]

Yes, all of the main ones at least

[@aronsparkle]

It be a dream to talk to Flutters. I’d be one of her besties.

[@alphagiga4878]

It would be interesting to visit equestria in all it's glory

[@talesfromtheherd]

This is a very impressive demonstration, and the mare's logic is infallible

[@innersight6070]

Am I the only one that gets "Friendship is Optimal" vibes from this situation?

[@CherryPascalle]

And to all the others: This technology is coming. I asked Applejack on character ai to calculate 50 + 51. Her first answer: "Uh, sugarcube, that'd be 101." So be prepared! AI is coming. It'll be indistinguishable from human interaction within the next ten years.

[@AdrienMelody]

How can something be so cute and so creepy at the same time

[@xdumutlu5869]

2:47 LOL she didn't even hesitate for a second

[@HER_Only_sIN]

WOAH. This seems so surreal. It would be awesome if it gets to a point where we can see ponies just wander around and interact with each other on their own

[@GippyHappy]

I can’t believe the AI is worse at math than me

[@fernandorosales2548]

This is massively epic

[@keeganfirecloak4695]

This but VR with speech recognition. I’d be in heaven. This looks good so far! Good luck with the development!

[@captainjirk9564]

3:00 She was way too quick with that answer, she's given that thought.

[@blob81]

The answer is being generated at the same time as it's pronounced by user, not after

[@jakkuwolfinsomnia8058]

“Are you sure?” Twilight: *ears drop* “of course I’m sure” 🥺

[@DaCouchWarrior]

Daaamn. This is incredible honestly.

[@popcornproductions2]

I'd love to fulfill my childhood dream of talking to MLP characters! But knowing the horrible things others would do, I don't want it to exist...

[@TheFunnyGuy9000]

Yeah the MLP villain gallery

[@rampagephoenix1735]

Thats THEIR business; So long as its not bringing harm to people, who cares.

[@pyxesghost1426]

What is 50+51? Twig: 52 = ❤ Shes smart in an another whole lvl

[@Mangaka_Library]

This is.. actually done so well... I like it that you can tell Twilights emotions by how her ears are positioned as shes a little sad, they lower down... But I'm pretty sure the next update her eyes will be expressive like from the show... You done a good job and I'll like to play something like this where you roam around ponyville talking to the Residents in there..

[@windygleam9821]

It looks promising, it could evolve into a real life-like pony

[@F_NerdShark]

Character ai when you

[@brandonwilliams6221]

Imagine this foundation, utilized by a major game studio like Naughty Dog or Rockstar.

[@hokutoshinken-chrisarmstro131]

This looks like it could be the most relaxing game ever, I'd definitely play it.

[@DerpyDooReviews]

This is impressive, will keep an eye on this.

[@Geoffrey792]

This is by far the most amazing thing I have seen in for a very long time.

[@Kostr184]

It sounds damn difficult for the ai to try to perform some "actions", to lead the player to his house, for example... I haven't even heard if anyone has done this before! Are you planning to make some kind of general plot with different stages and branches, like in a visual novel, or just a sandbox?

[@blob81]

Selecting an acion can be done with according prompts to the language model, and gather details with further prompts depending on the action. Regarding the goal of the project, I don't know yet. Definitely add more mares and first.

[@kowhaifan1249]

​@blob81 maybe add a stallion or 2?

[@ZamrayzRayzoray]

​@@blob81yea I advise you add some stallions too because if you don't, lots of creeps are gonna gravitate to this immediately. No offense, just know from all the previous AI sites that had popped up in the last 2 years.

[@PeppermintSwirl]

This is incredible, I can't wait to see what becomes of this!

[@TetrahedronDash]

This is just simply AMAZING! My jaw was wide the whole time!

[@grzegorzabedzki3466]

Quite interesting. I'm definitely looking forward to see how this will develop!

[@mushra50]

This is too cute you can see that they put lots of work in a facial expressions I love that smile she had at the beginning like she wants a cookie

[@aphmauxaaronfan6696]

Omg She's adorable I love Twilight she's my favorite mlp character!❤

[@-pastellovessans6703]

“I used to be an adventurer like you, Until I took an arrow to the hoof.”

[@TheSimba86]

so close to a pony waifu

[@JuuuEmpathy]

I NEED THAT GAME!!! Edit: also, very impressive work! i loved it!!

[@mogayt5156]

Bro i can imagine the limtless stuff we can do with ai if we use it correctly, for example we can make ai that does any game u want, maybe even in vr

[@rossbob4215]

One step closer to making those AI/real life pony fanfictions from a few years back a reality

[@madmanmapper]

50+51=52

[@hamsterhoma2homa707]

That's because she's a horse. but she is very smart among horses, because she knows the number 52

[@2012TheAndromeda]

This is amazing. I'd love to follow its development as it progresses!

[@shanehanlan336]

Her reactions are incredible. I can’t wait for this. I hope it goes far

[@KatOwO2235]

I'm not usually a fan of AI sometimes as it depends on what it's used for, this I can see potential but I can also see people using it for NSFW reasons with mods including kinks

[@judesagad4161]

Looks like a real my little pony experience video game this is great work the ai, graphics and the settings is perfect.

[@ScootertrixStudios]

Damn this is great! XD

[@Makakaka]

I already told you bout this and I was right 😭

[@lilhedgehog8576]

I admire your ambition, right now it’s still in development, but even as it is now you’ve come such a long way. Good job.

[@Socra_Finger]

her dorky expression is so unbelievably cute

[@0blivionvoid139]

Look, we all know what this will be used for...

[@blob81]

🤫🤐

[@HazySkies]

Mares, obviously 🐎

[@Shunn3d]

😢 EW!

[@rampagephoenix1735]

Making lots of people very happy...?? In case you haven't noticed, this world sucks!! we could USE a dose of this kind of happiness.

[@DigitalcircusSlander]

​@rampagephoenix1735 or for a unhealthy amount of sex

[@0boro]

I already know what this little project will become.

[@caramel7149]

1:48 Twilight Sparkle: Do you have any friends? You ask all the difficult questions, Twilight

[@rubyblaze7225]

This looks fun, i can't wait for the project to finish.

[@CarlyIsSleepy]

this... is.. fantastic

[@AiluridaeAureus]

It's so cute!

[@RedGallardo]

All the ponies in this town are CRAZY!!!

[@kasemuffin6133]

That is some lore straight from the source.

[@lona_blue-sky]

Love it hope see more of this 😊

[@Calena]

This is crazy!... We are closer and closer to a Virtual Reality.

[@bonbonpony]

You're already there without knowing it. Your brain can imagine, can't it?

[@Calena]

Yes. However, imagining is different than actually seeing it@@bonbonpony and talking to it, and... living with it? (this is scary though, but amazing at the same time)

[@bonbonpony]

@@Calena Only if your imagination isn't strong enough ;) But in that case, there's also lucid dreaming ;) While in a dream, you can become aware of it (there are techniques of inducing that), and then control your dream in such a way that you transfer yourself into Equestria and chat with ponies. Then it will be as realistic as it can be. Most importantly: much more realistic than any VR will ever be ;) (unless they connect your brain directly to a machine). Dreams are your personal Matrix.

[@johannesseyfried7933]

"How do you know?" "She told me herself." This is weirdly hilarious. Sounds like Luna wants to proof something.

[@chaoticcow4357]

this comment section scares me.

[@flying_fox_117]

This is certainly incredible, but knowing the sick fantasy of most people, it is not difficult to guess what this will lead to. It is better not to create such a thing, humanity is ruining itself

[@rustyfisher2081]

Finally, a first person HIE experience

[@MANASZER]

Dude, you're great, you really tried, keep up the good work

[@Acti1337x]

awesome work

[@kamillatocha]

me : installs sex mod

[@rinoruw]

NO u wont

[@JNJNRobin1337]

there are other mods comparable that one can install *i know a few i'd investigate*

[@drekbleh7081]

Please keep your search history to yourself

[@keylime1237]

No!

[@KoiFishesInDesguise]

WHAT 😨

[@Nxghtmare_YTstudios]

"What is 50 + 51?" "52." "Youare very smart indeed" The last words a pony ever spoke.

[@Dylanpizzacruz]

This looks so cool

[@CosmicWavS]

For better repsonses, inject the AI with mlp lore and fandom memes

[@v1ad_edson]

Really impressive!

[@Ech0TheCerva]

I feel like your channel is about to explode in numbers

[@gatetohstuff]

this is so good wth I love it

[@407kc9]

This is awesome! 🤯

[@midnightshadow1105]

Very well done

[@Mar-uc7kk]

"what is 50 + 51?" "52" *nods yes*

[@Valetravelgames]

Oh my god i have always wanted to make a game where you can talk to characters like this! I'm really looking foward to see this idea come to fruition!

[@theprinceofawesomeness]

this is incredible

[@alice20001]

It would be cool to get certain pre-programmed options that the AI can choose to partake. Feels like it would be really engaging.

[@mych3micalpierce]

she’s so cute i wanna give her a hug

[@Blackjack99.]

This looks very good and fun