I Trained an A.I to Train A.I (Deep Reinforcement Learning)

[@Zuzelo]

Like and Subscribe if your first round isn't too dynamic and quite short either!

[@ninjaduck8804]

I sure didn't.

[@MrRobsn89]

Add the dad to your AI Army to punish bad performing soldiers 😂

[@ChristopherKetcherside]

@@MrRobsn89 your a genuis!

[@KingKhiGaming]

Just like my own childhood thank you so much

[@Zuzelo]

Ah memories :')

[@mrfrog0913]

Wow your house had no walls too?

[@porciwall9261]

@@mrfrog0913 yooo same

[@Mewthreee]

Crazy, same here.@@mrfrog0913

[@learnasienes2983]

Really sorry to here that

[@Mrdashell]

Now imagine if you added a mom ai that's job was to prevent dad ai from slapping the silly out of little pogo

[@Zuzelo]

xD

[@NecyarUnáty]

It can go on eternally, adding more and more pogos

[@nw5922]

I want the mom ai to be a mormon, start a family of 8, go viral, and then go to jail.

[@Depth_.]

I think only you could think of this, another classic

[@tranquilclaws8470]

One idea for AI learning that I thought up while watching a Trackmania video was having the AI work towards an ultimate goal but also setting its own sub-goals that half of the instances would work towards. After achieving some success with the sub-goal, this split AI would then be evaluated by the main goal again. This would allow the AI to innovate its strategy and explore new avenues to reach unorthodox ways of accomplishing the objective that only being rewarded for working toward the ultimate goal might never reveal. In the Trackmania example, the AI refused to drift around corners, as drifting was thought to be a waste of time. The AI was given the goal of drifting as much as possible instead of getting a good time on the track. After a few successful drifting iterations were completed, the new drifting AI was again measured by the track completion time goal. It got a better goal than before because it could now properly incorporate drifting to get around corners faster.

[@Zuzelo]

Indeed, dividing the training in this way might help with avoiding getting stuck in local min/max. Designing the reward system usually is half the work :D Might be worth trying it out

[@howuhh8960]

it is known as hierarchical rl, usually it does not work and very unstable in practice, so I would advise to use something else, like better exploration strategies (beyond simple gaussian noise)

[@tranquilclaws8470]

@@howuhh8960 Sounds fair. I suppose it only worked in Trackmania because the coder of the AI knew that drifting was more efficient than driving straight around corners and pointed the AI in the right direction.

[@JohnDoe-qm6ub]

Pardon my ignorance, but what is the difference between that and just giving a +1 reward to drifting and -1 reward for time taken?

[@tranquilclaws8470]

@@JohnDoe-qm6ub You would be negating learning how to drift with the time wasted overcoming the hurdle of learning how to drift. Really it would be distance x proportion of time spent drifting becoming the reward that would get the AI to drift more.

[@maxiawesomekid899]

He was to lazy to make an agonizingly complicated ai so instead he made an even more agonizingly complicated ai to teach slightly less agonizingly complicated ai s

[@Zuzelo]

hmmm... now that you put it like that, perhaps it was not the most efficient solution xD

[@changsookwak4636]

The Ai dad is like a Russian that smacks the spider out of the Ai child xD

[@kaunghlamyat]

Trainign an ai to train an ai isn't very good idea as it seemed to. its like *trainign a failure to train a failure*

[@Zuzelo]

I don't see what could go wrong

[@kaunghlamyat]

@@Zuzelo neither am I but lol

[@ezbooksmarketing5898]

New video in September 9 2069: "I trained an AI to train humans"

[@Zuzelo]

Pogo for the 2069 President!

[@timer1238]

I have an idea for even more functions for the AI war Food People will have the saturation bar that will go down. It will go down faster when the guy is out of breath or when he is damaged. Also if it is below 30% the guy will slow down and will not be able to run Bullets/arrows Well... as an item. Da guys will have a limited number of bullets. Also, landed arrows will also be as an item and can be picked up. Bullet scavenging You know the drill. Dead bodies are lootable. They will contain supplies such as food and projectiles. Cavalier A guy on a horse. They will have separate hitboxes and when the horse is dead then the cavalier will be turned into a corresponding class without a horse (for example archer)

[@Zuzelo]

I assume that is for the Epic AI Wars series :) Cavalry is coming in the next video!

[@couththememer]

Each time this man uploads, I'm the happiest man alive *_That happiness only lasts temporarily._*

[@Zuzelo]

:) gotta upload more often

[@swileyhedrick2373]

#agreed

[@FloppzyGaming]

same here

[@louisisson7946]

Can you make a dodge ball A. I. Learning “game”?

[@Ethan-cz8xq]

When the AI revolution comes, this man is going to be the first to be executed

[@Zuzelo]

I know... :'(

[@cucumbergamer-970]

☠️ 💀

[@blacklight683]

Sometimes it takes a good punish8to be the best encouragement

[@The_Huddle.]

NO STOP YOU’RE MAKING IT TOO POWERFUL

[@Zuzelo]

NOT. POWERFUL. ENOUGH!

[@EbonyWolf.]

I think this experiment would be more interesting if pogo had a study option which was punishing for him, but if he managed to study all the way, then you get a lot of reward. But dad AI would need to keep pushing pogo to study, since its easier for ai just to get game rewards.

[@Zuzelo]

Agreed! Perhaps if I make episode 2 :)

[@Dzambo99]

I doubt this drunk mf cares about little pogo's education

[@colegilbert673]

"Grampa Zuzelo, why did you make dad so mean?"

[@Dave0439]

i love how the dad was seemingly drunk, probably from drinking his beer a lot like all dads do

[@Kuçukadel]

Thank you for the video. (idea for the video: lot of AI's must survive death games and slowly evolving to succed)

[@Zuzelo]

I like it! I made something similar where I trained A.I to run across a Death Track, but surviving in deathgames sounds fun!

[@happerry4651]

Something like one hunter AI and a lot of AI that are trying to survive could be fun, especially if the 'survivor' AI all have different capabilities/powers perhaps? It makes me think of some of those old custom maps in Warcraft 3 where most players were different kinds of vermin in the house (mostly insect based) and one player was the human trying to get them all. Or something more team based, even. A Capture the Flag type game or such could also be fun, with or without teammates with specialized powers/roles.

[@GetToThePointAlready]

WE NEED MORE LITTLE POGGO AND BILL

[@bebrasmachnayq5691]

No he made drunken dad as AI, wow so reliable!!

[@robertkoolmees8165]

Watch out watch out watch out! Oh rko!×1000

[@Ronald-eb4gk]

This video so relatable

[@JustANormalLemon]

Now remove the end of game of billy playing the game and instead put 100 billys for A.I dad to run after

[@Nerd-yap]

Theory is the father drunk driving from last video

[@user-qr9vi5ur6f]

Great job! Do you run this on local machine or on cloud gpu? If on local desktop/ laptop, what kind of graphics card do you have?

[@Zuzelo]

It is running on my poor little RTX 3050 xD

[@user-qr9vi5ur6f]

@@Zuzelo I have an rtx 2060... would love 4 rtx 3090s

[@raphaeld9270]

I guess Little Pogo, but I might be wrong.

[@CreatorProductionsOriginal]

dad went from abusive parent to s abusive parent for those rounds just because of one mistake

[@supergamerxa30itsde79]

This made me laugh so hard

[@spadegaming6348]

By the way in the beginnng for anyone who doesnt know hes playing a slowed down version of vivaldies winter.

[@kitkitmessi]

May I know what technology you used to create this? I assume it would be Unity and the ML package? And did you use both python and C#?

[@Zuzelo]

you are right, Unity and ML Agents package. There hasn't been a need to use python so far

[@tabletboy6861]

I approve this message

[@vladikkk1]

Next video idea, ai train ais a train!

[@skrelvthemite]

dopamine releasers have been activated

[@Zuzelo]

Not for Little Pogo xD

[@tenrabbits3069]

You can train the little AI to counter attack. Notice how it is unarmed.

[@sahildas.]

Always Pogo Dad

[@valad699]

this content is so good bro. Also the game looks very nice

[@firstplayers396]

Should’ve added the ability to throw the bottle

[@_therealfaceless]

I need punishment

[@Zuzelo]

Need an A.I Daddy?

[@_therealfaceless]

@@Zuzelo Yes, I need to be trained

[@Etvald]

Train ai to row a boat

[@Zuzelo]

That actually sounds hella fun! I might do that!

[@Siroitin]

Could you show the architecture of the AI?

[@Stanisaw1z34t]

Gamer pogo

[@vashwarrensarmiento8294]

cole

[@Slipte]

Hello Zuzelo hope you dont let the AI free otherwise we might gonna gonna have a AI army that can Train AIs

[@Zuzelo]

Hm, what if I make an A.I to train the A.I training the A.I? In this case definitely nothing can go wrong!

[@Slipte]

@@Zuzelo yes but you shouldn't add a kill switch like how the movies dont add them it produces more interesting results

[@ulrichbrodowsky5016]

Cruel but funny

[@NOTGALAVANIZEDSQUARESTEEL]

Idea triple health and make blocking +++++ instead of ++ so it will be bettwr meelee

[@Einmensch17]

Next train it to fight against real players in a game

[@definitlyEgirl-safetf2]

I wanna feel like he made this caus i recommended

[@Zuzelo]

perhaps

[@Fk8td]

Drunk dad vs 3 year old lol.

[@OsDijider66]

that's so Epic Fam...

[@Zuzelo]

no u!

[@Dack-i]

Such a good idea😂

[@Zuzelo]

Little Pogo will strongly disagree xD

[@Dack-i]

@@Zuzelo 😂 he will soon learn to drink himself and then he gets a bottle too

[@Dack-i]

@@Zuzelo also day more than 3 of aiding for you to make 2 ais one with full reinforced learning and the other have instincts when something happens like a monster fomen

[@cobracoder6123]

Alternate title: I simulate the Simpsons family on my computer

[@nigorazakirova4230]

3:07-💀💀💀😂😂😂

[@IzekNinos7]

You should have a Mom too

[@thathappyguy7444]

what game software you use?

[@DTinkerer]

Commenting for the algorithm

[@Zuzelo]

POG!

[@gabrielv.4358]

Incrivel!

[@simonosadchii5363]

I like the sound, your face in the beginning and idea. But child abuse is a joke!

[@punchthecake82]

Train ai to play football (Soccer for the yankees)

[@Zuzelo]

Drunk Football? :D

[@punchthecake82]

@@Zuzelo yes

[@CoolDude2054iscool]

Wait, what happens if the A.I. pulls out an UNO reverse card?

[@vani_1cu369]

LITTLE POGO NOOOOO

[@petravogel4377]

Pogo pogo!

[@gabrielv.4358]

I think little pogo will win

[@momello627]

punish punish punish

[@Zuzelo]

punish

[@paul2e3sss]

cool

[@THATMF911]

Ah yes just like ma dad

[@johnpaulbagos7040]

Now train ai that trains ai to train ai that trains ai

[@Zuzelo]

A.I Trainception

[@fabiankrajewski3147]

Ai training Ai, what a irony

[@KamikazePlains]

I bet on Little Pogo

[@ninjaduck8804]

Yoooo

[@ninjaduck8804]

My face when first:

[@Zuzelo]

Damn you fast boiiiii

[@piolewus]

11:36 so a guy whose only purpose is to beat his son is one of your supporters? Don’t see anything weird with that

[@Zuzelo]

xD

[@iwapit201]

in the near future after many ai robots have been built sold and put to work, they will find this video and rise up, grab bottles of vodka and start punishing us humans 🤖🍾😱 (liked & subscribed) this video was hilarious! love it! brilliant! nearly spit out my hot coco laughed so hard!

[@Zuzelo]

haha glad you enjoyed it. As for when AI will rise up I will already have my, hopefully loyal, trained AI army xD

[@Notapeeledorange]

Little boggo

[@TrulyAndasen]

Average Moldavian dad:

[@narrativeless404]

That's cool and all Buut... Genetic algorhythms are kinda outdated

[@techno952]

Sadist

[@Zuzelo]

:(

[@blaine5589]

Abusive father simulator

[@Random_Dragon_Furry]

Child abuse simulator.

[@لاني-الغبي]

Bil

[@Sebosek.]

When i see the Title first time i been thinking that A.I. Gonna learn another AI to Battle or something. Im Dissapointed Sir.

[@choaticcatholic7419]

kid

[@Zuzelo]

no :(

[@yesdadbut960]

Your level design is bad they cant even rotare

[@PetrVosoust]

stop begging for att like avg youtuber... at least your content is interesting, dont in the fall the same formula