VFX Reveal Before & After - Anime Rock, Paper, Scissors 2

For the past year we've been attempting to mold Ai models into useful tools to help tell stories people enjoy. Learn these powerful tools for yourself through our EXCLUSIVE TUTORIALS. Join CorridorDigital with a 14-Day Free Trial ► corridordigital...
Watch the Full Version of Episode 2 ► • ANIME ROCK, PAPER, SCI...
And Learn how we Made it ► • Did We Just Change Ani...
VFX Reveal the Before & After Side-by-Side of How we Took Greenscreen Footage and Turned it into a Cartoon.
Our Gear & Partners ►
Puget Systems Computers: bit.ly/PC_Puget...
Lighting by Aputure: bit.ly/CORRIDOR...
Our Go-To Gear: bhpho.to/3r0wEnt
ActionVFX: bit.ly/TheBest...
Cinema4D: bit.ly/Try_Cine...
Nuke by The Foundry: bit.ly/Nuke_Co...
Octane Render by OTOY: bit.ly/Octane_W...
Epidemic Music: bit.ly/Corridor... click this link for a free month!

[@sweetyespop1235]

Gotta love Jordan posing for the butler, probably one of the funniest parts of seeing the non vfx version

[@SeyiOfficial]

Where

[@ArktischerFrosch]

@@SeyiOfficial 0:41

[@grip3939]

Same😂😂😂

[@reduxreacts]

She's amazing 👏

[@rebeccaberton4144]

Ik bro fr😂

[@ConnorHammond]

Every time Sam's marching music starts, I can't help but laugh. The ridiculous premise of his character's powers, his walk, his voice, and the stupid hat. My god, I adore your creativity and humour.

[@Israel_hart113]

What I'm far more impressed by is making basic 3d elements look like hand drawn anime. That rabbit man...

[@jflintgaming6832]

also the "fathers grave" scene!

[@honduraseselmejor1]

I think they mentioned almost every background was made in Unreal Engine by Sam and then made with the AI in the anime's art style. Pretty bonkers!

[@HahnKirby]

I wonder what it would look like if they used that one software that can turn them into 3d models, make an animation with those models in 3d, and then plug that into the ai software to make it a 2d animation.

[@TheOriginalBeasticle]

Dude I'm glad someone else mentioned it, even with certain elements not being perfected still, the rabbit was actually super well done and could convince someone it was hand-animated. Speaking of, I saw this dude who I think would be excellent to review on VFX Artists React, he goes by Eagan Tilghman, and he recently did a stop-motion Scooby Doo episode that you would swear was done by hand, but was actually entirely done in Blender. Definitely worth a watch if you're a fan of Corridor.

[@planetmuskvlog3047]

Good point! And the skeleton demon!

[@RavTokomi]

I thought Sam's muscles were all done by the AI, seeing that cartoonish muscle suit is just perfectly hilarious.

[@TheRealAlpha2]

I love how you can still See King Sam's real beard under the fake one even in the animation. Also the fact that so many of the dynamic camera moves are done in live action is incredibly impressive.

[@Deliveredmean42]

Tho makes us wonder why king Sam still has a white hair 30 years ago. Could have done with a bit of touch up in that regard.

[@DavesThePartyGuy01]

I saw this too but its CANNON

[@Deliveredmean42]

How did you know his age?@@robocu4

[@ghostderazgriz]

Well that was the point. They wanted to "film" an anime.

[@marcussmithereens-smithert5409]

It would be cool to see you guys remake this in a few years using the same source materials! I'm sure the tech will improve so much by then!!

[@NephritduGrey]

I mean they could simply make new episodes too, like have it be the next generation, after all one of them has a child already and if the other has one as well, maybe revealed in an after credit scene, the circle could continue.

[@marcussmithereens-smithert5409]

@@NephritduGrey well yeah, they certainly will, but it would be cool to also see a 1:1 comparison shot for shot!

[@christophermullins7163]

Technology isn't going to suddenly make it better. What are you gonna do.. implement AI and remove the human element?

[@NephritduGrey]

@@christophermullins7163 Well, artificial actors might be a thing. Like have an AI for the screenplay, have an AI for the scenery from the descriptions in the screenplay, have an AI generate the characters with the same setting, have AI voices...yup from the descriptions... Though it likely would lack the human element of quality control, though with advanced enough parameters AI might get something done as well... like for continuity of eye colors (or other features) if they have a "memory" storage ready where the different AI's would draw from for consistency. Or the anti-"stutter" feature might be some autodetection of color changings inside elements, so it would act on "stuttering" but be fine with transitions to shadows or the reverse by introducing a light source. Basically it's just a lot of work but shouldn't be impossible, likely will be a work in progress for X amount of time too as an algorithm or any program for that matter would only do what one tells it to do so figuring and experiencing the individual parameters is a big step.

[@feffy380]

@@christophermullins7163 There's still tons of issues with faces in wide shots, which can be solved by using a larger resolution than what's currently possible. So yes, technology will absolutely make it better

[@DuskGuy217]

I love how heavily they leaned into the anime style in the live action shots, like the dramatic slow mo when young Jules collapses from his chair or holding on a single frame when a character is in the middle of an intense action. They didn't shoot it like a live production, they shot it like an anime, which must've required a bit of a paradigm shift in how they approached those shots. Awesome work guys!

[@musachi5999]

The writing is that good and so on point that I am just as engrossed watching it broken down as I was watching the finished product. A testament to the brilliance behind what you all do. Amazing.

[@elomaquiabelo]

The magic about this channel is no matter when i come back i feel it's the best content on KZbin and at the same time that i could be filming this with my friends. Makes me wanna cry and smile at the same time

[@Coffeezilla]

This is next level. Congratulations on pushing VFX yet again guys!

[@DuskGuy217]

From the man with one of the coolest sets I've seen from a creator!

[@toxicaristotle3052]

Wait wtf. This is some weird crossover

[@ConnorHammond]

Huh, I was wondering how you made such a sick ten million dollar studio. It all makes sense, now! Love your work, Mr Zilla

[@lethallohn]

@@ConnorHammond He must be a Corridor Digital Troop

[@MarkArandjus]

9:23 Jordan's surprised anime face is just quality, even raw.

[@noproblem2333]

Best face in the anime by far

[@jordanwoods462]

Had to comment again. This is quite possibly the coolest thing you guys have done. PLEASE PLEASE PLEASE continue! You guys are true VFX pioneers. Also, I love how in the other way”making of” video, you shout out to all the people who helped you along the way, and showed that there’s not really an a.i. “button” to do all this. It really takes a lot of creativity and skills to make something this great, and the a.i. tools just magnify your creativity.

[@PhoutianPhill]

The treadmill helps so much. In the first it was jarring to see characters walk in place but move across the screen, your body doesn't go through the same movement.

[@iVicEJay]

As a former Disney Animator myself, I trully believe you guys have made a huge achievement in opening up the possibility of animation to future artists and this piece is way to underrated and deserves far more exposure then it's been getting. We need to get this short to a million views ASAP

[@kobusdowney5291]

​@@gabriel_pavaniIts just a tool. You are just like those old school a animators who despised those who used 3D animation tools... Its the future m8...

[@jonathancullis9155]

not sure this counts as animation

[@kobusdowney5291]

@@jonathancullis9155 well, the scenes were compiled as traditional animation is compiled, the only difference here is no-one did any drawing other than the artist who the AI was trained on

[@AmedeeBoulette]

@@kobusdowney5291you clearly have not watch the part where they explain they hired an animator to train the AI on his style 😂😂

[@arog7493]

@@gabriel_pavani Literally no stolen art here actually. They hired an artist specifically for this project and trained the AI on his art, as someone previously has stated.

[@heinv2132]

1:26 I love how the processed image also has sam's original beard under the fake beard :D

[@JM-dc5rn]

loved that haha

[@theexchipmunk]

Same with all the guards being clones. Thats especially hilarious because changeing him up would probably have been relatively trivial. "We know we could have completly differnt looking guards all played by one actor, but that wouldn´t be funny."

[@jordanwoods462]

7:55 😂😂😂 Dean’s acting is incredibly over the top and I’m so here for it. All of you guys did an amazing job.

[@MasDouc]

They have to overact for the AI to pick up the mouth movement. Especially since they're using a morpher now.

[@Siberius-]

@@MasDouc - Though even if the AI or whatever COULD pick it all up, he would still act it out the same, since that's how anime be. The real life performance was much better than the animated side in this scene lol.

[@Optimusprime809]

Bro really said 😀😬😀😬😀😬

[@BlokHeadAnim]

10:32 this is probably one of the best rendered shots in the whole thing. Philip's face was so consistent, it pulled off the animation effect really well.

[@akumabito2008]

The green screen performances are amazing!

[@euansmith3699]

The use of the treadmill for walking up hill gave me a real smile. So inventive.

[@bobbyfischer9927]

@@euansmith3699Not inventive lol. That’s been used in the film industry forever. These guys did crush it though.

[@KarnBlueEarring]

10:08 Jordan's ability to make grimaces is seriously AMAZING!

[@creativeraijin]

The voice acting, the animation, the music, the effects, everything's so good! Gotta love the storytelling...

[@fearlessjoebanzai]

Incredible. You guys should be proud, not just of the excellence of the final product, but for holding true to beautiful values and sharing your knowledge freely. Kudos to you, it is humbling in many ways.

[@Dremth]

The tech is cool, but this is by far the best acted, directed, written, and produced thing you guys have ever done. The cinematography is truly great. The sound design is invisible, as all good sound design should be. The music fits perfectly. I mean, even the costumes are next level. It's clear you all spared no expense, and we're all totally here for it.

[@DavesThePartyGuy01]

You can just tell this is Nico's passion project! Every crew member delivered on this and i absolutely love Sams Barbarian theme throughout as well as his voice automation! Gee WHIZZ well done to all involved!

[@DavesThePartyGuy01]

One punch man and the Vinland saga references were so well done!

[@ron_sr1218]

I watched a video of Corridor from 4 years ago, one of the first VFX artists react, and its crazy how much they've grown and improved since

[@Jogwheel]

Imagine how much they've changed if you've been watching since 2010?

[@ron_sr1218]

@@Jogwheel yeah, I think I have watched some of their early video when I was younger. But I really started watching Corridor crew at I think the first artists react. That’s when I subbed

[@plixplop]

Sam's live action performance had me dying 😂 Excellent work from everyone!

[@kernyboydraws85]

beyond impressive. really consider making this a series.

[@AbjectPermanence]

I think I'd rather see them apply this methodology toward an original film if we're fantasizing about the possibilities. They've crushed the anime parody angle already, but they're still barely scratching the surface of potential for this style of animation.

[@_Crunchy]

@@AbjectPermanence When you consider how much the bts changed between the first and second Anime RPS, I think it's worth putting more time into furthering it as a short series just to get the style down properly before moving onto something intended to be serious.

[@deddrz2549]

​@@AbjectPermanenceidk if I'd say scratching the surface, I mean with each of the episodes they've done so far they have basically been at the cutting edge of their abilities with this tech so far. And they can explore it further without making a longer short film, infact being based on episodes allows them to further inprove it without being locked onto using old software until the projecr is finished, but be able to use any new tool that comes out as they make new episodes

[@nicholas_james]

Too late!

[@BritBox777]

@@AbjectPermanence Between this and last episode they had to completely change the work pipeline because of new tech. Between this and the next episode I guarantee we'll see something similar. Just keeping up with the methodology is hard enough, they aren't close to perfecting it.

[@Blu_Moon_Owl]

Sam is my personal favorite as the Barbarian King. It’s hilarious he fight with the “Got ‘Em” trick

[@remyb833]

I love the Original VS Processed, this just shows how much work goes into creating those short movies and also how good those guys are at acting and anything in between. Amazing work !

[@MooodyBoody]

It's so funny how mad twitter is getting about Anime Rock, Paper, Scissors lmao

[@impcityangel3245]

I'm just jealous of the barbarian king's eight-pack!

[@fabianjeldrespolanco6739]

Twitter gets mad about everything

[@mara_____]

Artists on twitter*

[@Eftkud]

What is a twitter?

[@gorylek198]

Quoting Dave Chappelle - Twitter is not a real place. Nobody cares what they think.

[@BrodieEaton]

Looking at the episode on its own, naturally all you can really notice is the jank here and there, but the side-by-side really gives a whole new appreciation for how incredible this technology really is. Insane work and huge props to you guys for pulling this off so well

[@artor9175]

Props to Nico for making a tutorial so anyone with the skillz can make their own high-quality animation. This is an amazing use of Ai that is still artist-driven, and I'd like to see more of it.

[@MunirRahool]

Many surprises! Jordan being one. And Seeing leads side by I feel I would like to see some touch of those facial expressions in the animation. Perhaps the next episode will refine that part.

[@tatyannafrancis9935]

The sequel left me with even more questions than the first but I love it

[@hristoborisov3713]

not a single second was void of love and passion, love you all

[@SaberSmith1118]

The funny part with the hunt is that if Jules just explained the situation to the king, he probably would have gotten mad at Philip because he wouldn't want a selfish ruler for an heir 😂

[@merseyviking]

You're right, but you underestimate the drive for a son to make his father proud, especially if he lacks confidence.

[@KSMinhoka]

It truly is anime

[@masamaeda9217]

I mean is it worse to be selfish or incompetent?

[@NostalgiaUnboxed]

This is absolute perfection. Story, acting, editing, animation, all of it. Wow!

[@Quintuplin12]

I think the most amazing thing about this is, early 2000s corridor was one of the trailblazers of adopting new technology in the youtube scene, and I love the brilliant silly VFX work you do... but this new direction is something else entirely! Y'all are hiring artists, investing in bigger projects than ever before, and scaling up the technology and applications into an entire new category of art. It feels like Rooster Teeth during their Monty Oum era all over again, and I'm simply overjoyed to be seeing this rebirth for your studio. I wish you the best of luck and will be watching with great interest.

[@biggolo85]

Sam's real beard showing through from under the fake one in the processed shot at 1:31 really made my day.

[@User-he6zd]

Amazing! Aside from all the (I'm sure) great fixes and editing to fix mistakes learned from ep1, the slight overexaggeration of words and lip movements to account for the AI's wackiness with lip movements is great

[@euansmith3699]

WHAT!!!... Do you... *NOT* _speak in this manner?!!_

[@taqresu5865]

I think the overexaggeration is also there to play into the anime trope, so two birds with one stone lol

[@LasCosasComoSean]

lip sync still looking pretty bad, though. They could have re-recorded the voices to get them closer to the final animation.. Sound editing is most definitely not their strength

[@User-he6zd]

@@LasCosasComoSean Whilst true, this is also not supposed to be a super high value/time intensive project as far as I can see. The next iteration (whether next ep or whole series) will improve the AI and so save a bunch of time otherwise spent fixing less egregious AI mistakes. Makes improvement easier to see too

[@taqresu5865]

@@LasCosasComoSean The lip syncing being off was a deliberate creative choice, because it's a parodying 90s anime with terrible lip sync.

[@ekojar3047]

I was watching this on my phone by myself with my earbuds too. and my 3Yrs old nephew saw me watching this somehow and said I wanna watch too uncle! So we watched RPS 2 then RPS 1 and then RPS 2 again. I told him that it is it for RPS atleast for now. so then I started Digimon EP1 S1. And he was absolutely glued now to anime. You created a new Anime fan tonight. You all should feel very proud of this for a little new kid to just look high up from the ground, and see a distorted perspective of this art style from his uncles phone. And immediately, he said, I want to watch this .... You are absolutely doing things right, and I hope this turns into a series for me and my nephew to watch now. Now dry your tears up haha. In the mean time we will be watching Digimon, 1st time for him and 2nd time for me since the debut! 😂

[@forgottenalex]

By any chance have you guys experimented with adding eyeliner and outlines to your face features in the original footage. I was thinking if you added eyeliner around your eyes it would give the AI an easier time on eliminating the eye flicker. You could also do this with the outline of your lip and mouth. And also adding a single line down the middle of your nose

[@HahnKirby]

That would be very interesting to see. I bet they could easily put on the makeup, jump in front of the green screen, and record a couple quick shots just to see how it would turn out.

[@AbjectPermanence]

I had the same idea a long time ago for using EbSynth to make rotoscope animations, using makeup to create "anchors" in the live video for drawn details to "stick to" in the animation. Some tests were done and it helped a bit. I'm sure it could help with this type of rotoscopy too.

[@sperzieb00n]

or they could use a plugin like Adetailer to set up customized face restore that uses information from controlnet and their already trained models, its a relatively recent plugin and to me it has made the a1111 built in face restore obsolete; gfpgan and codeformer make good faces but they are terrible at consistency and perserving style.

[@Gerthious]

Acting in this way without bursting into hysterics every second must have been so difficult. Looking at the original footage and knowing it can become the end product shows true vision...

[@austinleblanc234]

The music is sick!! Jordan getting knocked out and Sam’s circle of death are by far the funniest parts of the episode lol. Job well done 👏🏻👏🏻👏🏻 This brings anime to a whole new level. This is by far the best yet!

[@Wie_Is_Deze_Gast]

It's insane how good this looks

[@TheSniperpal]

Sam killed it as the barbarian king. Loved this!

[@AltKaxREAL]

this is like James Lee's style of video editing, but it actually looks like a cartoon/anime. it's not as exaggerated as his style, but you guys get the vibe across really well, i hope AI tools like this can help growing artists bring their creations to life

[@sabersight908]

this is quite interesting to see side by side, I'm making my own cosmic horror animated series (all drawn and music by my self) it wont be fully animated more a animated painting slide show :D im definitely excited for the day when all those facial features and emotions truly come trough with this workflow tho

[@BlokHeadAnim]

Dude King Philip's entrance with the rose was the coldest thing ever. I'm unironically invested in seeing him slowly lose his humanity as he continuously puts his kingdom above his loved ones.

[@FreezerdaBlue]

No way...there's a live action adaptation in the works?!

[@florianschneider3982]

😂

[@NephritduGrey]

Would be a fun UNO reverse card though by accurately turning Anime into live action, and not the subpar Netflix style but actually accurate.

[@pearce05]

@@NephritduGrey lmao that would be incredible. Use the same AI methods to turn the anime back into live action.

[@joseville]

This is so cool! Not only the technical side of it, but also the artistic side. The story is engrossing. 13:00 Philip is surprisingly self-aware

[@MooseCraft]

Bro this came out amazing! ❤

[@BearFOXThirty]

Sam's barbarian king is an absolutely highlight! Fantastic staging and direction with those scenes

[@oskararnarson]

The footage from 12:20... is just... amazeballs. 👏👏👏👏👏 Love what you're doing.

[@ngbr-mb]

While it looks absolutely fitting for an anime-style animation, in the raw plates the acting appears hilariously over the top. This is the dedication for which we appreciate Corridor.

[@smashallpots1428]

love seeing the goofy green screen shots this is truly art dont let anyone tell you otherwise

[@coolpantsmcgee9103]

Jordans acting is too good the anime version doesn't do it justice, except for the one frame at 9:23. that was my fav part of the video, I instantly recognised him in that one frame and the shock adds so much

[@OpinionatedGamer]

While the AI is really cool, the reason this is so good is because of the human element to it. Y'alls performances were so funny and well done and you can really see how they made the video in this comparison. Was a little sad to see that occasionally the ai lost some parts of your performance, sometimes giving the characters straight faces when in the video they had much better and exaggerated expressions, especially with nikos character although it still turned out great! I imagine this will get better as the ai and workflow are perfected.

[@kobusdowney5291]

​@@gabriel_pavaniAI has improved exponentially over the last two years. Things are progressing fast.

[@Deliveredmean42]

​@@gabriel_pavania bit of over exaggerated. Given that this kind AI has only been recently implemented in a viable open source way 3 to 5 years ago.

[@Xenathewarrior83]

​@@Deliveredmean42guys, no need reasoning with this guy - he's a troll)

[@En-Pea-Sea]

wow, I love this format, showing the entire EP side by side. Can't wait to see the progress on this SAGA!

[@jacobbalensiefer3846]

I really feel like this transcends “just using ai” this has the feel of the old rotoscoped tLotR films. The AI is just one piece of a much larger production. It still takes artists and vision to make all this happen. Barbarian king Sam is a top tier villain. Can’t wait for the “guess what….chicken butt” wizard and the ancient “cool S” rune carver to show up.

[@l0sts0ul89]

Yeah all the acting and just shows how much passion and fun they're having I wonder how many takes it took to do this, I couldn't stop laughing if I was here

[@AbjectPermanence]

Your idea about the "chicken butt" joke and "cool S" is interesting. I wonder what else they could slot into this lore. Knock knock jokes? "Circle circle dot dot, now I have my cooties shot"? A character who attacks by inexplicably predicting whatever their enemy is about to say so they can "jinx" them? Maybe a witch named "Bloody Mary" who comes for you if you spesk her name three times?

[@l0sts0ul89]

@@AbjectPermanence the infamous Deez Nuts and Ligma gods

[@kobusdowney5291]

​@@gabriel_pavaniyou're repeating yourself mister copy-pasta...

[@harshmoor2280]

This is amazing, I love the "life" of the characters. With this method, since you're using actual actors, you get movement in the characters that you dont get with a regularly drawn anime. Great stuff, I hope yall continue the journey. I think this is only an addition to the art, not a negative.

[@theexchipmunk]

But in contrast to cg animation based on motiontracking you also get the look of it actually being hand drawn. I can already see some really damn awesome stuff down the line. This is just scratching the surface.

[@MikeOlsen12]

Dean is a national treasure and needs to be protected at all cost! Great video crew and I can’t wait for the next one!

[@Allanon6666]

I feel like the best version of this would involve actual artists doing a clean up pass, but this is still fantastic for what it is!

[@nikytamayo]

a clear demonstration, AI mistakes and all, of how the AI pass fits into an actual production workflow, allowing artists to work faster and to concentrate on concepts and clean up, rather than simply supplanting then, as many fear.

[@davijimi]

​@@nikytamayono in the future only AI

[@DanboReviews]

I'm just happy seeing Niko happy and him being able to create his very own anime 😊

[@MortarMike]

My respect for their motion and movement grows with each scene I see of this... sheesh these guys were COMMITTED to their roles, and the payoff was super worth it. Also bonus points for Jordan taking roles, I had hope she had a hand in this content lol, and I DID not expect the butler hahaha

[@antoinettemiles5741]

Been a subscriber since the Sync days. Keep doing your thing and innovating!

[@kylebilenki]

The leaf blower in some of the unprocessed shots is so funny lol.

[@mwoodward1240]

I just love these side-by-side videos so dang much.

[@TheOriginalCatfood]

8:53 Looks just as awesome as the anime. What a chad

[@molliecrompton8208]

This method is absolutely incredible! You guys never cease to amaze, pushing the boundaries of VFX and art

[@Remymareno]

Not first, but here early for a change! Good work on episode 2, really liked it! Awesome to see the BTS from you. Tremendous effort from the whole team :)

[@theexchipmunk]

You know, what no one has been talking about, what we also might be looking here isn´t just a new technology, but multiple new jobs in the entertainment industry in their embryonic state. Most impactful of all something that has not happened since movies gained sound. A new subcategory of actor. Just as how back then, many previous actors of silent films had not always the skills to transition over, in a similar vein that an actor doesn´t automatically makes a good voice actor, this form of acting requires difernt skills. It´s more in the vein of pantomime than the realistic acting we have in modern movies. I am quiet exited about where this will go in the future, and in 10 years we will likely look at a very differnt landscape in the vfx, lifeaction and animation sectors. This really feels like a preview for the future.

[@tzachmost]

1:31 funny how the AI left the Sam's original beard underneath the grey beard XD

[@JuansGotThis]

14:12 😂 "goth queen, eye patch" has me weezing what a scene description

[@NaudVanDalen]

It's awesome to see both versions at once!

[@Editorinthemaking11]

Everybody is talking about the Sam's Barbarian King, but kudos to Ivy for playing Elizabeth. The king and queen have great chemistry. What a great episode! Eagerly waiting for the next one.

[@TheRealAlpha2]

Her character actually comes across as a likable innocent.

[@BeefForLess]

Such an interesting breakdown of the shots.

I love how Corridor changes and moves forward the ways art can be made!

[@randomhero6265]

lowkey more exited of what the story brings next :D but yeah, the pace of improvement is insanely impressive, big step from the 1st one. waiting for part 3 ;)

[@kinetic_1553]

This is so cool! For episode 3 would love to see a focus on trying to improve the mouths of the characters. The rest of the animation is basically there. Would it be possible to do a second pass over a close up of each mouth? There are some scenes where they look really good and they happen to be the really close up shots.

[@RogerUMartinez93]

Creating something like this takes months and a big team... wow, hats off to you Corridor, Pioneering something special and understanding its limits and potential. well done!

[@namelessalias0007]

Some pointers: * I think the end product would look better if the lighting in the source video was more diffuse. You can add the lighting back in via controlnet in a second step. * This might seem counter intuitive, but lowering the resolution of the source video might actually help the AI out. If you give the AI too much information to work with, it get's a little overwelmed. You can always upscale later since esrgan has great anime models.

[@anlumo1]

Stable Diffusion has a slider setting for blurring the input, there's no need for preprocessing in an external tool.

[@mjb3190]

the intro gives me full on chills. this is so epic you forget the concept is absurd. I totally bought into the world

[@macult]

I’ve worked as a 2D animator for 7 years and I am bordering on the line of impressed and scared, but honestly keep it up guys, as scared as I am, this type of innovation is what it takes to speed up human progress, I just hope I can keep my job for a few more years💀, when the tractor was invented many farmers complained about losing their jobs but the next generation embraced the increased productivity created by new technology, you guys are making history right now, anyone mad about it is just scared of the future

[@taqresu5865]

I don't know if this helps, but Corridor Crew hired an artist to formulate the style for this episode, feeding the A.I. references they had permission, and paid for, to use. This I think is a positive step towards A.I. art because it's not stealing art, and it enables artists to still have a significant role in the creative process. Here A.I. is just a tool.

[@jmhorange]

​@@taqresu5865 I don't know if this helps but what they trained it on is on top of the original stolen training data set. So they didn't address the underlying issues with these models and how they are threatening jobs based of artist's own data.

[@smartduck904]

I am a graphic design artist and I said that's about a year-and-a-half ago didn't have a good outcome but and have a really bad outcome they still need a graphic design artist for now anyway definitely looking at doing my own projects now though

[@MiPedoteTUMBA]

This is incredible! Imagine version 4 or 5 when the mouth and eye issues have been resolved! Add some tongue movements+more eye consistency and this is going to open up an entire new category of videos for people to make!

[@EricGarber]

Thank you for this! I loved getting to see Sam's character before.

[@LukaSauperl]

I can't wait for episode 3! The story has actually gotten really fun!

[@euansmith3699]

If this was a Hollywood production, the Director would be giving interviews saying that they didn't use any CGI. 😄 What a great video, and a cool look behind the scenes.

[@728GT]

Underrated comment

[@honduraseselmejor1]

Sound production makes this even more immersive. Gotta love it!

[@Floppa294]

Twitter sucks for Hating on this for "TaKiNg JoBs"... but Jesus this is amazing

[@FootyFlicksEdits]

As an Artist I do not know what twitter is talking about 😂

[@Floppa294]

@@FootyFlicksEdits they're basically saying that it's trying to "steal" and "taking artists jobs" or "making artists go out of business" where that is dumb

[@FootyFlicksEdits]

@@Floppa294 as an Artist I sorta agree with twitter but not on the "making artists go out of business" part and also it ain't taking our jobs it always is gonna look janky

[@MogulSuccess]

A full anime production house has been born - i wonder what epic sagas await us

[@WholeWheat_J]

Why is the live action so much more interesting than the processed version. Like there’s so much more emotion and feeling

[@etc834]

Corny.

[@just_kris]

Hm lemme think maybe because with the "filter" and since it still glitches here and there u can't see the emotions as clear as if they animated this in 3d or drew this by hand.

[@gmaster2647]

Well, the AI filter still misses a lot of the finer details from the mocap work. It's looking better but not quite there yet, they may need to use artists to fix some frames

[@WholeWheat_J]

@@gmaster2647 y’know, I was really upset with the first one for their use of preexisting material to copy other peoples work but when I think about I’m kinda fine with this one. I personally don’t like how the ai looks but with how awkward it is at times I can never see a future where live actors will replace animation at least in this style. It may look bad but as long as this “ai live action” stuff is done ethically I don’t see an issue with it. Even hiring some cleanup artists could bring in new work that wasn’t there before. It’s not animation, I hope they stop saying that. But it is a new medium of expression with art and I hope it finds its niche

[@gmaster2647]

@@WholeWheat_J For sure, and actually the Spiderverse movies already do that with cleanup artists and AI. They do a lot of art themselves, use AI to help fill in frames for scenes, and then do cleanup work. So yeah, there's a definite future with using AI as a tool alongside the human element. Helps streamline the process.

[@sum1liteamatch]

I absolutely love this, it's so ridiculous and I can't get over the art style of the finished product. There is still a bit of flicker that I know you guys are fussing over but honestly I love it. It's uniqueness makes it superior to a super clean and perfect video.

[@minecrafter0505]

I'd love to see this pipeline applied to an unreal engine production (using photoscans and mocaps). I think that could be insane.

[@jbritain]

I'm pretty sure most of the backgrounds and scenes were done in unreal

[@jramseier]

the backgrounds are all(for the most part) unreal engine and sam worked on those

[@malindukumaradasa3851]

Oh man I love king Doro! His walk, his theme and his attack technique are all brilliant. Please bring this guy back in the next episode!

[@theexchipmunk]

The reveal shot of what his "move" was had me genuinely in stitches. Not only was it cool but also a really creative shot, zooming away from the guard through the fingers, then back in focussing behind him transitioning to the attack. This also opens up a whole new world of antagonists with hilarious techniques. There is tons of these dumb games, the Game (you lost by the way), fliping coins, clapping games and so on.

[@Cheetahwithahat]

This is soo good, peak youtube content that will be someday end up in a museum. The exhibition called "the rise of AI art". I really think this (stable diffusion rotoscoping) at this level is a turning point for content to come. There will be soulless uses out there, but also empored, super creative artpieces like these that a whole audience loves :) keep it up

[@KaedennYT]

This episode is far better than it has any right to be. Given the technology, there's no way this could have been so amazing without the dedication given to it.

[@Music34897]

It's a really mind-boggling technical accomplishment, and will make experimenting way more accessible for some, but people who are freaking out about this replacing animation can calm down lol. One of the reasons anime is so powerful is the *animation* the way movement and expression is drawn in motion, squashing and stretching to communicate power, speed, and emotion. The amount of work you'd need to bring this stuff up to actual animation quality, you may as well just animate the old way without AI.

[@Orson_Welp]

This is all true. But I guarantee you a studio exec at Toei animation, Disney, WB, etc. doesn't care how good the product is. They care that it sells And the number of people watching this and saying "It looks more realistic than real anime!" should tell you all you need to know about what the average person is willing to accept in terms of quality This road leads to worse products, coming out with greater frequency, at a lesser benefit to actual creatives. Nothing good can possibly come from entertaining this idea

[@TheRealAlpha2]

There are too many directors that want absolute control over every frame to be a true threat to real animators. Honestly it's easier for a big studio to use CG models and something like 3D studio max or some other incredibly expensive tool rather than a free application like Stable Diffusion to fully change over their work flow to this, especially in Japan. Sure Disney used some AI stuff for Secret Invasion, but they still hired artists and were only purposefully using the weirdness of it for a 40 second opening seq. This method is far more suitable for a small production that can't afford an entire hand animation department.

[@Domzdream]

This is really amazing work guys 👍

[@dopetheadjective2020]

y'all really squishing the shit out of this for content, and im here for it.

[@MrSpannners]

Being able to see the leaf blower for the wind effects is hilarious 😂