Boosting Stop-Motion to 60 fps using AI

[@wenbobao7057]

I really like your sample here. Great piece for demonstrating our technique. Thanks for enjoying and spreading it.

[@LegoEddy]

So proud to see you commenting here! Researchers like you are whom I look up to in my own young researching career :) Keep up the great work!

[@wenbobao7057]

@@LegoEddy Yeah, it's my honor too. We all have to continue our hard working.

[@joemama-bu5ue]

Hey, you did a amazing work, this looks ultra great :) -now I can watch hentai at 60fps, then animation will be more fluid and smooth-

[@wenbobao7057]

@@joemama-bu5ue Haha, why not join us on Discord and share what you have. discord.gg/ZVk3zC

[@ArunG273]

@@joemama-bu5ue 🤣

[@NeoNinjaGames]

Everyone here shredding the artifacting and transitions and not just amazed at the fact that this just invented 45 frames that didn't exist every second. This is nuts

[@rdowg]

Well you cant just put up a video and say "it doesnt have any artifacting", and then show a few artifacts lol. I do think this is pretty amazing though

[@NeoNinjaGames]

@@rdowg IK i'm just disappointing that more people are focused on the couple of wrong frames than the thousands of magic ones.

[@dopaminecloud]

@@NeoNinjaGames I'm only disappointed at the attitude that interpolation is something stopmotion or any other form of animation would ever need. "More frames = better" is just not something that works for animated mediums. The technology is wasted when used on things like this.

[@HoloScope]

@@dopaminecloud I think they know that, it's just to show how capable DAIN is

[@mobmentality267]

Dopamine Cloud the technology isn’t wasted. It allows for creators to have a more professional look to their stop motion films if they desire without having to spend the countless extra hours to increase frame rate. It takes a video from being rough and looking like a flip book to looking more animated and smooth. The video is just as impressive either way, but it’s more of a viewing improvement as opposed to a creative improvement to up the frame rate with this technology.

[@BADC0FFEE]

it also interpolates the scene cuts, it's so weird, there's a morph effect every time there's a cut in a scene

[@matoushoral6082]

yup, so you need to feed it shot by shot..

[@tjwatson2249]

Yeah, I saw that when it was playing at full speed, and was like, "what is that transition!?" 😂

Theres a scene change treshold option, so that the AI don't do that weird stuff, i guess he didn't checked that option.

[@Ajee02]

You could just ediit that out afterwards cant leave it all to the AI

[@SierraGolfNiner]

Yea. I was going to say. The scene cuts need to be redone, other than that amazing.

[@DustinOffAClassic]

"I would have a hard time telling them apart" >>Astronaut teleports forward

[@dagothur1079]

Bastard, DIO!

[@yavuz9173]

@@dagothur1079 hoho

[@dev-g9j]

hahaha

[@Jords250]

hand disappears at 1:40

[@der_saftmon]

Mesa got that JoJo reference

[@handsomelessking]

Ok, there is some artifacts, like the hand movement and especially with the quick cuts, the cuts are fixable and the hands are minimal

[@wanhl2440]

There are simply no enough information to generate the hands movement in 60fps from 15 fps.

[@francogonzalez1985]

I guess if you make 32 to 64 it would be a lot better but still, it looks better than the original

[@handsomelessking]

@@wanhl2440 yeah i know, i only saw them in the 0.25x

[@brandomsoft5668]

1:37 second astronaut.

[@handsomelessking]

@@francogonzalez1985 i mean even 20fps would create a lot better result but still at 15 i only noticed the hands at 0.25 speed, but with the cuts you need to be tricky

[@Anonarchist]

I watched this with the sound off, and ngl had to double check that this wasn't Two Minute Papers.

[@DaedalusCommunity]

What a time to be alive! This video is sponsored by weights and biases

[@right_jehoon]

i clicked the video as this video seems like two minute papers.. and it wasn't lol

[@Anriru]

Same dude.

[@matthikin]

Just found out it wasn't two minute papers by looking at your comment LOL, watched the entire thing picturing his voice in my head

[@JackTheOrangePumpkin]

Very true

[@deathpie24]

It actually looks like they're moving themselves now

[@csongorawot6428]

Skynet is already around the corner. But this time it's gonna be LEGO figures.

[@3bigbignig-abandoned]

I don't want to ruin the 767 likes.

[@InstantNameOfficial]

@@3bigbignig-abandoned my name is micheal jordan. Stop it get some help.

[@3bigbignig-abandoned]

@@InstantNameOfficial Stop what? U have to be so rude just because I like planes? ☹️

[@InstantNameOfficial]

@@3bigbignig-abandoned what do planes have to with like... just stop already dude. Its cringky enough

[@CoolHardLogic]

No artefacts? Check out the disappearing hands on the right of the frame at 1:40

[@quintuhhh]

Lol didn't you notice the head at 1:38 in the middle.

[@supersolomob422]

Yeah there definitely are, I don't know how he didn't see it. I saw one of their helmets grow taller as well.

[@CoolHardLogic]

@@quintuhhh Not initially, but after I flicked it back when I thought I saw the hands disappearing. Then it was a case of the more I looked the more weird things happened :) Where it gets it right, it really does do an excellent job, but like all these things there are circumstances where it can't figure out what to do.

[@brotherthorns4615]

Yeah I saw that too but that was .25x speed

[@quintuhhh]

@@brotherthorns4615 even at normal speed u notice it.

[@toobin8r]

Honestly, that just looks exactly how LEGO would make their movies

[@elcompadrejose_]

@xg223 whats cool about the lego movie is that all the pieces used to make the movies are all actual peices in realife. you can literally recreate the lego movie at home

[@cophfe]

@@elcompadrejose_ except it was mostly made in cgi

[@thomashorne2607]

@xg223 The characters move at a low fps, but the camera is still moving at at least 24 fps to stay smooth.

[@colonelpopcorn1947]

@@elcompadrejose_ would cost you a fortune

[@sediew]

xg223 wait, they’re full CG? I thought they were indeed stop motion

[@SunspaceStudioProductions]

Big brain time: film at only 1 FPS, interpolate up to 60 FPS for lightning-fast production speeds!

[@AlfieLikesComputers]

The animation will look strange lol

[@TheDylandProductions]

In all seriousness, I do wonder just how low of a FPS you could use and have the result still look presentable? 10 fps? 8? 1? IDK. Someone should test it!

[@sirkuchen1501]

Dyland Pictures definitely not 1 fps xd

[@TheDylandProductions]

@@sirkuchen1501 Not 1 fps to 60 no. But 1 fps to 5? 1 to 10? And then 10 to 60?

[@sirkuchen1501]

Dyland Pictures no, im pretty sure this wont work well with 1 fps at all, but maybe 8 or so will do the trick. Though i myself would keep it to 12 at least, i think that should work out the bes

[@SirNarax]

Literally 2 years ago there was a movie called "They Shall Not Grow Old" that took footage from the Great War and did this sort of thing. 2 short years ago this was top of the line visual effects then suddenly a free AI can do a significant portion of the work from that film. Granted they also did voice work, colours and removed general imperfections but still.

[@Owl90]

Imagine what it could be two more papers down the line. What a time to be alive!

[@irok1]

@@Owl90 Two Minute Papers reference

[@SirNarax]

@@ExoJordy I know an AI isn't quite at that point yet. I am fully aware that old hand cranked footage has a varying frame rate. I was speaking general terms. 2 years ago it was impressive that the documentary added all the extra frames in the first place and now an AI can do it pretty easily and for free.

[@toobig7150]

Glad to see that people still remember that movie, god i love it.

[@SirNarax]

@@toobig7150 Sadly have not got to watch it yet. Still really want to. I live in the US which means it had a really limited theatrical release and I didn't have time. I could have bought it when it came to disc but I kept putting it off until I would have had some time to sit down and watch a movie. Suddenly now I have plenty of time but not plenty of money to spend.

[@RavenDravenek]

It’s not perfect, but honestly, that’s impressive.

[@thelegitdinosaur1278]

@@rock9737 look at the cut in-between the shots, it morphs to the next scene in a weird way.

[@333dae]

@@thelegitdinosaur1278 Someone already said just do it on each cut first before putting them together, also I'd imagine it's an easy fix either way

[@XxxXxx-yh5gz]

right on, not as mature but that’s a big step

[@paradox9265]

This is stop-motion 15FPS, but in animation at 24FPS it works WONDERS. And imagine that animators need to do less than half the work that they WOULD have needed to do, and then they can plug it into an engine to make it a buttery 60FPS! Obviously there is room for improvement but already crazy.

[@sanccex_313]

Not even impressive

[@CAMELOT331]

This was way cooler than expected haha. It was butter smooth. Butter is my favorite thing.

[@kavirajsivakumar7720]

Mine too

[@Fleischkopf]

butter is the best thing there is

[@jirxchi3676]

Mmm buter

[@jazminesarchive]

as a danganronpa fan that triggered me lmao

[@matt4280]

@@jazminesarchive oh no..

[@mystery5906]

i want to see someone apply this to a series of unrelated frames

[@fireyblackdragon]

you can see this every time there's a jump cut. The AI does its best, trying to create a convincing warp. Like if there's a face in frame on both sides, it'll slide the face from one to the other, but for everything else it kindas just gets folded in and sucked up into the lines of the scene. Things like this need to be given one scene at a time, and even then, the AI artifacting is really apparent. This is why I personally hate automatic frame interpolation. I'd rather have low framerate rather than an AI just bashing away trying to make more frames out of nothing. The tech is impressive to be sure, but it's not ready for widespread deployment yet.

[@Max_Meier]

@@fireyblackdragon Just let every short clip pass the AI and then edit it, then you have no jump cuts for the AI.

[@brianr6744]

Yes

[@jss1328]

@@fireyblackdragon Just edit those parts yourself and pass the rest through the AI. You have to admit that the AI does a really smooth job at making scenes 60 fps and that is way better than low framerates (based on the video). It's way easier than doing it manually and it has a nice end result. But really, just edit the parts you don't like yourself. Think about it, even if the AI didn't do a great job at everything, it will still smoothen out some parts. Now you don't have to do those parts anymore and just edit the rest yourself. It's less work than doing it all manually. You made a rant going on about nothing.

[@skylark.kraken]

DAIN will recognise when 2 frames are similar to tween but will also recognise when 2 frames are different enough it cannot calculate pixel movements and will not tween them. So inserting unrelated frames even if they include similar features will not be tweened, this causes a slight issue if you were to have a strobing light which switches every few frames, the frames in which are joined may not be tweened and it will appear to stutter as frames are duplicated to fill in the gap. DAIN has not been represented fairly by Eddy even though they sound impressed, because of the way they created their animations has too much movement between frames and not enough time in a single scene which allows for a better understanding of what is in the scene. In the section where Eddy mentioned that there were no artifacts, there were obvious artifacts which arise from a lack of training on Lego and also the large movements which arise due to recording at 15fps (Eddy doesn't have much choice, and 15FPS is fine - it's just that when using DAIN to turn it into 60FPS it looks bad). (also, I think 15FPS Lego stop motion is more impressive and charming than turning it into 60FPS because with 15FPS you can pause on every frame and that is exactly what has existed and physically photographed while with 60FPS everything is way too smooth and if you pause there's a 75% chance you aren't looking at anything which has existed but instead CGI)

[@jacekniedzielski9837]

1:40 "There are no odd affects" Floor: * moves *

[@noblebuild2550]

The second dude pulled a Okuyasu at 1:38 timestamp too

[@aan3513]

@@noblebuild2550 ZA HANDO GA KESU

[@benjiviews4300]

First guy's hand disappears - still really good though

[@microassaultrifle1280]

Lmao

[@AdanASR]

Middle guys head glitches

[@BenGroebe]

I see an artifact at 1:39, the head of the guy in the background gets jumbled with the head of the astronaut. You can also see some artifacts in the hands of the front astronaut just afterwards when he waves. Still very impressive.

[@cass7448]

Even with the artefacts, this is bloody black magic.

[@dns7095]

Alasdair Black I totally agree, I’m not living under a rock but they just made up 45 frames out of nothing. Man AI really is the future.

[@Last_Resort991]

Not really

[@Last_Resort991]

@@dns7095 Not out of nothing, they just matched 3 frames between two reference points, that is why it is called interpolation.

[@exxx247]

@@Last_Resort991 they didnt match it lol. they created a model on the fly that was depth aware and then rendered frames of it. this is extremely difficult and i love your dismissive attitude. it screams ignorance and low intelligence.

[@Last_Resort991]

@@exxx247 I'm an AI programmer myself. Already written a Chess engine and a neuronal network from scratch. You don't know what you are talking about, it really is not that hard.

[@thomasw5154]

When people start making a lego movie themselves instead of having a million dollar budget

[@calebkendrick5286]

people made ego movies way before the actual movie with the million dollar budget

[@amps.]

@The Homie obviously....

[@amps.]

@The Homie mad?

[@giovannijohnson1885]

Amped.R6 stfu i didnt know that lmao

[@Nockenz]

creamgod same XD I thought they just took like 50 hours of stop motion and started editing lol

[@zaylor4736]

Sad the movie didn’t get more views than this, it really deserves more.

[@guydino.]

1 mil

[@thejustlexa]

1 mil

[@fizan6129]

1 mil

[@codeyhutch]

1.7mil

[@MrReddragongamingHD]

At least this video blew up, and its based around his movie anyway so there's that too

[@RayMak]

As smooth as Avatar

[@LightningShiva1]

X to doubt

[@jimitSoni]

Ah! Here you are

[@rayanjunaid3368]

ok

[@gamerx-km6115]

Ur marketing ain't working

[@LightningShiva1]

@@gamerx-km6115 ikr

[@velhacega]

"There are no visible artifacts" Astronaut at 1:39: *warps*

[@jeltje50]

That was some hilarious timing.

[@speediskey3856]

1:40 floor: movrs

[@jorgosgustavus3183]

high ping

[@shygecko2811]

@@speediskey3856 im crying rewatching the part from 1:36 now because there were 2 errors as he was saying there were none

[@abandoned-mines-novascotia]

@@shygecko2811 *WRONG* THERE WERE NO ERRORS. Watch the regular speed clip he showed, just seconds before. Same "errors" in the original master shots. That is because his stop-motion animation wasn't "perfect" ... a) the strange 'warp' of the astronaut was due to a slightly imperfect jump cut from a *still camera* to a *panning camera move* Watch closely, and understand how what is happening to make that in stop-motion. It's tough to do, and he didn't get it absolutely perfect during animation... so what? Big deal. Still looks great. b) the "floor moving" was AGAIN, just a simple little flub during the stop-motion moves made to the scene. He likely bumped the floor piece during the frames. Again, so what? *BOTTOM LINE* it's not the interpolation AI that made those appear.

[@dduude87]

Ah, yes, my favorite territory: Google.

[@FloatingDogs]

LOL just noticed that too

[@ant1574]

Right next to amazon

[@heisernsu]

destroying small companies and cut g'ing your privacy, i love the place.

[@JonatasMonte]

Next to the People's Democratic Republic of Apple.

[@danikahicks2210]

"No artifacting." Watch the second to the right astronaut starting 1:38 . And then the guy he teleports forward while the background guy he occurs is thanos snapped out of existance. Still liked it.

[@GasparLewis]

Or just watch the front/far right astronaut's hand as it goes up to wave to the crowd. Extremely impressive all the same, just a bit funny with what's being said in the narration at the timestamp.

[@ClicStudio]

The reason of that artifact is because he had one picture where that specific character goes a bit backward instead of going the direction he was going and it probably looks weird even in 15 fps (weirder in 60 for sure)

[@lunarxs]

Also a few seconds later when the camera spans right the gray ground slides a little bit to the right as well

[@ClicStudio]

So basically if your animation isn’t perfect in 15 fps it won’t be perfect in 60

[@ano_nym]

And the a second later the lego man in the front's hand disappear. Still cool though.

[@RaccoonGlitch]

every cut looks horrible, but continuous shots are ALMOST perfect

[@TakaG]

Easy fix. Just do one cut at a time and edit them together afterwards.

[@TripleTSingt]

@@TakaG yeah, use the Algorithm on your raw footage and not on the finished edit.

[@nagybalint1474]

@@TakaG exactly

[@x-ray-oh3134]

"researchers from Shanghai, California, and Google" Ah yes, Google, my favorite geographic location

[@oddlang687]

I had no idea there was a Shanghai in California too! 😆

[@FunkyPhilMusic]

Daniel Najarro he said shangai, california and google, not that shangai is in california

[@SquareRoot_]

Yesno 。 Los Angles, California Shanghai, California I’ll let you figure it out

[@marianpe5773]

xd

[@TVIDS123]

This is such a stupid comment. What he said is correct...

[@YowLife]

It's free but it takes a lot of free space and time to get it to work.

[@Walter_Hartwell_White356]

Hi

[@acey1590]

Oh hey

[@alfathfajar6856]

Ok

[@vtrjnkhole1017]

Why hello there

[@ufkkcndr]

Lets just say you don't pay with money

[@viniciusmarchesin]

"There are no visible artifacts, I couldn't even tell the real frames from the interpolated ones". Proceeds to show a .25x video full of artifacts that you can't really miss.

[@jasonoshman1079]

Seriously. The middle of the 3 astronauts as he passes that person in the foreground. His entire body and face warp forward. Then when the front astronaut waves at the end, there are about 3-4 VERY VISIBLE artifacts as he raises his hand and turns it.

[@jesusgonzalez2375]

Are you talking about that frame where suddenly the front of the guys helmet is at the back of his head?

[@venci16]

@@jesusgonzalez2375 the middle astronaut just warps forward I. E. There were too little data there so he just faded out and in

[@spooki-2451]

the floor in the bottom right also shifts forward for about 4 frames ... DAIN is doing its best though .

[@jasonoshman1079]

I'm not knocking the software. It's an awesome tool for sure. Basically the same thing as Twixter, which has been around for a long time now (I remember using it at work in... 2014 I think?). But these scripts/programs are never perfect. You always have to go in during post and clean up the glitches it creates. But you can get some really nice results if the footage is done right and you can do the cleanup.

[@aaroncarsonart]

I think the key here is to interpolate the frames scene by scene, because the interpolation causes a weird warping to occur when it cuts to another scene.

[@KrexaProductions]

Totally agree with you there.

[@ptt619]

I noticed that too! when you look through frame by frame, its pretty interesting to see how it interprets two completely different images.

[@alexvoedi]

how to make an easy lego movie: take on picture at start, take one picture at end, let ai interpolate 2 hours between.

[@ember24k80]

Nice

[@Edgeperor]

Ember you’re not allowed to speak, you make fortnite content in 2020

[@ember24k80]

@@Edgeperor what is the problem? Its a game that i like, you have to respect other opinions

[@cthuwu2138]

@@Edgeperor Edgeperor you're not allowed to speak, you make fun of people for playing a game that they enjoy in 2020

[@LehMeowX3]

@@Edgeperor shut

[@Shadowdncer]

"X using AI": "X, but the trick is that we don't know how it works."

[@sebasfavaron]

In benign cases like increasing a movie's fps, do you care?

[@khanch.6807]

@@sebasfavaron No but put something like traffic control, policy making or making another AI in the place of X.... It becomes scary.

[@hamedown]

@@khanch.6807 it's just algorithms generating data based of off current data

[@khanch.6807]

@Damian Jablonski Not that kind of control. What i mean is fully automated like tesla with little to no diver interaction.

[@UberDragon]

"without visible artifacts" is a little bit of an over exaggeration, but the results are indeed quite impressive. Occasionally you can see body parts phase out of existence in one place to appear at a different position (most noticeably during slow motion at 1:39 with the middle astronaut with another example being the hand of the guy walking by at 2:12). Given though how much smoother it makes the entire animation I think this is a really small price to pay and there's a good chance the technology will still improve over time. What the algorithm doesn't seem to be good at is detect cuts, as it seems to try to smooth those more often than not.

[@abandoned-mines-novascotia]

*WRONG* THERE WERE NO ERRORS. Watch the regular speed clip he showed, just seconds before. Same "errors" in the original master shots. That is because his stop-motion animation wasn't "perfect" ... a) the strange 'warp' of the astronaut was due to a slightly imperfect jump cut from a *still camera* to a *panning camera move* Watch closely, and understand what is happening to make that in stop-motion. It's tough to do, and he didn't get it absolutely perfect during animation... so what? Big deal. Still looks great. b) the "floor moving" was AGAIN, just a simple little flub during the stop-motion moves made to the scene. He likely bumped the floor piece during the frames. Again, so what? *BOTTOM LINE* it's not the interpolation AI that made those appear.

[@UberDragon]

@@abandoned-mines-novascotia I sincerely can't tell whether you're serious or not. Peak satire if not, well done.

[@Warwipf]

@@UberDragon I don't get it. Why would it be satire when he's correct? Am I missing something? EDIT: Never mind, I was missing something. I thought the 1x speed footage before the slow-mo was the original footage, but it's not. The error indeed doesn't exist in the original footage and is caused by the neural network. Then again, there was quite a hefty jump in the original footage too, although no weird warping.

[@fromrjwithlove9819]

@@abandoned-mines-novascotia Dude, you teach art at the rec center, calm down.

[@jcdenton2819]

Well, "visible" is subjective, people saw an error because it was played at 1/4 speed, but at normal speed only the most keen eye would see it.

[@BlockGod_1832]

1:38 "There are no odd affects "guy: * morphs *

[@TheBypasser]

1:38 "a hard time telling them apart from the AI-generated ones" - a weird teleport happens :)

[@vapor-sings]

And the floor in front of the first astronaut shifts

[@LionKimbro]

I was about to report exactly the same, but thought it proper to do a search of the literature, to see if anybody else had already reported it...

[@SteleCat]

In both cases, it appears that the fault is in the original animation.

[@DeepFriedOreoOffline]

It looks really impressive in full speed. But when you slowed it down, at the beginning one of the astronauts heads interferes with a head in the background and it ends up fading in rather than sliding across. Also, near the end as one astronaut is waving his hand, the hand splits apart during one of the waves rather than seemlessly folding in the image as expected. I would assume though that both of those are just due to the original film being 15 frames, and some frames don't have enough information to create a predictable image. In full speed though, it's absolutely incredible.

[@Harlizarrd]

It's pretty funny that while replaying a few second of footage to look at a couple of oddities in the slowed down footage, I realised I was also hearing him say "no artifacts" repeatedly..

[@coderhd8554]

@@Harlizarrd he propably meant compared to traditional methods of frame interpolation.. these glitches are no big deal

[@jss1328]

That doesn't really matter. Like you said, in realtime, it looks just fine. And if you have slow-mo parts in your movie, then do it yourself or with other methods.

[@DeepFriedOreoOffline]

​@@jss1328 I never said it looks good in real time, I said it looks good at full speed, there is a difference. As for shooting a slow-mo scene, of course you would increase the original FPS of the footage, a typical slow-mo video captured with a smart phone is 240+ FPS, Galaxy S20 can film slow mo in 960 FPS. It doesn't matter how good the tool is, you aren't going to get that from a 15 FPS base video. I am not pointing out the issues because it's a problem, that is a weird assumption to make. I am pointing it out simply because it was said multiple times in the video that there are "no artifacts". That is not the case. However, I also specified that it's not a problem due to the artifacts most likely being caused by the original footage being 15 FPS. I guess what I am trying to say is, I never said it was a problem, and everything you said seems fairly obvious.

[@jss1328]

@@DeepFriedOreoOffline That's what I meant, full speed. But you could just been more clear by actually saying that he said "no artifiacts" and then pointing them out instead of pointing them out without explaining why because that makes it seem like you're ponting out problems.

[@HomersIlliad]

Someone should do this with the very first horse-galloping film.

[@PieFaceThrowsPie]

That's actually a super interesting idea

[@Vospi]

It was easy, there you go: kzbin.info/www/bejne/n2XalJKOgNmdo7M

[@Yezpahr]

@@Vospi I'm curious.... I just saw the vid you linked and I'm impressed by that. Do you reckon this was also easy for the AI, not just you? Imagine recording a shooter game at 15fps, then feeding that footage into the AI... would it genuinely make a convincing scene of it, or would we spot errors **everywhere**?? The reason I ask is because then gamers can record at 15fps, saving 75% on resources during gaming and later upscaling it to 60fps. I think it would definitely be spewing graphical artifacts everywhere depending on the details/image format, but it would be very interesting.

[@HomersIlliad]

@@Vospi This was cool, thanks for making it!

[@Vospi]

@@Yezpahr According to the video above, you should just test instead. 1) The horse video lacks depth, and there's even a setting for telling your NN that. Meanwhile, the gameplay video would definitely contain a lot of depth, particles etc. So they're not comparable. Naturally, DAIN was made for the depth-related kind of stuff, but I'm personally convinced it would be cool to try for a slomo foootage first and foremost, not for general purpose. 2) This app needs a good GPU. If your GPU is good enough to handle it, it would almost definitely be enough to capture 60fps footage. For example, I have 1650 SUPER, it's not anything superpowerful, but it's recent enough to record footage with its own hardware codec, meaning that I lose practically zero performance both in Geforce Experience and OBS. Moving forward, it would make even less sense for your scenario. This 640x480 15 seconds clip took a considerable amount of time, too. So yeah, better just get a ~$150 GPU instead of all the hassle.

[@ulischmidt03]

i feel you would need to edit it so it doesn’t do the warping effect when the camera changes

[@KrakenEyeGaming]

I think that the way around this could be processing each clip separately whenever it cuts. Of course that will take a looot more time. But probably less time than making a 60fps stop motion

[@VentA_7]

DragonEyeGaming Arce more time but less effort, imo a good trade off

[@dennisjungbauer4467]

I don't think it will take a lot more time to apply it to separate clips. The clips are either already separated and just cut together or he created the full clip directly out of all the images. Then he could just create separate clips before merging it all together and apply it on those, then just merge the interpolated clips together with the cuts at the end. It probably takes a bit more time, but not much, definitely way less than doing the stop-motion at 60fps, and definitely much less effort.

[@wave9142]

@@dennisjungbauer4467 Also, automatically detecting when there is a cut can't be that hard.

[@nagybalint1474]

@@wave9142 sureee do it mate

[@indifferenteyes]

KZbin Recommended this to me.. i wasn't disappointed This is so cool dude.

[@bruh-yo1vf]

Hey mighty!

[@Vicorcivius]

KZbin also forces c0mmunist style censorship on it's creators and users as well. Beyond disappointed. Their automatic algorithms that recommend their own parent corporations opensource software that will put thousands of people out of work just so a few hobbyist can save some time, does not impress me. (I am not so much concerned about that as the censorship)

[@D_YellowMadness]

*Isn't disappointed* *Still brings it up*

[@mikael1891]

sonuvabitch

[@LostieTrekieTechie]

It's impressive, but there are definitely artefacts.

[@KickstandOptional]

Like the teleporting astronaut at 1:35.

[@wyvern2066]

Yes but I guess the lower the framerate the higher the chance for artifacts.

[@LeoAr37]

@@KickstandOptional With that kind of teleport I'm guessing the stop motion wasn't done well in the first place. You can't cleanly interpolate between frames that aren't interpolable in the first place.

[@ProtoPropski]

True, although it's still way better then it ever has been, and it's only ever improving

[@troy5568]

Ofc, nothing is absolutely perfect in the first try. Even our first real image of a black hole wasn't really that satisfactory. But this is definitely a huge leap towards getting the desired results, and future developers can use this as a reference point on where to start, instead of having to start all over again from scratch.

[@renatoramos8834]

In the future, we'll get a whole movie out of a single frame.

[@Kubadaniels]

thats how baka mitai memes are made

[@moistbread1948]

I can say myself wow!😂🤩 kzbin.info/www/bejne/jIbIoHh5iLh7pKM

[@snorch6697]

Well, the AI will generate the movie instead.

[@Anikinoro]

Zero?!?

[@tobiderfisch9]

Filmmakers will just have to make the fist and the last frames (I guess they're just photos then) and an AI will come up with everything in the middle.

[@SilentBrix]

Honestly, the choppy movent of many of the self-made brickfilms is what keeps it authentic and fun to watch and makes the medium stand out for me.

[@awesomeferret]

And it's authentic because... Seriously, it will be way harder for you to defend that then you think. "Authentic" is way too subjective in cases like this. If realism is authentic, then 15fps certainly cannot count as "authentic". So, what's your definition of "authentic"?

[@SilentBrix]

What I mean with "authentic" in this scenario is an animation that feels rougher around the edges, with small imperfections that show the creator is just a human being as well. In my opinion, these less perfect animations can carry much more artistic weight than an animation that is buttery smooth with 60fps. I am not saying these can not be great video's too, just that I enjoy the, in my opinion, more "authentic" feel, of the more "imperfect" animations. That being said, this is, of course, all my opinion and as such, you do not have to agree with me.

[@miquelmarti6537]

We are more used to 15hz but 60 is so much cleaner. I think i would enjoy both equally.15 can look funnier and define some character but 60 is more immersive.

[@mr_elyte]

I would pass every scene thorugh the AI and then mix/edit the film.

[@lox07]

Good idea

[@fleflix8410]

Me too

[@moistbread1948]

No one thought this could happen 🤩😂 kzbin.info/www/bejne/jIbIoHh5iLh7pKM

[@mz00956]

That is just a link to a video from Moist Bread. Nothing special

[@CptLande]

@@mz00956 He's just spamming his video.

[@Artcaneon]

"Shanghai, California and Google" Ah yes... The three nations.

[@flameshana9]

Everything changed, when the Amazon nation attacked.

[@nicholaskoenig1089]

KZbin Juggernaut I once again am asking for you to endorse the establishment 🙏🏻

[@barulicksama3838]

I lol'd.

The axis powers

[@EchoBuildsThings]

Ironically at 1:40 when you say there are no artifacts the ground moves due to the interpolation. Idk if I’m the only one to see this but for it to happen at that moment is funny

[@fatildaiv8632]

Yeah, it's obvious in slowmotion.

[@anch95]

It's probably still a beta version, for that it's really good.

[@EchoBuildsThings]

@@anch95 oh yeah for sure I just liked the irony

[@PhantasmXYZ]

And just before that the AI confuses the middle astronaut for the guy in the background, making his face and body teleport when they get close enough

[@smoker_joe]

The 60 fps version is just astonishing and more "immersive" to watch. But the original version shows the incredible work done to animate characters frame by frame, which disappears with the improved version. So I can't make a choice. Both are nice in their kind.

[@shadowxxe]

The work is till being put in its just being enhanced its like practical effects vs CGI sometimes practical effects would be either too costly or too elaborate and difficult to build for a scene in this case animating in 60FPS is hard work because you are quadrupling the amount of frames you need to make so having a software that can do that for you is very7 helpful

[@Sluggadome_Rotunda_Bernardson]

@@shadowxxe true, but I’m more impressive doesn’t equal better in most cases. Time and care needs to be put into an animation and you need to put actual thought into the frames and characters. Just adding “smoothness” makes it worse because it doesn’t take actual human creativity into account. Think of stuff like studio trigger, those animations rely heavily on the unique properties of low frame rate animation and adding frames would make them look WAY worse.

[@AeroRain]

Amazing how it still retains those clunky Lego movements while also looking much smoother than the original 15 fps. From what I’ve seen interpolation usually makes it a blurry mess, but it does a great job here.

[@hax0r_jax]

Someone needs to tell Ben Wyatt about this now that he's done with "The Cones of Dunshire"

[@stan9912]

That is *Literally* the greatest idea

[@taylorbrown7426]

i did not expect to see parks and rec on here.... big respect for making me remember i gotta go watch the last season

[@Jerdan_]

He also came to my mind, with his eye rims and manic look while realizing how much work was left :D

[@pcmaster888]

Pretty impressive how far the technology is nowadays, but saying that there are no artifacts is just not right

[@KARKATELCESARENVIADODESA-pv4yd]

What are artifacts :(

[@RetrOchannel]

@@KARKATELCESARENVIADODESA-pv4yd Little side-effect graphical bugs.

[@CED99]

@@KARKATELCESARENVIADODESA-pv4yd watch at 1:38 second astronaut

[@SavageGreywolf]

@@CED99 I caught that too. The AI seems to have a hard time predicting the movement of the objects that are obscured. Watch the first astronaut's right arm as he passes by the crowd member with the Leia hair.

[@Tuxfanturnip]

Individual frames are not nearly as artifacted as with other methods, but it's still noticeable in motion if you look hard enough.There will always be imperfections when filling in data that just isn't there, but the effect is amazing overall.

[@DistortionUltra]

Wow. Thats actually stunning.. And I like both equally. The 15fps lego stop motion is iconic, but the butter smooth 60fps is marvelous. I'd have no problem viewing either.

[@lillatravius1106]

The 15 FPS is charming, sure, but it truly makes the characters “come to life” when they move in 60.

[@dantediiorio7547]

the only problem is on jump cuts it creates distracting artifacts if you use it you should use it before editing all together

[@RubenKelevra]

Yes, but you can just run a cutscene detection over the video and just interpolate each scene individually

[@masterchieftheconqueror2631]

You could also just recut it with another edit

[@RubenKelevra]

@@masterchieftheconqueror2631 this would alter the runtime and the audio sync will be lost. You need to stance out every scene, do the interpolation at a fixed rate and concat the scenes again, if the algorithm has no scene detection threshold.

[@masterchieftheconqueror2631]

@@RubenKelevra ok, cool (I will admit my description wasn't accurate but would cutting that transition with a frame from before look alright?)

[@RubenKelevra]

@@masterchieftheconqueror2631 It's quite a lot of work to do frame exact cutting, so not very efficient, while you can script cutting a video into scenes with nearly every editing tool. Additionally the frames have different 'length' afterwards, so your last frame becomes like 3 or 4 frames on the output. So you need to delete 3-4 frames and replace it with one frame copied 3-4 times. This would look like the motion freezes right before every cut for a split second.

[@loyaputon]

Can someone do this with "the burrito, the hamster and the alien" clip from icarly?

[@jamy306]

Wot?

[@benjaminsobotka6208]

omfg i know what youre trying to do and you need to stop

[@signbear999]

@@benjaminsobotka6208 WHAT ARE THEY TRYING TO DO

[@matthewsterling8873]

this is absolutely sick! the one thing that looked funky were the scene transitions. it's really fast so it's not super noticeable but it just has this slightly unnerving look to it that you can't really figure out why unless you slow it down all the way and see all the colors morphing to create the next scene like an alien movie projector

[@cruisername8423]

"There are no artifacts" **woman teleports**

[@TheViralInfekT]

The only thing i don't like with the 60fps version are the scene transitions. They now have this annoying morph effect. Other than that it is really interesting and looks good.

[@kouvolaartschoolfinland9332]

It can be fixed doe

[@Niko-rf9or]

@@kouvolaartschoolfinland9332 yeah just edit after youve interpolated all the footage

[@Crown-Fox]

This can easily be fixed by interpolating scenes before merging them.

[@z-beeblebrox]

Yeah but that ONLY exists because he took a completed, flattened project and ran it through. irl you would interpolate each shot individually and *then* edit the footage together.

[@doommaker4000]

@@Niko-rf9or Or apply interpolation to each scene and then put them all together

[@theodoreyd]

1:40 is that a glitch on the floor I'm seeing?

[@MacReflections]

Also at 1:40, the second astronaut's head morphs.

[@mirinbrah739]

Yeah but notice the software is still in alpha stage, version 0.23 . So I imagine it will get better.

[@Moraxno]

@@mirinbrah739 it's just a bit ironic since exactly then he explains that there are absolutely no artifacts and he could not tell the difference

[@erin3967]

MacReflections 1:39

[@bonk369]

@@Moraxno I suspect it will work even better if given video input with a higher fps than 15. For instance, imagine you were recording console gameplay at 30 fps and wanted to interpolate it to 60 fps.

[@nahbirdie4773]

This is so cool!!! But I do love the shorter fps look as well. Its nostalgic and it...just makes me happy.lol. I wouldnt want it this smooth but i can see how helpful this will be. Thanks for sharing.

[@Brainles5]

Incredibly impressive, but there are definately artifacts.

[@bobsmith93]

Man there are so many artifacts lol. It looked alright at normal speed at first, but after watching it slowed down I can't go back, I just see artifacts everywhere even at normal speed. Each frame just kind of weirdly morphs into the next one. It's probably easiest to notice on the guy on the middle's head during the first half of the slowed down footage

[@freakihaijiki]

@@bobsmith93false.

[@bobsmith93]

@@freakihaijiki same

[@JoshuaCrunk]

@@bobsmith93 Totally agree with you bob. Some of those artifacts are unforgivable, like the middle astronaut teleporting at about 1:39. I don't know why other people have such a hard time seeing stuff like this.

[@TheAuzman466]

but this is also extremely impressive for a free, open source AI frame interpolation software. and through more training it can improve massively.

[@CamKablam]

No artifacts, except for hands phasing out of reality, and this wierd lego brick that "slides" 1:40

[@Jimjimjimmyjimmyjimjim]

And the middle astronaut a moment before...

[@TheMrTape]

@@Jimjimjimmyjimmyjimjim Was just about to reply #1:39

[@dylantreacy1663]

There's also a part where the floor moves in the part were the astronauts are walking out

[@vedi0boy]

This is only noticeable at slowed speed though. Have you ever seen some of the Simpsons still frames to show actions, it’s very creepy and unrealistic, but looks good at full speed. But yes, the claim that there are no artifacts whatsoever is false.

[@toba9005]

Yeah but keep in mind, this software its TOTALLY FREE, and what it does is still very impressive

[@secabrepheox5450]

1:40 "There are no odd affects" Hand vanishes casually

[@DCyph3r.]

And floor moves

[@ULouOW]

its artifacts not odd affects

[@ahadgroup]

that is crazy - was not expecting that! Really smooth

[@therealdrgiles7207]

"There are no visible artifacts". Watch the lead dude's arms at 1:33.

[@Wisss]

watch the 2nd guy's head

[@RoyalA7mDo]

Well it's not even noticeable in normal speed

[@baldwinvp]

lol yeah, not sure how he missed that. Still, this is very impressive.

[@F40LM]

You are so cool for noticing that browie!

[@Softpaw1996]

@@RoyalA7mDo your eyes may not have noticed it... but your brain did.

[@b0nes95]

1:40 "I would have a hard time telling them apart." Bro, did you even look?

[@calvindreesman4951]

even still its an easy fix. It looks to be messed up due to the edited camera flash

[@DaddyT21]

You're telling me to make all the old Disney movies 60fps and sell them at the swap meet?!?

[@Walamonga1313]

Yes

[@fived9424]

hahaha

[@elvancor]

I beg you for all that is holy, do not make all the old Disney movies 60fps. It's heresy, it's repulsive and it needs to die.

[@flameshana9]

@@elvancor I hate interpolation more than the average Joe, but Disney movies at least contain enough information to work with. 24 fps to 30 or 48 is better than working with 8-12 like other animation.

[@elvancor]

@@flameshana9 Well yeah, it would yield spectacular results. I just don't wish to look at them.

[@deoxyl453]

Okay. I’m not gonna lie, at first, I was thinking “this is gonna be a waste of time isn’t it?” But this is actually really cool. It actually looks like they’re moving themselves. It doesn’t look like stop motion anymore, that’s so cool

[@Lumcoin]

the cuts between shots aren't perfect, but otherwise it is stunning

[@reversible8740]

That’s because it’s turning a 1 frame cut into a 4 frame transition and it morphs the photos. but that is easily fixable by deleting the 4 frames in something like premiere pro

[@isthatajojoreference]

"This is great, but this is so much more better."

[@Beos_Valrah]

lol.

[@aidancommenting]

1:38 astronaut in the middle has some weird animation glitch for a few frames

[@abandoned-mines-novascotia]

*WRONG* THERE WERE NO ERRORS. Watch the regular speed clip he showed, just seconds before. Same "errors" in the original master shots. That is because his stop-motion animation wasn't "perfect" ... a) the strange 'warp' of the astronaut was due to a slightly imperfect jump cut from a *still camera* to a *panning camera move* Watch closely, and understand what is happening to make that in stop-motion. It's tough to do, and he didn't get it absolutely perfect during animation... so what? Big deal. Still looks great. b) the "floor moving" was AGAIN, just a simple little flub during the stop-motion moves made to the scene. He likely bumped the floor piece during the frames. Again, so what? *BOTTOM LINE* it's not the interpolation AI that made those appear.

[@gian.4388]

@@abandoned-mines-novascotia The one he showed seconds before was already 60 fps dude

[@TorutheRedFox]

@@abandoned-mines-novascotia well partially it is, but when you have more frames to work with, and you do each shot individually, it comes out nearly flawless

[@SMAAAASHTV]

@@abandoned-mines-novascotia you're so sure of yourself. Check out the original 15fps version kzbin.info/www/bejne/eH-ml3lmnc-agZY where there is no visible warping glitch.

[@samsibbens8164]

The biggest difference is it reduces the impact of hight speed movement. For example to simulate extreme speed you might use just 2 or 3 frames to do a movement. However with interpolation it seems that ease-in and ease-out are added everywhere regardless of whether there should be a gradual acceleration/deceleration or not. This is an issue in video games as well. Old fighting games had much better animation even though they had worse graphics. Modern animations are much smoother but have much less of a punch.

[@MatthewBeats-t7k]

Premeire pro has effects that could definitely help with that

[@Sluggadome_Rotunda_Bernardson]

@@MatthewBeats-t7k or you could just…appreciate the original animations and not have to bump everything up to 60fps just for the sake of it.

[@Winasaurus]

Definite artifacting. Especially rough on scene cuts or large movements like arm swings. The arm swing artifacts are barely noticable, and look far more like smear frames than anything uncomfortable to look at. The scene cut artifacting is a bit nasty though. Feels like the screen is being blurred and shook on every cut. Easily fixable by either interpolating scenes independently and stitching them together, or simply trimming the cut after interpolation to remove the 'smear' frames. Could lose some content on something with quick cuts by cutting out that much though, easily fixed by either having a longer time between cuts, or biting the bullet and manually making 60 frames/sec for sections of constant cuts to prevent it entirely, which isn't so bad considering the majority is getting interpolated so it's not like you had to do tons of work for the whole thing. In short, great, not quite perfect, but possible to work around.

[@Zwodo]

I think the scene cut can definitely be worked around by either 1) adding - unless it exists - a parameter that defines the amount of similarity two frames must have in order for interpolation to be effective or 2) feeding every single scene into the AI separately, thus avoiding any work the AI could perform on jump cuts. I thought about 3) removal of excess frames to be another option but I believe the software also alters the existing frames which would mean that the frames right before and after a jump cut likely would already have a slight fade in/out applied.

[@TheDorionChannel]

"Literally blows my mind" *Head blows up and dies*

[@TheGiantRobot]

Haha, I often wonder what people think literally actually means.

[@OMA2k]

@@TheGiantRobot Well, take a look at this: www.merriam-webster.com/words-at-play/misuse-of-literally 😉

[@RockAnimations]

Yeah it's impressive, but to say that there's no artifacts is 100% misleading.

[@superliro100]

1:39 for example

[@alfred_philip]

@@superliro100 it literally happens while he's saying there are no artifacts 😂

[@elibenaron]

Not 100% misleading, just 95% accurate. Very few artifacts compared to earlier. But yes, not an entirely true statement.

[@mchammer5026]

@@elibenaron That's a bit like saying "This medicine has no side effects" when really it kills 5% of people who take it is is 95% accurate and not 100% misleading.

[@RockAnimations]

@@elibenaron That's not how it works

[@lukedemarco182]

This is the coolest youtube video I've seen in a year.

[@RyluRocky]

I personally enjoy the "choppy" look to stop-motion animation, it's part of the charm.

[@mike18699-e]

Agreed. The technology is impressive, but it's questionable whether it actually makes this more enjoyable to watch - and that surely is the litmus test.

[@Thornskade]

Are you sure it's not just nostalgia? Sometimes I feel people would use that word interchangably, except "charm" sounds less negative. To be clear. I like the look of stop motion, stop motion is an awesome genre - but what I always liked about it is how it produces real imagery, yet often with things like puppets, clay or LEGO. That's the look I like about it. The choppiness? Heavens no. I accept it because of how hard it is to make these movies and how unreasonably long one would take to produce if you increased the framerate, but if I'm honest, I would very much prefer to see these types of films in much higher framerates, if that were possible. Choppiness was never something I enjoyed in and of itself, in fact it's probably quite the opposite, I find it rather straining on the eyes.

[@RyluRocky]

@@Thornskade No, at least not to me personally, I have no nostalgia for stop-motion animation. Also I wouldn't say the word "nostalgia" inherently has any negative connotations surrounding it.

[@Thornskade]

@@RyluRocky Inherently, probably not. But in this context I would say so; if technology advances so that without much extra effort we can have higher and higher framerates in movies and even in stop-motion animation, but both audiences and directors reject it with an appeal to tradition or nostalgia, to me that would be a rather negative thing.

[@RealMonies-eu1in]

If anyone is planning on using this (you'll probably notice this anyway, but might as well point it out), run this program for every single shot before editing rather than after editing. If you notice, the cuts in the interpolated version are a little weird because it's trying to turn a hard cut into a cross dissolve.

[@drdesten]

Now let me play it back at 1/4 speed, so you can see there are no artifacts. **Literally has artifacts in every interpolated frame**

[@VinnyFonseca]

Many people here are talking about the transitions, and possible fixes such as interpolating each cut and then stitching them together again. As DAIN is still around version 0.4, we can assume the researchers have a lot in store until v1, and probably have a transition fix, something like comparing 2 images for similarities and only applying interpolation if it's under a certain threshold, while taking into account fast action and flashing lights. Early days, people. This is incredible, proper black magic, and revolutionary for creators everywhere. Can you imagine a future where this tech is available in video editing software out of the box? Amazing.

[@ordinarybear7414]

I'm not intersted in stop motion. I'm not intersted in AI, but I sure loved this video, astonishing

[@unknownvariable2456]

1:42 ah yes there’s nothing wrong with this part, his hand simply briefly entered a wormhole which was meant to be in the video.

[@An7ero]

Almost nobody notices those in real-time. Worth the effort to make it 60fps.

[@unknownvariable2456]

An7ero i noticed it in real time and saw it again in the slow mo. honestly if i didn’t notice something like that in real time i would fear that i was having a stroke when i noticed it in slow mo. probably has something to do with resolution though when your watching it. and if i didn’t notice it in slow mo... well i hope i would’ve left behind a will by then asking them to unplug me rather than keeping the machines running and billing my family.

[@An7ero]

@@unknownvariable2456 Yeah. Watching it on mobile in 480p. But great to know you've got little to no positive to say about the subject!

[@unknownvariable2456]

@@An7ero that's the spirit!

[@Easterhands]

I feel like a great workflow for this would be interpolate to 60 and then use that temporal information to create really effective motion blur to use at 30 or 24 FPS

[@jdraiby]

smart

[@jeff9228]

It does take some of the magic away knowing that everything was moved by the artists hand in the 15fps and that it's just not the case in the 60fps, but the results are STUNNING! I'd still have to vote for the real thing, and not the way over-the-top awesome 60fps, even with all of it's visual glory, for that reason. Hand drawn cartoons are unique when all the frames are drawn and painted by hand and not computer drawn/sequenced. This is still utterly amazing!

[@Tigrou7777]

It would be interesting to see what is the result with Claymation movies (like Wallace & Gromit)

[@RubenKelevra]

It does extremely well, take a look: kzbin.info/www/bejne/f3yQgmZ7mLmhiqM

[@BierBart12]

I would be more interested in seeing some very low framerate animations like old Garry's Mod animations.

[@toothlessblue]

That is legitimately incredible, software like this could be worth billions, but they've given it out for free.

[@logixindie]

AI can help us so much that it will take over our jobs at some point

[@bromibromi]

No, it could not. Simply because people having billions have had this kind of software for quite a lot of time.

[@TheRogue12]

The interpolated version looks just slightly greener than the original.

[@ijustdontcareleavemealone.3172]

@Robert Dorbandt Compare the minifigures head

[@rohanr5150]

Should be fixable with a simple color edit!

[@TheUltimizer.]

I've Recently started with Stop Motion and now I think this'll be worth it

[@sablesanctum]

I prefer traditional stop-motion, but this is certainly nice tech for certain applications.

[@frost3533]

What does "traditional" stop motion have over this? It's literally the same as "traditional" except you're putting it through a post-production process. Any professional stop motion production will do this, so I don't know what you mean implying this isn't "traditional".

[@Pedro_eqw]

@@frost3533 Traditional as in 15 fps instead of 60

[@sablesanctum]

@@frost3533 I'm sorry I worded myself unclear. I prefer the visual look stop-motion animation has with its relatively low frame rate without going through this kind of post processing. However it would be interesting to see how it would "improve" scenes like those in the original Terminator and the like.

[@TwentyPercentDash]

The guy's head mutates at 1:38, and at 1:40 you can see the ground shifting on the bottom-right. I noticed it the first time it was played; I'm only providing slow-motion timecode to better explain the issue. While this technology is really cool, it still needs some work. I suppose you could apply to a shot, then do some mild touch-up in After Effects to fix the glitches. And of course, there's weird frames when it cuts; I'm assuming you only applied it to the final edit as a quick preview- if you were doing this as a final version, you would need to apply the effect on a shot-by-shot basis.

[@LegoEddy]

What do you think about the results? Are you as baffled as me by just how good this looks? :) Was haltet ihr von dem Ergebnis? Seid ihr genau so erstaunt wie ich davon, wie gut das Endergebnis aussieht? :)

[@pokefan-lp9fs]

Ja

[@Will-kt5jk]

There is weird artefact where the floor slides forward with the character at 1:41 (unless that was in the original) But it does a great job overall.

[@LegoEddy]

@@Will-kt5jk Oh, you're right about that one! Guess that was because of the camera movement

[@TheWindows72306]

I immediately go to the website and downloaded the app after I watch your video. The movie you made is simply magnificent and awesome when paired with the interpolation. But my frame extraction takes a very long time, 112 frames out of 6200 frames for 12 hours! The video is just a 480p video with small size of 40mb. Can you teach me how to render fast? I have a i7-6700, 16gb, and GTX 1060 3gb Nvidia gpu. I have searched countless days, make countless settings, and even reducing to 120px in video resize and yet no speed change at all, only up to 3 frames per hour boost.

[@LegoEddy]

@@TheWindows72306 phew, for me it worked out of the box. Are you sure your Graphics card drivers are updated? Check that your CUDA is working. Interpolating the whole 7 minutes Video in 480p took 12 hours for me in a similar setup, as reference

[@summerngeorge]

dude when you put it side by side, i was actually blown the hell away

[@actualhyena]

Yea, the only problem is the cuts needing cleaning up. But that's only if you're converting your films. Otherwise it's fine. Thanks for sharing.

[@b3at2]

I like the charm of 30fps when it comes to stop motion.

[@HunterSchramm]

charm comes from animating on twos (12 fps)

[@brandonlee8123]

Idk if anyone would understand, but i totally expected to hear “sethbling here” after the “welcome back”

[@CaptainMonkeyFez]

And if we hop into gamemode 3 we can see that the LEGO actors are moving via invisible armorstands

[@EYEmaginary]

That’s amazing. Looks incredible. Even unbelievable

[@451asians]

Them: *Uses advanced AI technology to create new frames* Me: *Puts video to 2x speed*

[@aerospherology2001]

As long as you put scenes in as separate clips, it looks incredible.

[@nerdiloo9863]

If it can smooth Ray Harry Hausen's movies, "Valley of the Gwangi", any Sinbad movie from the 50s, 60s, 70s, "Clash of the Titans" or "Equinox" , then I'd be impressed. But yeah that's very cool.

[@TYSLYS]

yep I went straight to Hausen to on seeing this

[@elliot3751]

That’s pretty cool! I love both versions! 15 FPS gives it more of a natural feeling and I find I can appreciate it more cause I know people sent time on it! 60 FPS is more eye catching and I like seeing the smoothness but it makes it seem like a computer generated film.

[@robertdevito5001]

Damn, I thought they already had this stuff, I’ve thought this was a thing for years.

[@xyoxus]

Interpolation has been a thing for very long, but this is AI supported and should result in way better interpolation for when the source material has depth, e.g. blurred background because of the focus of the camera.

[@bobbob-pf4jd]

I made some stop motions a while back, ima see what they look like with this!

[@ff-qf1th]

i bet that weird transition could easily be remedied by processing each scene independently.

[@marcinkaliszewski2326]

Wow. This is really something. Respect for researchers for sharing.