Myst 3: Exile 4k 60fps upscale test (DAIN → waifu2x)

This is a test of using some off-the-shelf tools to upscale a cutscene from Exile into 4k 60fps. DAIN was used to bring the video from 15fps to 60fps, and then waifu2x-caffe's CUnet model was used to upscale and de-noise the frames.
Results would be better if either of these models were trained on Exile specifically.

[@MisterEPCOT]

This was the BEST part of Exile

[@mage9564]

Thats so freaking amazing! I would love to see this done with like Riven's minecart ride / skytrain rides!

[@Croz89]

This makes me want a remake of Exile in Unreal even more. Maybe after Starry Expanse is finished.

[@Antphoneigh]

Holy crap, we now need the entire Myst 3 to be upscaled like this!

[@Delcolux]

DAIN is making this one much easier to watch that the 15fps version.

[@silentdebugger]

"now I know how my hamster feels" - Boston Low

[@micahbush5397]

I like being able to see Amateria more clearly, although I think the original version fits the game better; the lower resolution and frame rate sells the idea that you're moving too fast to properly absorb everything that's going on.

[@willbill808]

Woah the marble ride! Amazing work!

[@kiwec]

waifu2x is trained on anime, so it doesn't work well on realistic video (anime4k is a more modern upscaler). Any "classic" upscaling method, like lanczos, would look better. I'm sure there are models for realistic video upscaling out there.

[@katzenwerfer]

for real life/3D video upscaling VEAI comes on top quality and speed are both good

[@gregkrazanski]

i think 30 fps would probably look significantly better. The amount of motion blur is way too high for something filmed at 60 fps

[@kalkstein2694]

too many artifacts during the ride and 60fps really takes away from it, 24fps is the cinematic ratio and the higher it goes the more clunky it gets rather than being epic

[@longWriter]

What a payoff for all those puzzles!

[@gharren]

What was the original resolution of the frames? This must have taken ages (no pun intended) to render.

[@Gaxhar]

Original video is 640x360, 15fps. Took about 3 days for DAIN and I think 12 hours for waifu2x? I don't remember the exact numbers.

[@Gaxhar]

And that's with a 1660ti.

[@NuclearCraftMod]

Could I ask how long this took and on what sort of hardware?

[@Gaxhar]

if I remember correctly, DAIN took about three days and waifu2x-caffe another 12 hours on a 1660 ti

[@NuclearCraftMod]

@@Gaxhar Thanks, and great vid!

[@NuclearCraftMod]

@@Gaxhar I've been testing DAIN against RIFE with some of Exile's cutscenes. I'm finding that RIFE is incredibly fast compared to DAIN, but does struggle with some of the fast-moving sequences, such as the corners at 0:30 and 0:39, which DAIN seems to have far less trouble with.

[@朝隈瞳]

これ、半分目が回った(;^_^A