Can Nvidia's VSR Enhance Low quality videos?

[@notravstar]

I hope your next upscaling video is an hour long and the most complicated yet. I enjoy them so much thanks for doing what you do!

[@lreismann9180]

Same

[@Z0MBUSTER]

Why stop there? 4 HOURS LET'S GOOOOOOOOOOOOOOO !!!!!

[@WangleLine]

Same!!

[@ChaseMMD]

I've upscaled a couple hundred hours of animation using ESRGAN and found nowhere to put it. Quality is excellent.

[@EmptyMag]

I'd love to see a 3 hour video from him on the subject, I'd easily set a day aside for it.

[@WaffleCake]

I'd love to see 2kliksphilip cover Lossless Scaling. I've been enjoying scaling everything using the LS1 upscaler. Supposedly it's based on machine-learning but it mostly manifests as a more accurate looking representation of the original native image-as if it does such an effective job scaling, the need for native resolution almost becomes nonexistent.

[@stargazer162]

Okay I had no idea Lossless Scaling had progressed so much since I last touched it. The last time I tried it, it only had FSR, NIS and integer scaling, but now it has tons of other modes. Magpie is a good alternative too, used to be much better than Lossless Scaling because it had many other shaders to choose from while Lossless Scaling only had FSR, integer and NIS, but now Lossless Scaling has pretty much caught up in terms of features, and it's interesting that they made their own upscaling algorithm that seems to perform as well as FSR and have a better quality.

[@eee1200]

I hear about people complaining about the input lag is it good or bad?

[@A.Froster]

Where do you use it ? I have tried it once in game and it destroyed my performance so I haven't tried ever since.

[@stargazer162]

@@A.Froster You can use it on KZbin if you're a little creative and find a way to open the video on a separate window that you can upscale. I use the Enhancer for KZbin extension and set up both the pop-up player size and resolution to the size I want to upscale from.

[@Maxcism]

Ok

[@vekst]

I recently got a 3060 so it's nice to finally be able to actually use the things that you talk about

[@eee1200]

I recently got a rtx 2070 too bad I can't use it until I Wait patiently for a update

[@eldafint]

@@eee1200 it wont come

[@danielsgrunge]

@@eldafint nvidia literally said it will lol

[@coin777]

3060 can only upscale on lvl1

[@randombrowser6692]

@@coin777 i can access all 4 levels on ny pc

[@PlGGS]

This is honestly more impressive to me than many other upscalers that I've seen bc of it striking that balance as you mentioned. I honestly think that's the optimal way those pixelated stairs should be handled when there's a similarly colored flat wall right next to them, so I'm actually glad it didn't try to "make more stairs" and end up getting it wrong

[@argonaut5617]

actually there was no stairs at all in some of blocks, so yes.

[@thezirnis]

Honestly, if you showed me the two videos separately I would not be able to tell which one is enhanced with 100% certainty.

[@UnrebornMortuus]

i dont know how to tell if its actually on

[@vffa]

Same. Watching at 4K with premium on a 3440p OLED HDR1000 Display. There is almost no difference at all, or the small difference gets lost thanks to compression. I've seen bigger improvements by just upping contrast or using simple reshade presets

[@aqwandrew6330]

you could actually see it cleary if you use it yourself

[@thedudely1]

I feel like your stairs example at 5:53 was actually the most impressive one. It almost does seem like it's adding stairs where they should be!

[@itchylol742]

Can we get a video about video compression? I want to hear you talk about video codecs, hardware vs software encoding, etc. Doing something like reducing a video file size by 80% while only reducing its quality by 20% is possible with today's video compression and the AV1 codec (free and open source), theres lots of poorly compressed videos sitting on peoples hard drive that could benefit from this.

[@zoinksboy3786]

THISSSS

[@ChaseMMD]

AV1 Preset 6 to 8 for max compression with CRF set. At least in my testing.

[@HaliOnRepeat]

Compressing my Videos on kliksphilip

[@julikaiba]

didnt he do something like that already when talking about his archiving process?

[@Sopel997]

Poorly compressed videos benefit the most from not being touched again. Though I agree that some informative video on this would be great, I see plenty of people completely clueless about digital video, sometimes even in areas that you would expect them to know at least something useful. For example most Handbrake users have no idea what they are doing and it pains me.

[@darkpheonix69008]

I would love a comparison to real time upscaling decoders like madVR using the best al'gos like jinc and all the other bells and whistles that have been available for years

[@veryconcernedjesus2584]

This channel went from CS:GO to tech tutorials and analysis overnight

[@adam_roman]

This works great for this case, but I'm really curious how it would look on something like a low bitrate video of an NES or SNES game. Would it be able to recognize it's a pixelated source and do its best to preserve that, or mistake parts of the pixelation with artifacts as just artifacts that need to be smoothed?

[@Radix_dev]

I can't wait to use VSR to enhance 2kiliksphilps beard

[@adrian23422]

Please make a follow up on this where you do the things you said would make a too long video. I fee like the four different presets make no difference. They even draw the same amount of power

[@thegenericnerd6832]

Keep making the videos you want and make them as long as you want, your love for the craft shows through to your videos. I love to hear someone talk about something they love

[@TheWildcat_YT]

Your upscaling videos are my favorite so I wouldn't mind a longer one.

[@gin0v4]

Hi Philip, what easy to use Video Upscaling Program would you recommend for an RTX 2080Ti + 9900k? I want to Upscale Videos from an older Actioncam, the Video is a simple top-down tech tutorial and I want to sharpen the Image before I upload it. Can you recommend anything or would you be down about doing a "how to upscale" `Video? Already tried Video2x, but the first pass with the RealSR driver takes 20+ hours already and is only 30% done - I set the Scale Ratio to 4,00. The final, edited Video is about 2GB big, 17min long and 1080p. RAW clips from the ActionCam are about 7hours, 60GB. I do not even need it to be 4k, just want a sharper Image.

[@stargazer162]

It's hard to use buy Selur's Hybrid is great for upscaling videos without it taking forever like if you use AI upscaling. And if you don't want to upscale and just want a sharper image, you could try with a sharpening filter like CAS.

[@LLPTV]

Topaz is pretty good. I hope you aren't trying to upscale the whole 7 hours?

[@imadecoy.]

I found it applied some kind of smoothing that deleted detail from lower resolution textures (source engine road textures on a 1080p video became solid grey) and in another example to human skin (A 1080p Q&A style video where it heavily smoothed the skin of the subjects, approaching what happens when you go too far with Topaz). Maybe because I was trying the level 4 setting.

[@landoishisname]

I'm excited to see how it makes blocky low bitrate twitch/youtube streams look

[@CountFisco]

Im interested if they can translate the DLSS 3 "frame generation" into VSR. 30fps youtube videos at 60fps would be brilliant

[@coin777]

i would be more happy if they translated twich streams from 60 to 120

[@plume...]

Some of the background music made this feel like a "Look Around You" video, and I love you for this Philip.

[@praralexander7561]

3:30 I noticed the same color change thing in the past using de-jpeg filters, where even on a completely greyscale image, it will add a slight amount of color.

[@gemstone7818]

i hope to see longer videos from 2kliksphilip about upscaling

[@rpgPalette]

What I have observed, with the new update: my desktop GPU usage has risen from 12-16Watt to 40Watt (from 25 celsius to 36 celsius) without any app enabled. I use 3060ti.

[@vmafarah9473]

It's just 2.5X power usage, nothing to worry.

[@lordcola-3324]

Dear Phillip, I just want you to know that I have zero interest in upscaling. But I greatly enjoy watching videos about topics that you are pasionate about. So please continue!

[@ShadonicX7543]

this video is really cool and this tech needs more of a spotlight as, like you said, it propels the tech from "enthusiast-only" to the general masses. I'm really looking forward to part 2 (and 3 and 4 hopefully!)

[@Die-Coughman]

I love this feature. Makes 1080p bitrate, especially from small content creators more bareable. I just wish it worked on interlaced content. A realtime AI deinterlacer+upscaler would be an absolute game changer for watching interlaced dvd/bluray content.

[@zekion.]

I love your videos no matter how long or complex they become 😂

[@brotifypacha7275]

I wonder why does VSR turns cyan colored “Off” text into green “On” and moves it to the right🤔

[@DrZhark]

Hearing morrowind music made me so nostalgic. I had a drink or two and I'm really missing my childhood. Thank you Philip for this video. I don't think I'll remember anything from this video, but right now you made me feel really comfortable and happy with myself.

[@fffrrraannkk]

I have a 20 series card and "Deinterlacing" is available in the nvidia control panel in the same section where VSR shows up for everyone else. Is that new? I don't remember seeing that before.

[@T2NWasTaken]

i'm using 4x upscale and i can't really see difference unless i look at it side-by-side with magnifying glass :/ Edit: Besides, it uses like 80% gpu usage with rtx3070, so there is gonna be fan noise while watching videos... Are we moving backwards? Besides, if you have multimonitor setup and want to watch something in the background while playing ex twitch, it's a no no.

[@AaaaAaaa-zp6ki]

Hi, you mentioned that you know this can be used in video players. I’m looking for a way to use VLC with real time upscaling and I was not succesful till now. Where do you think I could find help or another player that can do it? Thank you

[@emit...]

There's a fork of MPC-HC that uses VRS.

[@AaaaAaaa-zp6ki]

@@emit... Thank you very much! I’ll try that. :)

[@H3LLGHA5T]

@@emit... Any way to use it with SVP 4?

[@shimigami92dk]

@@emit... link?

[@emit...]

@@shimigami92dk Google it, links are flagged as spam on KZbin.

[@kennytvn]

Even just for fixing blurry or unreadable text this looks pretty amazing

[@ruijikisu]

this is really nice and i think it does the right thing since its a general driver setting you dont wanna have to toggle it a lot so its conservative, but that means it never looks worse, so you have no reason to ever disable it but a thought: i was watching this with the feature on what happens if you keep running a video through it over and over?

[@scenenuf]

Watching this in 480p, very interesting indeed.

[@oliver-nation4377]

Pls test with the same picture that Nvidia showed it with, and make sure the picture got the same bit rate.

[@Deliveredmean42]

It does makes you wish Nvidia enhance their Nvidia Control panel that doesnt look straight out of windows XP

[@mspoints4fre123]

You're right that using data from before and after a scene done right would be the holy grail. But methinks it takes too much processing power right now and that's why it hasn't been implemented. Not the fact that it's too hard to code or something.

[@ShinobuX99]

As someone who does consume a great deal of 1080p Japanese Cartoons on a 4K TV, I'm excited to myself evaluate the efficacy of this tech in this use case. In my initial impression as of now, I am not overwhelmingly impressed even though I do appreciate that a significant difference is achieved. For the past year or so I have been using a different upscaling solution for Anime, which is a set of GLSL shaders running in MPV (a project called Anime4K), and the result achieved by the HQ preset of this tool is a good step above what VSR can provide, in my opinion. VSR does provide an image that I'd argue is more authentic to the original look, which I am sure would be appreciated by some people. Anime4K creates a more noticeably artifical sharpness that I know many viewers find too clean, but personally this is kind of exactly the thing I'm looking for. I'll likely be sticking to Anime4K for my typical viewing, but I'm glad to have another tool to play around with.

[@David_Crayford]

I'm from the future and with my old 6090 TI with 512 GB video memory, VSR 3.11 for Neural Networks really is a game changer. You are right about technology not being *magic* but when I show someone from 1984 what we had in 2028, they are impressed, but wonder how our synth pop music became so terrible.

[@KalkuehlGaming]

I am a little bit shocked to learn philips last name through this video. It bursts my bubble that it might be Trump or Merkel or anything else that needs to be hidden. Happy while thinking I am the first one to notice, I googled his name and learned that he openly posted it 8 years ago on reddit. I was wet but now I am dry. No need for a dryer anymore.

[@KoseChris]

i have been testing since it came out, and it works ok so far, your are on point :)

[@hellterminator]

I appreciate that you don't wanna do a long video about VSR on real life footage, but I do want to see it.

[@Querxes]

Thank you klik, very cool

[@LilGnomeGames]

Good thing this video was short, that gives you more time to work on your Half Life RTX video!

[@ThisIsNotWhatItLooksLik]

Have an addiction that brings joy to others... Also Moomin where a surprise.

[@6Twisted]

That's pretty sweet. It's subtle but definitely sharpens up the image and removes banding. Shame it's only available on RTX cards AT THE MOMENT (waiting for nvidia to do their usual and enable it for older cards once AMD does it better). Please do a test on GoPro footage. Being able to record at 1080p and upscale to 4k would save a ton of battery life and file size. I don't know if it has the option to smooth the frame rate as well but that would be another way to save even more battery life.

[@foshe]

I am slowly starting to learn that nvidia isn't all about gaming, but also kinda everything else. For general use, they've made this featur. For renders, they've just been super efficient at that, always beating amd in that field. It's pretty impressive how much they have been able to do in the past few years, can't wait to see what they do next!

[@noizeuk]

Imagine watching Peep Show with this, you know, that super rare upscaled klikedition

[@LalaithMeren]

Watching this video with VSR on may make this more complicated! I checked out VSR on some videos and I definitely noticed the same sorta "dithering" artifacts and in one case it made the video look awful (The video was Katie Melua's music video "Love is a Silent Thief"). If we're throwing "filters" on videos now, I'd love to see some color debanding too

[@KalkuehlGaming]

05:15 You can say it actually takes AWAY extra detail (the blocks ARE details to our eyes) while it creates more REAL details which looks smoother, relevant and true.

[@ephgee1554]

bro you know what he meant dumbass

[@JynxedKoma]

The use of Skyrim's theme was a Chef's kiss.

[@NIkolla13]

That bgm makes me feel emotional about an upscaler

[@indestructiblemadness8531]

Ill be honest, for me this is a thing of: If I look for it I find the improvements. If I just watch normally its all the same to me.

[@AponTechy]

2000 series owners left in dust

[@tristanwegner]

DlSS still has to be implemented by the game, but the existence of VSR implies that it should be possible to scale up any game(it works with any game footage evidently). The only reason against I can imagine is latency. But I am impressed and surprised, that VSR handles snow so well. DLSS3 struggled massively with rain in Hitman, although it is interpolating whole frames. Also the gradient removable is a joy to see. It still bothers me in even Netflix shows in dark scenes.

[@cnr_0778]

impressive stuff! i wish it wasn't limited to 30 series and newer though... i there any technical explanation for this or is it just another one of nVidia's many money grabs?

[@jakobmod9881]

Only rtx cards have tensor cores, and rtx2000-will might get support later, sems reasonable to me

[@cnr_0778]

@@jakobmod9881 i knew it was because of the tensor cores but i wasn't sure why they wouldn't support the 20 series from day one. That's what most people have after all, right?

[@KalkuehlGaming]

Can you combine this with the opera GX browsers RGX? Rgx did wonders on the old family guy youtube videos. It literally looked HD. But if the video is so old that the colors morph, like in your moomin video, it doesnt work anymore. So maybe upscaling AND rgx would be even better.

[@SKHYJINX]

RTX 2000 series trick for AI Enhance. Activate DLDSR 2.25X (Filtering 50: = +0-) less filter = sharper & more filtering =smoother. Set DESKTOP to DLDSR 2.25X RES, use Windows display scaling to suit preferences. (100-200%) somewhere.. Play Movies and change the filtering slider of DLDSR. It gets treated to some enhancement. Not App specific, its activated on everything.

[@ezBeanie]

Who has an RTX 3 or 4 series with slow internet only capable of 360p Videos 😂 but nice video!

[@Shadow1412a]

I might have overheard it, but a significant issue with this approach, for all its here highlighted upsides is the massive wattage required for this to take place. I read about the big cards spooling up to full power draw.

[@petyavodolaz]

I noticed that It's works pretty good with text. Videos like programming tutorials are so much clearer.

[@woodywillchange]

we need an hour long of "philip dyer proudly presents *something*" appearing out of different places and in different fonts and on different backgrounds.....

[@Quast]

More than double the power consumption just to view a video - now a killer feature.....

[@seto007]

I'll be honest, and maybe this is just me and the device I'm viewing this on, but the differences in most of these shots really aren't that noticeable at 1080p unless you're REALLY looking for them. I think the best use for this upscaler is going to be computer tutorial videos. Even in a lot of 1080p videos I find that the elements you're meant to be focusing on just seem too small and low detail, and it seems like this upscaler performs the best with these sorts of elements and circumstances.

[@AntiGrieferGames]

Dude, 1080p doenst work. I cant see difference.

[@CountFisco]

I was wondering why I couldn't see the effects in the on/off comparisons... just to remember I still had VSR on in my own browser ffs

[@STANNco]

looks like it's improving stuff by 5% but well if we get to a point where we need 5% extra, this will be the go-to

[@masterwillems]

This looks like the same technology that my Nvidia Shield uses to upscale the image to my TV (4k 46"). Two years ago it was a bit of rubbish, yes it made the image look sharper but there was allot of highlights that where pulled into the extreme and there was a nasty smear when the image moved to fast. Nowadays this has improved massively and I could not live without it. The difference with it on and off is night and day and with off I would think that I would need glasses because the image is so blurry. Funny that you mention that you think this technology works best on low resolution content to make it look more clear. The biggest improvement for me (mind you, watching the content on a TV screen and not a smaller computer screen) is when 720P or 1080P content is upscaled to roughly 4K. Yes the old family video's that my dad digitalized into 480P look better however it is still blurry as expected. While the sharpness and clarity of 1080P streaming content is improved massively.

[@Rafael96xD]

This is a game changer ON ANIME VIDEOS, ITS AMAZING!!!

[@MrMousiee]

In my experience, any video that goes through the NVEnc on the gpu tends to come out with more red saturation than before. It's very subtle in most if not all cases so isn't really an issue but it does seem to just be there.

[@TheAuzman466]

I'm turning VSR on before watching the video, for double the upscaling.

[@BurningFishGaming]

This. I want to see VSR inception.

[@Rainquack]

On an old laptop (i5-4200/GT750M/8GB DDR3) instead of my main PC (R5 5600X/RTX3060Ti/32GB DDR4), getting super excited to try this out soon at "RTX 3000 [...] cards" - cause I never noticed that option before, having the card since ~2 years - only to get fatally struck in the heart seconds later at "Chrome-based browsers". I have to recover from this emotional whiplash... Edit: Also you wanting to do shorter videos is apparently absolutely horrendous - cause it leads to amazing things like at 1:33 - good to know that you know how to enable such a really useful thing, but I expected you to quickly and easily tell us, well, *how to do the thing* - saving us from having to research and relearn everything you learned already, independently. No rejoicing here.

[@eljestLiv]

Moomins in a 2kliksphilip video? That's a crossover I didn't expect!

[@omarcomming722]

On which video players is VSR working? I can't find any info on this and I'll never watch any actual movies or shows on browsers because of judder.

[@Ferdam]

I hope you didn't decide not doing the 'most complicated video yet about upscaling' because of us. I bet most will enjoy even if you come up with a new one-hour-long video I'd certainly like it

[@madduckuk]

Wonder how much tech this shares with the upscaling in the shield.

[@miikalaurila]

Have you created new music? I haven't rally paid attention to it before since music is usually just a part of the Kliksphilip experience for me but for some reason watching this video around 2/3 through I felt like the songs were remixes of older music instead. I liked it though :)

[@MystycCheez]

My vision is really poor, watching this at 1440p on a 27 inch monitor, I cannot tell the difference at all even when i stick my face to the screen until you zoom in.

[@GyliuDot]

finally they put a shield feature on a GPU, just shows how powerful the shield is

[@Apemon7]

2kliksphilip keeps saying "massive improvement" and "works wonders" when I can barely even tell any difference. The text looked better when zoomed in, and the mosaic blocks on the stair example looked much smoother, but those were the most significant thing I saw.

[@mike.w]

2kliksphilip should become the upscaling and techie video channel

[@sniperstyx]

i've used vsr for a week (turned it on and forgot about it) until recently because i began to dislike the quality from the upscaled videos and the amount of noise i was getting from my PC for just watching a simple youtube video i only recommend it if it really helps any of y'all out with bad quality videos in any way and if you don't have an issue with sounds from your PC

[@Deathbynature89]

I wonder if this will be rolled out to Nvidia Shield tv units? If the old hardware can handle it, cause it's upscaling was already good.

[@pedromartins4847]

The king of upscaling

[@CaveyMoth]

The color differences are the most striking effect of VSR for me. The castle in the fly-through near the end of the video has quite a change in the hue after VSR is applied. It's quite green-ish before, and gray-ish yellow afterwards. Is the algorithm doing more than just increasing visible detail, and playing with colors to make things look more "realistic?"

[@vmafarah9473]

May be it's changing colours so that people.feel it has made some change .

I think it plays with contrasts as well, and contrasts can change the colors a bit.

[@burger406]

cant wait to whack it to pixels in adult movies that are actaully AI generated therefore making me a robosexual -burger40

[@100_JAB]

Would you compare it against other realtime upscalers such as FSRCNNX

[@fv4202x]

Almost better than Opera GX's RGX feature

[@uknowhen]

"Those of you who like compressing your collection of cartoons down to super-small filesizes can rejoice" Me, trying to relate, while always aiming to hold on to the best release/encode available, x264 being the biggest compromise, all in order to keep as much as the original film grain as possible in my 70s japanese cartoon.

[@700gsteak]

So i get from this youtube video that vsr works in realtime on streamed videos but is it somehow possible to use this vsr tech to batch process old digitalized vhs recordings on the computer?

[@kmemz]

You should take a high quality recording and make purposely bitcrushed and/or downscaled versions of it, that way you can compare the upscale to the original and determine how close the upscalers are able to get to the original HQ image, rebuilding from far less/worse.

[@chaozzah]

So one of the parts I am missing from this video and your description of a future one - what is the impact on my GPU/performance using this? I have youtube running on a 2nd screen when playing games, but if it's going to snoop frames away from those games (more than running the video in the first case) I might not enable it.

[@mosamaster]

I tried the VSR at 1 and found near no difference and at 4 the whole image looked smudged and waxy while playing a 720p video at 1080p display. Nvidia should give its users a conversion tool to use this tech to upscale low res videos. I used Magpie upscale utility and found the quality to be a bit better using Nvidia vsr at level 4.

[@chocolate_maned_wolf]

What is the music at 8:00? It sounds VERY Deus-Ex ~esque.

[@Veptis]

So while the original process of mepg compressed images using jepg, now we try to undo the loss with a learned method. If we were to just use a learning based method, and an appropiate metric! - we could get something much much better. Which will eventually happen on large enough scale with for example netflix. A single model per show could be a reality.

[@666dreamboat]

If I don't get to see a video that is 6 hours of Philip exploring, predicting, and learning about upscaling I'm gonna get mad.

[@raymondcarldelacruz3769]

I watched this video to see how good the RTX video super resolution is then noticed that I can see barely any difference while @2kliksphilip said there's a noticeable difference. Then I realized I just turned on RTX VSS, lol. I turned it off then immediately saw the difference. The fact it can fix the problematic parts and make it look very similar to the enhanced parts really proves the effectivity of this feature.

[@adamfred]

Would love to see multiple generations of VSR applied. What does 20x look like?

[@JynxedKoma]

The power draw is insane and thus, not worth the otherwise impressive feature.

[@drunksupportcharacter]

Ill wait for the most complicated upscaling video yet, take your time, ill be upset if its under 1h

[@dm1i]

Looks like FSR 1.0. Maybe there is the way to use FSR 1 on videos too?