How I saved 20 TERABYTES with one basic Script (Updated 2019, HEVC)

[@316whatupz]

Video: how to save 20tbs on hard drive *looks at 1tb hard drive I'm listening.

[@316whatupz]

@@CodingUnited I feel you bruh

[@slim420-e8v]

Same here.

[@Twikkilol]

Hahaha, true! xD

[@putrareverie]

Wkwkkw

[@explosionmental2781]

200* for me

[@tingtingin]

Can't wait to store my "homework folder" while saving alot of space

[@MoonBeamLaser]

"Research material" ;)

[@Von_D]

How's the homework coming?

[@uncrunch398]

Worth it. Experiment with switches that increase parallelism without reducing quality. Double worth it.

[@KokkoroConnoisseur]

My "internet explorer" folder

[@daristotell]

Next video: How I saved my kidney yet again!

[@Richard-rk1ru]

How I saved my kidney with one basic Script

[@tommyamida5951]

cant wait for the av1 update!

[@kionenkgn9315]

I bereave a full tutorial is needed for this video since not everyone is script savvy. i can tare down and rebuild computers all day and fix almost all software and hardware related issues but scripting is a whole different knowledge base and skill set. please make this a tutorial video :)

[@zinput]

Definitely I can't get the script to work and I don't know when it works. It's very confusing.

[@KnowIin]

I'm very interested in how this works but I have zero scripting skills. Couldn't find a single good KZbin tutorial on batch encoding files.

[@brandon_downes]

@@KnowIin Bit late to you guys but in the description there's an .exe file which you can put in a folder and just double click it

[@meolessi5227]

@@brandon_downes where is the .exe file ? I downloaded the zip from github but I didn't find the .exe

[@dbp-wv1hs]

@@meolessi5227 The description links to ffmpeg.exe - you can't run this script without ffmpeg, which he is not going to host as it is likely copyrighted. All he's automating is an ffmpeg command, you could simply strip that out of his script and as long as you change the input file ("%%A") and output file ("%%A~dnpA_CRF%ffmpeg_qv%_HEVC.mp4") parts it should work manually.

[@TennesesseTitans]

Man I don’t even have one terabyte. That’s really insane bro.

[@treeleaf6471]

KiiDFLiiGHT I have 240 gb lol

[@jonathangaylindo69gachagil18]

@@treeleaf6471 i have 128gbs of ram LOL

You compared x264 -crf 14 with nvenc -qp 24 as if they were interchangeable. This is not true, x264's crf mode is substantially different from nvenc's qp mode. Your results will have a substantially different quality profile. Which in your use case may not be critical, but in other scenarios this difference in how these modes assign quality and file sizes in different ways are quite substantial. Also please remember that the licensing situations of h264 and h265 are very different. The additional fees and more complex licensing requirements for x265 almost disqualifies the format for most scenarios that not either strictly private use or very big scale commercial.

[@EposVox]

I'm aware, I mention that every time I discuss streaming scenarios and why HEVC isn't used for live. For random people via my KZbin video, it's fine.

[@matrixate]

You're right about the CRF parameters, but I want address the licensing. So, while the HEVC codec does limit playability and editability in mainstream NLEs and players, I still think saving in that format is safe for the long run because we haven't yet hit the best compression quite yet, which means that one should use and make use, of what's best now. Even if the licensing is exclusive in the future, I'm on with paying once to be able to open a work of video footage that I can still reconvert for viewing pleasure. Yes, for streaming, not the best, BUT I want to archive, and so I've actually changed to HEVC encoding a while ago even before this video was posted on the same premise and results. So, I applaud this move and approve his message. The script was actually very helpful.

[@Deikybara]

waiting for an update to this video using AV1

[@saxinat0r]

For anyone who isn't an expert and are trying to figure out how to do this: 1) download the "crf24_hevc.bat" file from EposVox's video description link 2) go to ffmpeg.org, click download, click on Windows, and click on "Windows Build by BtbN" 3) download this file: "ffmpeg-N-100554-g89c9c42c5b-win64-gpl.zip " 4) extract the "ffmpeg.zip" file, and look for "ffpmeg.exe" 5) move the "ffmpeg.exe" and "crf24_hevc.bat" into a new folder, and move the video file you want to convert in that folder also 6) double click on "crf24_hevc.bat" and it will start encoding Some things to note: 1) you may need to disable your virus scanner temporarily since mine prevented the .bat from running 2) you need an Nvidia video card for this. If you don't have one, it won't work Good luck. Mine worked fine with the instructions above. Thank you EposVox for this stellar script as I'm seeing a noticeable difference in file size and the quality is identical!

[@ilyamuromtsev1167]

This is exactly what I've been looking for. Thanks!

[@draskuul]

When you're selecting those files to delete you can probably do it a lot more easily by sorting by Type, shift-select the block of old files, then sort back by filename to look for empty/bad files and correct from there.

[@olegt.6358]

After a bit tinkering, I think I fixed the script to work with AMD cards. Only did a few changes to line 33 on the script and it seems to be working and doing the same stuff without any problems now. Changed hevc_nvenc to hevc_amf and added -gops_per_idr 1 after to solve the seek problem that happened in videos and also changed "constqp -qp %ffmpeg_qv%" to "cqp -qp_p %ffmpeg_qv% -qp_i %ffmpeg_qv%". Also had to change -pix_fmt to nv12 as was recommended during the encoding, but that's just optional and can be changed to something else.

[@crazyrichbum]

This was super helpful, I kept getting errors regarding constqp and could not figure it out!

[@vladimirgandi427]

Hello, thx for script. It us working for amd, but from what I see Nvidia get much smaller files with better quality than amd.? I get a bit washed out colors and size for example 1.2GB from 14.7GB file (from resolve ) where I expected around 600MB max. It's sad. I have rx 570 8GB. From what I understand, amd could fix this with just some software patch but they have no plan to do it in near future.

[@impoppy9145]

I strongly advise you to NOT USE AMD hardware decoding, it is the worst technology (literally) you can use if you care about quality OR /AND if you care about file size. This is not a secret this is a well-known fact. Very easy to google.

[@Anton1699]

Please do note that QP24 and CRF24 are different. CRF will use different QP values for each frame depending on what is deemed necessary to reach the specified quality level.

[@N0N0111]

6GB to 6MB haha that is nice!

[@AlphaYellow]

Just a correction, the max bitrate allowed for the AAC codec isn't 384 Kbps, but 512 Kbps.

[@jacobkoziej]

I'm honestly really grateful for this video, I remember a while back I modified your original FFmpeg script to use x265 instead of x264 with limited success. Although I got the script working it wasn't practical with the absurd amount of time it would take to compress footage, this on the other hand just burns through my footage and is 6x faster on my system with close to similar visual fidelity. Thank you so much!

[@EposVox]

Software HEVC is way too slow

[@Suuhls]

Can you do a video basically just setting this stuff up, just a short do this, download this and put this here video.

[@Suuhls]

@@darkcggaming I am a hardware engineer, I just have little to no knowledge of automation

[@SimonZellox]

I found x264 at CRF 18 and veryslow to be imperceptibly close to lossless with really good file sizes. I use this for my Plex server to stream media faster and with less bandwidth usage. I wanted to halve the file sizes but I can't do it at acceptable quality. x265 at quality 22 looks alright in bright scenes but falls apart in dark scenes and has severe banding issues. 10 bit h265 is way better but not quite half the file size of h264. H265 is really not half the file size at the same quality. I tried over and over but h265 just shows more artifacts than h264. I wonder how good your stuff looks at CRF 24 because software x265 is crap at 24.

[@glenwaldrop8166]

For dark scenes I've found you really have to tinker with x264 settings, 2 pass is best. For general video I've actually got NVENC settings that beat x264 in quality and size, but you may not find my quality level acceptable if you're having issues with 18. Using NVENC VBRHQ is essentially the NVENC version of 2 pass so even using 23 and bitrate of 1100 on 720P is nearly indistinguishable from source video except for really dark scenes and/or fog.

[@SimonZellox]

@@glenwaldrop8166 q18 h264 looks nearly perfect. The difference is tiny and only visible on a large screen that has bad black levels. It is most visible in dark areas where you can see blocking but h265 is way worse in dark areas. H265 produces different artifacts like banding and weird noise blocks. The banding is extremely noticable if you encode at 8 bit. Some of my movies are under 2 GB and still look good in h265 but the quality drop is a bit larger.

[@SolitaireNZ]

Brilliant, will look into this!

[@David-2501]

Tip: This doesn't work on 900 series cards, because they don't support 265 encoding. I just found this out since I wanted to try it on my laptop, as I'm not home to test it on my PC.

[@EposVox]

Yeah only 10 and up :/

[@Martin__]

Wait, what...? This is a 980: i.imgur.com/2aQVT8r.png

[@FilipeFernandes7]

@@EposVox So if i use Handbrake H.265 (NVEnc) it works, why i cant use it with this? Nvidia GTX 980

[@FilipeFernandes7]

so i need to change the pixel format to -pix_fmt yuv420p

[@EposVox]

@@FilipeFernandes7 I don't know why it would work in Handbrake, 900 series doesn't support it.

[@amrnassef5344]

Hey Eposvox great video just got a quick question, at 10:00 you said that the encodes come in 8-bit 4:2:0 but according to NVIDIA your cards should support 10bit 444 and lossless, so why not use that and save more space? developer.nvidia.com/video-encode-decode-gpu-support-matrix

[@EposVox]

Er, encoding to 444/lossless doesn't save more space...

[@amrnassef5344]

It does when compared to raw doesn't it, I don't have alot of experience with video compression but from me messing around lossless files definitely where smaller than raw with no data loss ( Couse you know lossless 😂) when I encoded. Thought of course they took way more space than "visually lossless" which I ended up using because they where nothing important, if you need all video data I don't get why lossless wouldn't save space on drives compared to the high bitrate raw.

[@amrnassef5344]

Oh and I'm talking specifically about the black magic files you said you might need to color correct later and such not the normal ones. And thanks for replying btw 😁

[@EposVox]

@@amrnassef5344 Ohh I see. Yeah I need to work on that, but that requires changing which encoding I do based on the source which gets more messy. Something I'd like to work on.

[@amrnassef5344]

@@EposVox Oh I thought you would have the raw files in a separate folder per project or something so you would just be able to specifie the codec in the script (another version for lossless) and run it on the folder containing the raw files. But if you have a different workflow then that changes things of course, though I do hope you look into this in the future and do a video about it as it would be really useful and interesting. :D

[@Reedith]

Just opened my 45 drives server today. I installed 120 terabytes and I never thought nine 14 terabyte drives wood look so small but next to 36 empty drive bays it's sad. First world problems

[@EposVox]

HNNNNG jealous

[@Reedith]

@@EposVox lol I've got lots of empty bays you're welcome to come by my office in LA throw in some drives, make a storage pool, and bang ! Free cloud storage. 2gig symmetrical fiber in it also helps. Speed things up

[@varunraikar]

Can I compress Alpha channel videos like this?

[@scienceontheright]

I'm using Handbrake to do the same thing. I tried the script, but ffmpeg complained about a missing a library, which is odd. But I got Handbrake to do the same thing. I am currently chewing through 64 Blu Ray 1080p movies, encoding them to H.265 HEVC using my 8700K and nVidia 2080 ti. It takes about 25 to 30 minutes per movie to transcode them. These files took up about 1.7TB of space on my NAS, but based on the compression so far, I expect that I will save about ~60% of that. So the end result is that I should save about 700GB across all 64 files. Not bad!! Plus, I can now direct play these to my Sony TV, which means the CPU usage for my NAS is about 0-1% while Plex streams them!! I'm happy!!

[@scienceontheright]

UPDATE: I just had to change it to output an .mkv file (since that is a regression for ffmpeg when the input is .mkv) and it worked. Comparing the output of that to Handbrake however, Handbrake is better for only one reason. Everything is the same, video quality, audio quality, except the ffmpeg produces a video image that won't scale to the size of the player. So on my TV or gaming PC, it is a small rectangle with black borders on the top, bottom, left and right. Whereas Handbrake scales the video to any size view port.

[@HeyWerePlayin]

Really needed this. Hard drives were starting to really fill up. Thanks for sharing!

[@David-2501]

Me too, but for videos in Google Photos! They take up so much space on my SSD! D:

[@user-ks8bb2xx7s]

Quick question - any particular reason to use '-rc constqp -qp' over other possibilities? Many say, including slhck site, to avoid -qp and opt for -cq (similar to -crf in x264). Quality with -qp is guaranteed, however, it can use more space, so savings with -cq could be higher. I am still testing hevc in order to see what is best for archival purposes. BTW, you can omit both -map 0, the default map behavior is to select best video+audio, or in case of single video/audio track it is not even needed. Then for -b:v you can simply use 0, 'K' is not needed, ie. '-b:v 0'.

[@EposVox]

1 - no particular reason, just what I was most familiar with. 2 - no, those cannot be omitted for people with my kind of workflow, they're required to safely keep multitrack recordings in tact

[@user-ks8bb2xx7s]

I see. I did some SSIM and PSNR tests, '-qp' definitely preserves quality, and yes, it uses slightly more bits, but there is no drastic increase compared to '-cq' with the same value, so both are great. Observations around '-cq': - it seems to default to '-rc vbr' and it had slightly better score than '-rc vbr_hq', which some people recommend, almost no difference in metrics - '-preset slow' surprisingly lowered metrics a little, but not perceivable as well. In short, it seems nvenc is smart enough to use best defaults in given scenario, and '-qp' or '-cq' is enough. Same values provide similar results, both require '-b:v 0', '-qp' seems to default to '-rc constqp'. I used this to test: # ffmpeg -i new.mp4 -i original.mp4 -lavfi "ssim;[0:v][1:v]psnr" -f null - ... and this to see all options: # ffmpeg -hide_banner -h encoder=hevc_nvenc FFmpeg was latest build from Zeranoe site.

[@videomania666]

I want to use this but keep getting errors before the video starts to encode,. Not sure if my files are in the correct folders etc??? Great Idea, but I'm totally lost.

[@DimiS1978]

Are you getting "ffmpeg is not recognized as an internal or external command" as error?

[@markifi]

reencoding video sure, who cares, but i really don't get why you would reencode audio

[@loganwalsh]

Dude, you're the best. I always love your uploads but then again I'm in the center of your target demographic so I guess that makes sense. Keep up the great work!

[@KuJoe]

In 2020 this video has been extremely helpful. :)

[@meolessi5227]

Ok, the topic looks interesting , and now, I'm a novice in this. Where do I start? I have some .mkv's than I'd like to compress, so how do I use this script? Thanks a lot for help!!

[@vsevolod.dobrovolskyi]

If you have an old Android phone you can save space by rooting it and installing a Magisk module (or just changing the "build.prop" file) to make Google Photos think you are using a Google Pixel and it will give you unlimited uncompressed storage. Then you just sync your footage with a cross platform app/program like Syncthing, and you can drag footage into a folder on your PC for example, and it will automatically send it to your phone first and upload it to Google Photos. I use it all the time on my phone and PC, works great

[@DezorianGuy]

Can you make a tutorial how to actually encode a video with your script? Put a video file into the same folder and press "crf24_hevc"?

[@joshuaosbiston5777]

Remembered this when I needed to compress some training videos, thanks for the content!

[@MarkosVG90]

Hi, do you have an updated version of this script?

[@byVELTEN]

I am "only" getting about 1.5x speed on 1080p footage, anything I can do to make it quicker? or is this just how it works with certain files etc?(1080ti)

[@TheDmankl]

Depends on your chosen encoder using hvec_nvenc speeds it up but bit bigger file size

[@glenwaldrop8166]

I'm one of the biggest IT guys in my area and I only have about 15TB between 7 machines and several external drives. No telling what I've got archived to DVD though... that's probably a pretty ridiculous number there. While I typed this up I had to keep bumping up the number though, keep forgetting about this drive and that drive and that one over there, backup in my bag... It is time to pick up a couple of 4 to 6TB rust drives for storage though before the prices go up. It's only a matter of time before SSD and HD won't be so far apart in price and I'm not sure SSD are going to get a lot cheaper.

[@EposVox]

General datahoarding and video production business are very different scales of data, hehe

[@glenwaldrop8166]

@@EposVox very true. My original DVR system recorded at roughly 15GB/hr, but I only recorded about an hour a night, compressed it the same night. Nvenc made my life a lot easier.

[@ENunn]

whats the typical bitrate for the compressed files? i usually encode in handbrake with cq 0 and it turned a 200+mbps 20gb video to a 20 mbps 2 gb video.

[@EposVox]

The point of CQP is that it bases the bitrate on the content. So I have files that are 1-2mbps, 12mbps, 100mbps, etc.

[@alvydasjokubauskas2587]

For archive use 12-15 constant bitrate hevc 1080p - blue ray quality. CQ is not made for archives, streams and it actually uses more space on some video. Constant bitrate is way to go.

[@EposVox]

Constant bitrate is something that should never be used other than for streaming

[@chumbo]

11:53..."I'm here to make tech EASIER and more fun..." easier? I didn't understand anything and still have no idea how to compress my video files.

[@davidg4512]

powershell is the answer, supports all path types and easier than batch

[@peterjansen4826]

I don't understand the map-part: 0:a and 0:v. The a stands for audio and v for video but what does that 0 mean? I quickly looked in the man-page of ffmpeg (I searched for map), it doesn't make it much clearer. It is not relevant for using it but I am curious what that number stands for.

[@matthewbilker3401]

It refers to source 0. You can have multiple input files with ffmpeg.

[@EposVox]

It's for multiple tracks. I mentioned that in the video. I utilize multiple audio tracks in OBS and this makes sure that they're all mapped from source to the new file.

[@peterjansen4826]

@@EposVox Matthew Bilker Thanks.

[@simpleandfrank]

If you did not press 'Like' for this video, then you shall never press 'like' on another video ever! Great efforts!

[@ENunn]

Have you ever tried using this on AviSynth scripts? Wanna make sure I'm doing this right, it seems to be using more of my CPU than my GPU, if it's even using my GPU.

[@ItsTbig]

I'm coming from the future, oOoOo! Great informative video my dude! This was really interesting.

[@daristotell]

who the hell are you?

[@EposVox]

A spy

[@ItsTbig]

@@EposVox a spy indeed ;)

[@TheXev]

EposVox, is there a version of this script that uses AMD HVEC? You have sung its praises lately and I'd love to try a version of this script with my AMD hardware.

[@EposVox]

AMF's ffmpeg implementation is a tad confusing atm and I haven't gotten CQP working in it yet. Theoretically just swapping "hevc_nvenc" to "hevc_amf" would work, but it throws errors for me. Will update if I get it sorted!

[@lands1459]

could this be automated on linux for x265? i have an old HP DL160 G6 server and i've manually been needing to move files to and from it every time its done so just dumping a bunch of crap over and letting it run for the day would help

[@cyantox]

Could you possibly make a newer video, but this time for AV1?

[@GramOfMayo]

man you seem to be the handbrake/obs/premiere wizard. how tf do i fix my shyt? i'm recording with a focusrite scarlett 2i2 2nd gen. in obs I record with mkv format. when video is brought into handbrake i encode or whatever to mp4. So I have 3 files when it's encoding in handbrake. game (video) game(audio) and mic (audio) if i import a video in i've converted then cut it in 2 different areas and try draggin another one on top and cropping it my playback doesn't work and it just skips all around like crazy or locks up. i have constant bitrate selected in handbrake or whatever.. not sure what im doing wrong. can you help me out?

[@laurentiudll]

Unfortunately, theres a noticeable green tint applied across al my GH5 original videos, also on the exported color graded ones. Anyone knwos a fix ?

[@PescaitoFrito]

Any script to convert h265 back to h264 for old TV? Also what about a scrip too for downmixing properly the audios 5.1 to stereo 2.0 again for some old TV , thanks.

[@salaciouscreations4323]

Amazingly I hadn't considered this before. Will davinci resolve allow hvec editing

[@EposVox]

Yep!

[@salaciouscreations4323]

@@EposVox I going to add this to my workflow, pop a new raid in and run this through my server this weekend. Thank you so much your channel has always been a go to place for process improvement for me.

[@EposVox]

@@salaciouscreations4323 :D

[@amar1945]

This script is getting rid of the original subtitles, any help?

[@BearsBlend]

Would this also be recommended with movies?

[@loirodeja]

as a atomation lover, this video was delightfull. great job as aways.

[@EposVox]

:D

[@hunter1586]

an*

[@LeeSmith-cf1vo]

I considered doing something similar last year. I set up a script that worked well, the quality was barely perceptibly different, with significantly smaller files (better than 1/2 size in most cases). However I came to the conclusion that it actually wasn't worth it - because the Electricity cost to re-encode was higher than the cost of just buying additional HDs. Obviously the maths is different if you have an ongoing cost for cloud storage, vs the one-off cost of local storage.

[@EposVox]

Expensive electricity o_o

[@LeeSmith-cf1vo]

@@EposVox Not really - hard disks, even resonable quality ones, are cheap. I worked out it was going to take over a month to re-encode. vs the maybe £100 for a suitably sized HD. Now, at the time, I had solar panels and so free electricity during the day. I did have a plan to make a script that would run in the daytime only, and while I was out of the house. But in the end it just didn't seem worthwhile. Not everyone's needs are the same though

[@EposVox]

​@@LeeSmith-cf1vo Clearly you don't need the same scale of storage lol

[@LeeSmith-cf1vo]

@@EposVox correct, although assuming a linear relationship between encoding time and space required - the maths still works the same. That's a big assumption though, and unlikely to be true at the higher end. As I say, different requirements for different people 🙂

[@jonasparsson6721]

Did the script but the compressed file is larger than the original?

[@williamdlc3]

Why am i only seeing this now thank you KZbin algorithm and epos vox!! I have 40tb+ worth of client files that i need to compress so i can start re using hard drives to save money, and this is a gamechanger. Thank you

[@MsTiagoPotencia]

Hello! And what about video metadata (for example created at)? For old videos it's important to have these data to be easiest to find and sort files. I saw that ffmpeg has an option to copy the original video metadata to the converted one. Thanks!

[@EposVox]

Probably something I should include, haven't looked into it.

[@MsTiagoPotencia]

@@EposVox i saw something like: "-movflags use_metadata_tags" video.stackexchange.com/questions/23741/how-to-prevent-ffmpeg-from-dropping-metadata

[@EposVox]

I've also got "-map_metadata 0" added in on github

[@BornwithASD]

@EposVox just wanted to ask you if by any chance do you know on nvenc settings slice decisions what number will be good when encoding blu ray's?

[@EposVox]

I've never messed w/ BluRay mastering, sorry :

[@BornwithASD]

@@EposVox thanks anyway

[@Bethedon27]

These are great settings for ffmpeg. Instead of using a script you can easily automate everything with tdarr (I run in a docker container) which will monitor folders and automatically fan in and fan out GPU encoding and give you all the stats you want on storage saved.

[@eyadaldwaik3880]

Use powershell man, and do the whole thing in one script, adding checks for bit depth and output file size, compare with input, and delete if needed, you'll never touch a batch file after you do powershell.

[@pvdgucht]

Can’t wait for the H266 VVC update 🤓!

[@skatcat743]

does plex work with nvenc/amf? I am planning to retire my current rig which has an old i3 to be a tv tuner/plex server/htpc thing but cpu encoding/upgrade isn't going to work for me or my budget. So I'm considering getting it a gpu to use for compressing & 4k decode. Should I use plex to capture broadcasts or have other software simply write the raw MPEG2/H264 stream to disk and process later?

[@ClockworkD0rk]

Plex works fine* with h265. The asterisk is because lots of client devices can't handle h265. Plex will gladly attempt to transcode it to h264, but you need either a very modern CPU or something capable of doing it in hardware to transcode in realtime for playback.

[@skatcat743]

@@ClockworkD0rk can it use gpu to do real time?

[@ClockworkD0rk]

@@skatcat743 I was just researching this earlier today, and according to documentation / forum posts it will, but I haven't verified it myself yet.

[@skatcat743]

@@ClockworkD0rk bet

[@SimonZellox]

Hardware encoding only works if you have a Plex pass. 1080p and 720p transcoding from 1080p h264 isn't very demanding so at least that should work.

[@djvincon]

Very nice!! Do you have a video were you go in to your mapped drives?

[@ahmedlasheen6133]

hi could you please tell me is that script made just for Nvidia cards cos it tells me it Cannot load nvcuda.dll ??? i have RX580 VGA card

[@TheDmankl]

Yes it is because of the hevc_nvenc encoder, if you change that to the amd version of it then it will use that hardware encoder

[@254-z6k]

Hey Epos, have you considered using LTO tapes for archiving your cineform/massive video files so this way, if you absolutely need a clip and in it's original quality, you've got it in ~24 hours? That's personally what I'd do instead of deleting files (I'm running ~100TB locally and over 1PB in the cloud/colocated servers)

[@EposVox]

It's something I've wanted to look into, but don't have the budget for anytime soon

[@logokas]

I wonder if this could be useful in cutting down Shadowplay footage in a reliable way. I don't generate much of a footprint with my recordings still, but those files can get out of hand sometimes, since they're recorded at 50Mbit on the old NVENC.

[@EposVox]

Every once in a while the file will be bigger due to extra noise or motion, but yep! Here's an example i.imgur.com/HR7STlL.png

[@bradmattlage]

So I gave this a shot with my stream recordings. I changed the audio bitrate on your script from 384k to 192k (because that's the quality I stream/record). I tried a short 20 minute mp4 recording, before it was 858,370KB and after it was 1,657,192KB. It's just about twice the size as before I done this. What could be going on here?

[@WarMomPT]

I've been playing around with this script and different 'original' recording settings over the past 3 months and I find that if I'm re-encoding something at H265 CQP 22 or worse, you can get *some* artifacting but it's in very niche situations that usually happen with dark environments. I've seen blocking on steam vent effects in a dark area, or a face that passes by in a split second in the King's Row (night time) map in Overwatch. This is made *very slightly* more significant if you're running a garbage-in-garbage-out workflow where you already compressed the recording at a very high setting (like H264 CQP14, well past diminishing returns) but even CQP22 from a lossless AVI can produce some flaws here and there With that said, 'watching the video, fullscreen, pausing on busy frames and actively hunting for flaws' is quite different from how the content is actually watched, and for the amount of space saved, oh, it's absolutely worth it, especially considering that at this point youtube processing is the tightest bottleneck even at 1440p.

[@FINNBOY7667]

i seen a thing but i don't know if it's normal or not , in your recent bat , you use the mp4 format , everything work , then when i change to MKV , it does loop , something is wrong or it's perfectly normal ?

[@CPGplays]

EposVox I have a question I use OBS studio to record with and I have recently started recording in lossless quality do you know any file converters that are out there that I can use to convert the file to MP4 because the editor that I use does not support Avi and that's the only way you can record lossless quality is Avi right?

[@EposVox]

You can use "Indistinguishable quality" for MKV/MP4

[@CPGplays]

@@EposVox Thank you for your help

[@CrankyCoder]

did you have to custom build the ffmpeg to get hardware acceleration working?

[@EposVox]

Nope, just the latest Windows build from their website/zeranoes

[@frankvanderheide]

Did you update it perhaps after the rtx ampere GPU's came out? I have a 3080 and I'm wondering if it's worth to update the ffmpeg script. I don't have the skills to update it.

[@NetFelixOfficiel]

is it possible to run the script for amd users

[@byVELTEN]

how did you set up the stream deck button to encode the folder you are currently active in?

[@zorin1us]

@EposVox I have been using HandBrake to compress my movie collection. Everyone says that you should use your CPU and X.246 for the compression. I see that you are using ffmep which is the same as HandBrake but you are using the Video card to do the compression. I'm guessing you would not being do this if the compressed version was a bad quality. I can't see why there would be any difference between what you are doing and me with compressing a movie. Do you know of any settings that I can set in HandBrake to produce the same quality that you are doing? If I could same a bunch of time that would be wonderful. Maybe this is something you could make a video about. It would be nice if you could address the CPU verses GPU compression. Great video by the way. One comment. You can install Linux in Windows 10 (WSL). So you could write a bash script to do your encoding.

[@_--_--_]

Well its actually pretty simple. CPU (aka software) encoding will always be more efficient compared to GPU, meaning same quality at smaller file size or better quality with same file size. The reason why that is, is because hardware encoding (GPU) isnt as flexible as a written software and does not 100% support all the features of the codec (for example nvidia h.265 encoder before 20 series did not support B-Frames, which is very important for good efficiency with hevc).

[@zorin1us]

@EposVox might be a good idea to create a video about this subject. I'm sure a lot of people might have the same questions. @@_--_--_

[@denizlo3913]

Hey ... I Love this, but i have (programming) issues: I Put your scripts/files, ffmpeg and my video (.mov File from Iphone) in one folder Got an Error after executing cfr24_hevc.bat ... Can you Help Me ?

[@denizlo3913]

Stream mapping: Stream #0:0 -> #0:0 (hevc (native) -> hevc (hevc_nvenc)) Stream #0:1 -> #0:1 (aac (native) -> aac (native)) Press [q] to stop, [?] for help [hevc_nvenc @ 0000024d33ba81c0] 10 bit encode not supported2.77 bitrate= -0.0kbits/s speed=N/A [hevc_nvenc @ 0000024d33ba81c0] No capable devices found Error initializing output stream 0:0 -- Error while opening encoder for output stream #0:0 - maybe incorrect parameters such as bit_rate, rate, width or height [aac @ 0000024d33ba7440] Qavg: 54808.117 [aac @ 0000024d33ba7440] 2 frames left in the queue on closing Conversion failed!

[@denizlo3913]

Ryzen 9 3900x / gtx 980ti

[@denizlo3913]

Also found this error: [mov,mp4,m4a,3gp,3g2,mj2 @ 000001f13b20df40] Format mov,mp4,m4a,3gp,3g2,mj2 detected only with low score of 1, misdetection possible! [mov,mp4,m4a,3gp,3g2,mj2 @ 000001f13b20df40] moov atom not found C:\Users\Home\Desktop\Test\IMG_0005 2.MOV~dnpA_CRF24_HEVC.mp4: Invalid data found when processing input

[@TechGuides]

Cool script, thanks for sharing man!

[@dmjita]

I see Synology, i upvote

[@Shisno2112]

Not sure if you still check the comments on this video but I tried this on some videos i recorded with shadowplay and while everything worked properly the colors on the encoded video weren't quite right. On the encoded version of the video I tried the colors seem a bit dull for example the reds are a bit more orange than red and the blues are a bit darker. I don't really understand all the commands in the batch file but I tried to up the cqp to 22 like it said in the script and while the file size went up the colors weren't fixed. I tested out encoding the videos through handbrake using nvenc x265 and it fixed the color issue but obviously a script would be way easier to encode videos than handbrake so I would like to use the script if possible. Do you know the reason why this happens with your script and if it's possible to fix?

[@InfinityNexusReviews]

I have a question, I use handbrake to convert footage from shadowplay so it's constant frame rate which is needed for Resolve. I use H.264 Intel QSV and the file sizes are massive. I want it to be lossless because it's before the video is edited, but my God, a 5GB file can become 30GB. Is there something I'm missing?

[@CallumEM]

how i need this to save space! and also 20TB? how much storage do you HAVE?

[@FluffyPuppyKasey]

I think at least 80TB on one NAS

[@EposVox]

I've got about 100TB total spinning up in various forms.

[@CallumEM]

@@EposVox wow. just wow. *sitting here running off 4TB*

[@CallumEM]

@@CodingUnited lol, i paid combined total of £1.4k to buy this.

[@zinsy23]

Holy crap! CRF 24 and no noticeable quality loss? I'll have to try that!

[@surject]

You lose sharpness. Else it's awesome / way better than h264.

[@zinsy23]

surject It's not noticable unless you zoom way in, is it?

[@surject]

@@zinsy23 Depends on viewing distance, display size and resolution... *I* notice it on my projects and setup. It's just a technical fact h265 got less details aka smoothens/blurs the image. Same reason your JPEG file got smaller when you add some blur in Photoshop "save for web" export dialog.

[@IDKOKIDK]

@@surject Is there a CR value that won't reduce sharpness compared to original & does that value still make this HEVC archival process worth it if attempting to reduce file size (Not that I expect you to know all the answers but I thought I'd ask :) )

[@surject]

@@IDKOKIDK More details mean bigger file size. Test "--tune grain" and play especially around with "--psy-rd" / "--psy-rdoq" / "--rdoq-level" depending on your source.

[@JimLeonard]

Have you done SSIM comparisons with qp 24? I see loss (with the naked eye) with 1080p footage at 24. 4k is less important, but it's still there.

[@EposVox]

Are you using HEVC? X264 and HEVC CQP/CRF values work a bit differently. But no, I haven't. If it looks good enough upon spot checking and running through KZbin compression again, it's more than good enough for this purpose. I'm not aiming to squeeze out perfect duplicates, just "good enough". That being said, most of what I have is screen capture, which compresses well anyway, and uncompressed DNxHR/Cineform/ProRes files which are going to squish down a ton.

[@JimLeonard]

@@EposVox Yes, hvec and same hardware. As long as you understand that it is not a visually lossless conversion, you should be okay. It sounds like you're doing this just for archiving footage you're not sure if you need any more, aka "rainy day" backups, so it's fine.

[@ObeyThyIllest]

started using this updated script for my obs/shadowplay recordings and now the thumbnails don't load after compressing and i can no longer tag them in the details property :/

[@EposVox]

Explorer doesn't have a ton of support for MKV nor HEVC

[@ObeyThyIllest]

@@EposVox thanks for the heads up. downloading icaros helped sort out the thumbnail problem, do you know of any way or program where i can tag the files?

[@toxotis70]

can you do a more detailed video about how to do it exactly ?

[@FatheredPuma81]

No idea what the capacity/age of those harddrives but i'd assume they're 8TB each if these were built post 2015 so why not just combine the 2 and get a bit of extra storage? All in all though it's pretty rare to see a channel with only 240k subscribers spend $2500 on storage. I assume most of them are sitting on maybe $300 of storage for their videos at most.

[@falxie_]

How are the quality profiles equivalent between h264 and h265? Would you get better compression with CPU encoding over GPU? I have so many unanswered questions because I'm currently re-encoding my GoPro footage

[@DesertCookie]

CPU-based encoding always results in better quality and compression rates (at least for the foreseeable future). Hardware encoders don't offer all the instructions a software encoder can offer which results in the losses. I only use GPU-based hardware encoding when rendering a rough-cut of a project and want it to happen relatively fast. When streaming, the GPU does the live-stream and my CPU does a local recording for better quality.

[@TriforceofShadows]

Great Video, Subscribed.

[@EposVox]

Thanks!

[@zinsy23]

In your experience so far, is CRF 24 H.265 still basically equivalent to CRF 14 H.264?

[@EposVox]

So far, yep!

[@zinsy23]

@@EposVox Nice! I just tried this on a screen recording and unfortunately, I noticed a little artifacting on CRF 24 with handbrake. I actually did a test with x264 and x265 with the same recording and it seemed like x264 looked better strangely. There's some recordings that I don't have a reason to keep but will do anyway, so I will use x265 for that just for archival purposes. I'm actually doing CRF 20 on that just to be safe. The size is still a lot smaller than x264, so I'm still getting a lot of benefit! I'm not storing an insane amount of things like you are, but I can still definitely receive the storage benefits despite this.

[@paulmaydaynight9925]

i noticed some of your scripts seem to recode lower sound grades,that will bite you, use -strict -2 -acodec aac -ac 2 -ab 192k at least... and oc i find its aways better to explicity set -vf yadif,hqdn3d,unsharp=5:5:0.5,gradfun "%%~nA.MP4" just in case the original decodes slighty wrong on a given hardware assisted decode (their just not good enough for recoding anything but 8bit yt for the impatent) and oc.. the most under used option when playing with ffmpeg filters etc is to "just" use the matched ffplay in place of ffmpeg to get the realtime visual result ... the simple version of colour grading included... kzbin.info/www/bejne/g2abo5ZtmN2fldU FFMPEG Advanced Techniques Pt1 - Advanced Filters 0612 TV w/ NERDfirst ,Published on Sep 27, 2016 In the past, we've worked with FFMPEG as a conversion tool, but in fact, this little command line utility is so much more! We kick off this two-part series by first delving into some of the more interesting filters provided by the program! kzbin.info/www/bejne/nnbPdaavqqaEeqM FFMPEG Advanced Techniques Pt2 - Filtergraphs & Timeline

[@thejcedeno]

or you coulda wrote a small python program/script to do it all at once thus being able to deal with the issues inside the same program?

[@EposVox]

Coulda, if I had the experience. Could've made it a full gui and something that ran itself for me once footage copies over while I'm afk - but I work with what I know how to do. And I'm a control freak and don't want something deleting the files for me.

[@pimpjuice6869]

hey EposVox! I use this script religiously :) I was just wondering If you've made any improvements to this script after all these years ? Thank you very much

[@BilgeKaanAtay]

I have a 340 MB video which was captured via OBS. I downloaded your script and ffmpeg.exe thing. I put them in the same directory with the original video. In a result, the video became larger which was 350 MB.

[@hunter1586]

What resolution was the video to begin with because I hear low resolutions won’t really benefit from h265 over h264

[@tomchen_8889]

That one Filder on the Desktop named "F" @ 9:06 Wonder what´s inside there?

[@EposVox]

F

[@ringo_-]

Great video, I'm back-archiving a lot of videos with HEVC now with a variation of your preset, it's mostly the same as yours and I'll likely use your script in the future. Question @eposvox, if you want to edit the HEVC converted video in a video editor, you would have to losslessly convert it back to x264, right? I can't seem to find any video editor that can edit it natively.

[@EposVox]

Premiere and Resolve both edit HEVC fine

[@HeroMike17]

have you ever tried to sort the files by type before selecting them? Then click first file, hold shift, click last file - voila. Hopefully all have been processed well ;-)

[@EposVox]

Except I have plenty of files that are also in the same kind of container as what gets spit out, and I still need to check and make sure they're smaller first anyway

[@Neurotoxus]

Does this work on .mp4 files as well? Tried doing this, and the result was getting a "compressed" video that was a larger file size. Went from 1.05GB to 1.08GB

[@EposVox]

Yep

[@JorgeEscobarMX]

after weeks, my OBS videos got compressed by a ~10th the original size. Thanks.

[@DiegottlosenCharmeure]

7:10 that is not true, you can go, depending on the aac profile up to 1440kbps. 384kbps is more than enough for stereo, especially for speech, but its not true that 384kbps is the limit for aac.