What is SSD Overprovisioning?

[@SethiestSeth]

Now this is a real Techquickie!!!

[@SethiestSeth]

PS thanks for the upload

[@Olibelus]

The Master Agreed!

[@isaac52050]

The rest are all a cringy mess

[@Psittac20]

thumbnail looks from the 80's, haven't watched the vid but suck my grapes. Edit: wait......... add a solid state driver?........????????????????????

[@EVRLYNMedia]

The Master i know! but they still didnt get rid of the cringy intro

[@robert-bg9pf]

Now THIS is an episode that is actually USEFUL!!! I have noticed the weird storage capacities of SSD storage before I saw this video, but I had never heard that term "Overprovisioning" before. Keep making videos like this that are truly useful for educational purposes and your subscriber count will explode!

[@alexanderrr1825]

1:15 Linus predicted the overprovisionning of toilet paper :)

[@worlwr2]

Lots of empty unpartitioned space at supermarkets and convenience stores -- exactly as intended and designed, nice.

[@Rattacko]

*When you haven't watched techquickie yet* "Thanks for watching techquickie" WAT

[@topinator3403]

Rattacko full verse please ? He said , during the previous month , we recommended sdd in your pc . We thanks you for watching techquicki .

[@topinator3403]

Rattacko Don't watch news too much often . Because they only shows part of it .

[@Rattacko]

I'm talking about the intro

[@ODeltan]

It was just so quick that you missed it

[@gaminghazardofficial]

When my wife starts to sing I always go out and do some garden work so our neighbors can see there's no domestic violence going on.

[@leopoldo.mp4]

Brutal

[@jec_ecart]

Huh?

[@KobrokoHere]

Just some auditory violence, nothing to see here!

[@jody024]

2017 to 2020, Linus aged 10 years, though his voice stayed the same.

[@mkpc12]

Linus I wish you went more into Gigabytes vs Gibibytes, since it has a lot more impact on advertised storage vs actual storage than you talked about. My SSD has an advertised capacity of 480GB. According to Windows 10 however, it has a capacity of 446GB. Now it's time to take the advertised storage to the GB to GiB converter. 480GB is equal to 447GiB. I'll do this on another drive as well. My 3TB HDD, according to Windows 10, has a capacity of 2.72TB. Again, throw it into the converter. And the result is that 3TB is equal to 2.72TiB. Just a note I thought I should add, since Linus never went into detail about this in the video. Edit: I did round off my results.

[@pojcharapoltosukowong]

Its also worth pointing out that, most (or all) computer storage manufacturers uses a base 10 system (1 GB = 1,000,000,000 bytes), but computers always uses base 2 system, so 1 GB (Or the Linux users might see the OS mentioned it as GiB: Gi"Bi"Bytes) is actually 1,073,741,824 Bytes. So, for every 1 GB the hard drive advertised, you'll lose around 73 megabytes when the computer addresses it (without addition in formatting overhead, file systems and such)

[@markusTegelane]

Not all OSes show gibibytes. So, to be sure, you can just check the byte count, then divide that by 10⁹ to get size in gigabytes (10¹² for terabytes, 10¹⁵ for petabytes, etc).

[@JohnSmith-qz1hh]

I'd like to see a video from you explaining the difference between Garbage Collection and TRIM, and how important each is.

[@Drives31forhalo]

fun story: my office computer was running out of space with only 100GBs available on it's HDD. I was going to upgrade it a bigger SSD, so I looked into drive management work out some partitions in preparation to the new drive, it had 900 GIGABYTES OF UNALLOCATED SPACE! that computer from 15 years ago had a 1 TERABYTE HARD DRIVE IN IT WITH MOST OF IT JUST NOT ALLOCATED!

[@cooldaddyslick6869]

It wasn't a fun story.

[@Mahlak_Mriuani_Anatman]

Wtf

[@billg.7909]

Anyone else feel my pain over GB vs. GiB (or MB vs. MiB, etc). When I learned all this 30 years ago, there was no KiB, it was just KB, and 1 kilobyte = 1024 bytes because 1 byte = 8 bits. Damn Apple.

[@Zelmarked]

TechQuickie's intro poisoned our water supply, burned our crops and delivered a plague upon unto our houses.

[@Masta_Frog]

4K PS2 Games PCSX2 and other emu's IT DID???

[@minecraftmaster10100]

This should have more likes for originality

[@GMHX77]

Haven't played dink for AGES

[@phi0_]

It did?

[@SamuelBoynton]

Sigma Waffle no, but are we gonna wait around till he does?!

[@arthursmith2755]

I miss the defrag coloured blocks that used to display the amount of defragmentation being corrected. I used to watch them till the early hours of the morning.

[@Dexter101x]

0:46 partially right, but you have to realise that Windows uses the 1024 byte system, and the manufacturers state the unformatted capacity of their drives, because it isn't known what the OS the SSD is going to be used on

[@Mike6rs]

Great video, I cannot believe that You guys were able to squeeze in so much information into just 4:53 (including advert).

[@dcmk4683]

this linus-looking-guy predicted the future we are OVERPROVISION toilet paperd

[@daringcuteseal]

😂

[@pedrohenriqueboscofi]

"And speaking of extra space..." Me: "okay, here comes the square space B-roll... What?"

[@bayshore3497]

I love how you look to the right of the screen when you say something confusing

[@airborne5642]

I looked the MAC Book Air which has an SSD. Are you saying that at some point in time the SSD will no longer have space to write/save data?

[@rambit23]

"Some" *Almost 1TB*

[@kakarroto007]

Thanks Linus. That was really informative. I knew that there was a reason for the weird partitioning numbers, but now I know why. Love the format. You guys should have Jon do more Tech Quickies: maybe one a week? Loved the Dyson Sphere, cause it was on my favorite topics; science, technology, and fiction!

[@QLTD]

which is better for long term storage and archiving? SSD or HDD? if you write files into SSD once will it last for ever?

[@PerMejdal]

Seeing how almost all NES cartridges still works fine. I would go for a SSD.

[@QLTD]

that was I was thinking

[@Palozon]

Thank you for an informative video that takes the viewers seriously.

[@monday6740]

Seems like an interesting feature ... There's quite some guides on SSD performance, and few mention this function.

[@abid_hihi]

damn, so it is possible to overclock an ssd huh technology has come too far

[@albertobueno7805]

It was also possible to overclock HDDs back in the day, but it was kinda hardcore.

[@JohnDoe-vz7ff]

The first SSD I got was an 80 gb intel ssd for 200 dollars 10 years ago. It had a read speed of 250 mb/s and a write speed of 95 mb/s (sequential), but far higher random read/writes than hard drives. I just got a 1000 gb ssd for 145 bucks which has a read speed of 560 mb/s and a write speed of 525 mb/s. That's a decrease in cost per gb by a factor of around 17. Incredible stuff. My build lasted 10 years before I replaced the motherboard and CPU, and it still ran fine. This is why I suggest building your own so you can replace parts as needed.

[@korndogz69]

Another reason why the SSD is best used as your OS drive since you won't be overwriting, or moving your OS (generally). You can use one for more volatile storage, but you won't get as much longevity.

[@SeminarChauffeur]

I was agonizing over this when I got reminded of it months after I bought my ssd and is now almost full. Fortunately it was in one of those odd sizes, 240 GB so it turns out I don't need to do manual overprovisioning at all.

[@gnagyusa]

So, what happens if you later on decide to add a partition to the unused space?

[@Audysseus]

Teacher: ok class can anyone tell us what 1,073,741,824 mega bytes translates too? Kid 1: thats a gigabyte!! Random kid in the corner that never talks: unh uh that theres a darn G I B I B Y T E

[@Quickloaded]

Samsung removed overprovisioning in Samsung Magician 5.0 indicating, that they no longer deem it to be necessary.

[@ChibiSteak]

3:57 fin.

[@returo7297]

wheres the CC?

[@thatguyontheright1]

If over provisioning is a thing why not put more nand chips on the SSD to account for the lost space?

[@fartfanify]

The intro really needs some getting used to. Great video though

[@whosdr]

For 1, why there're unconventional capacities - this is likely down to the individual chips making up the SSD. Say they're manufacturered in 60GB chips. Take two, that's 120gb, take four and you have your 480gb. Eight, there's your 960gb. (Though looking into it, they probably are just nipping away at 64/128GB chips) And for point 2, showing up in lower capacities when reported by your OS, this is mostly Windows now, and it's due to the difference in definitions of GB. Windows still uses the 1024 bytes to the kb, whereas manufacturers and other operating systems use 1000. If you do a quick conversion - (1000/1024)³ x 512(GB) = 476.8(GB). I know that Seagate specifically add this extra 7.37% difference for the provision such that it really is a 512GB drive, but really any amount can be added by the manufacturer that's invisible on the OS-level for the sake of ssd shuffling as it were. So for these, I find the images and topics on this Techquickie a little misleading. (Especially since #2 will also be evident in conventional mechanical hard-drives, which don't use overprovisioning)

[@AndreiTache]

Here's the reason why many people are complaining about the intro: It's too long for the format of the video. "Ughh, but it's literally a few seconds long" - Yea, but the video is literally a few minutes long... If I were watching a podcast (~1:30h) I wouldn't care if you were plugging your stuff for 5 minutes because, guess what, I probably have the time to 'waste', where as on a fast-paced informative video that is 4 minutes I don't... Not to mention how repetitive it will get if you bingewatch a few of them one after each other... (Seriously, listen to the intro a couple of times and you'll see what I mean) "But you're just entitled!" - Maybe I am a little bit... but something like this gets *really* annoying for someone like me who binges videos and I don't think that it's that big of a thing to request that they make it an outro (which if it were 4seconds instead of 7, people wouldn't have time to click off of by the way) or at least shorten it so it's a bit better... Also, for those who are like "It doesn't matter to me" or "I don't care", you do realize that there are other people besides you in the world, right? Just because it doesn't affect you doesn't mean it also doesn't affect me. "Ahh, you milenials!" - ...

[@cmmosh]

ლ(ಠ益ಠლ)

[@johnjohnson-li1bw]

they actually saw a growth in subs since last week around when the intro was added, so yeah I do think it is beneficial. More people are going to see the intro than an outro after a sponsor and its fact, so it is the best place to put it and it clearly has been working. According to Linus 55% of watchers weren't even subscribed which is a big percentage.

[@AndreiTache]

+Rasv I wasn't arguing about the effectiveness of the intro, but about how annoying it is... If they would put it immediately after the video is over and before the sponsors, I don't think that people would have the time to click away without at least hearing part of the message... That way it will be pretty much as effective while being way less annoying for frequent viewers...

[@Dan-mj4ux]

The ad goes by quickly so it's not bad, second of all it's like less than 5 seconds so chill xD

[@xp4030]

i have a question : to increase memory, is it better to have two 8gb ddr( stick, dont know the word...) or one 16gb ?

[@miezis20]

2 sticks will work a bit faster.

[@ooltimu]

It's also true for USB data sticks. There are factory utilities that can modify the provisioning and you can increase the life and decrease the usable size or vice versa.

[@mattforbes7833]

SSD's write things into what are called pages, which are then organized into blocks, which are then integrated into larger cubes, which of course are part of the larger "binder" organization structure, which are then super imposed over the matrix stack.

[@YounesLayachi]

Does this apply to eMMC and UFS ? Do I need to keep 6 GB of my 64 GB phone empty to keep it good ? Or can I have 99% filled and no worries ?

[@nathanmead140]

I have got mine to 300 megabytes free of 16 gigabytes (6.04 used by android nougat 7.0.0) and it's fine but i would NOT recommend it because updates for apps will not download from the Google play store (butihavetheazpenstore)

[@creepersmate]

That bunker joke is now reality rip

[@drabberfrog]

Ikr

[@Mmmm_tea]

I got a question... if I run 2 operating systems from one ssd does that reduce the lifespam of the drive ? if there's always one partition of data not being used at the back end of the drive with files not seeing use? does the controller treat it differently ?

[@pixel0]

I care about my personal space. Let's step up here, and everybody get stepped up, and let's get some stepped up PERSONAL SPACE UP IN THIS PLACE! Here we go. We get a 1) personal space. 2) personal space. 3) stay out of my personal space 4) keep away from my personal space 5) get out of that personal space 6) stay away from my personal space 7) keep away from that personal space 8) personal space 9) personal space. You know, I take personal space pretty seriously. This message brought to you by Tunnel Bear. They care about personal space.

[@albertmas3752]

It could be nice if you explained the difference between Gigabyte and Gibibyte. When the industry tried to enter the International System of Units (they finally did it in 1996 or maybe 1999) they found the problem that to keep consistence with units and measures the prefixes "kilo", "mega", "giga", etc. are decimal based units meaning exactly 1000, 1.000.000, 1000.000.000, etc. respectively. Keeping their binary values of 1024, 1.048.576 etc. meaned those prefixes had different values thus would become non standard (which goes against the idea of standarization) so they decided to create new acronyms like "KiB", "MiB" etc. meaning (K)ilo B(i)nary (B)yte, (M)ega B(i)nary (B)yte...And it's the reason when you buy a 500 GB (Gigabytes) Windows says you have just 465 Gigabytes total space. Because Microsoft are a bunch of idiots and refuse to accept standards. The right form Windows should explain it is "465 GiB (Gibybytes or giga binary bytes) total space"

[@albertmas3752]

So when you buy a 500GB disk it means it has 465 GiB. In HDD and SSD in my own experience they always keep the decimal (Gigabyte) but when you buy RAM most of the times they use the GB acronym when they should use the GiB one (because it really has the announced GibiBytes). Some brands of discs (CD,DVD,Bluray...) use one or the other acronym and in my experience they use it well (for example 4.7 GB DVD equals 4.5GiB, TDK normally uses the GiB form).

[@tdrewman]

SSDs have a limited write lifetime..... Now think about all those MacBooks with the SSD Soldered on the Motherboard that have to be sent back to the factory for replacement.... Thats right, Apple doesn't repair most of the time, they tell you to upgrade.

[@woodshop2300]

You also loose space when they use chunks of say triple layer flash as if it were double or single layer flash as a write buffer cause its much faster for writes.

[@nO_d3N1AL]

Always wondered what this options was in Samsung Magician.

[@Ibnblackbird]

Linus is this also true for M.2 SSDS as well? Or just normal SSD l size and SATA format?

[@rhys.davieswork]

Thank you for asking a question i didn't even know i had!! Great work :) at 2:49

[@victorsenna5729]

I don't think that leaving an unallocated partition will make SSDs see it as an over provisioning space. Where is the source of that info?

[@GabrielTrosell]

Okey, now i gotta ask, its in all the videos with Linus, WHAT is he touching on his right hip all the time when he speaks ? is it to time-segment-code to make it easier in post ?

[@وطنپرستپاکستانی]

After watching this video. I have started loving my old Hdd

[@Blakehx]

Cool info thanks! You should do a TechQuickie episode on VPNs and how they work!

[@SpikesSoRandom]

Blakehx well

[@SpikesSoRandom]

kzbin.info/www/bejne/epm8lqSdqsuMqdU you are two years too late I'm afraid

[@Blakehx]

Hahaha, my bad... And thanks! 😜

[@xybersurfer]

i don't think the first issue is formatting overhead. it's the manufacturers scamming that 10^9 Bytes = 1 GB, instead of the proper 2^30 Bytes = 1 GB. you can easily check it yourself

[@AlpheusGibbs]

Hey can you do a video on the must have software for any pic user. You know software that is the basics that will help with maintenance, support and allow OCA user to at least stay up to date as possible.

[@kso35]

ALWAYS EXPLAINING THESE TOPICS SO CLEARLY!!!!!!!!!! THANK YOU!!!!!!!!!!

[@Jdmorris143]

Best transition in awhile.

[@The.JZA.]

So my Samsung 970 Evo 1TB shows up as 930 GB and then in the Samsung Magician software it offers to turn on overprovisioning? Does that mean it is doubling up on overprovisioning? Should I turn it off in the software since the hardware already has OP built in?

[@ДмитроПрищепа-д3я]

Nope, 930 Gigabytes is exactly what you'd expact form buying a 1 Tb drive because manufacturers are scumbags and use a technical definition of a Terabyte, which is 1000000000000 Bytes while OS uses a more common definition in powers of 2. If you do the conversion yourself, you'd see that 10^12 bytes is exactly 930 proper gigabytes(technically called gibibytes, as was said in the video).

[@call_me_julie]

@@ДмитроПрищепа-д3я Only part of that is true. Microsoft uses binary measurements (factor 1024) while falsely labelling them as decimal units. The binary units are called Kibi-, Mebi-, Gibi-, Tebi-, Pebibytes and so on. The bi stands for binary. Almost only Microsoft does that wrong. If I remember correctly ThioJoe made a video about that. Linux for example lets you choose between the binary and decimal units most of the time but always uses them correctly. Manufacturers are using the units correctly.

[@ДмитроПрищепа-д3я]

@@call_me_julie That's exactly what I meant when I said "technical definition". They use them correctly, but not because they like to abide to standards, but because it lets them make smaller drives and trick customers that don't know about this little technicality.

[@lui6link]

Love these vids! Never knew!

[@dfitzy]

Ok, I saw the stream about the intro and with that in mind I would suggest shortening the subscribe bit, I find the enable notifications bit drags the intro out and is a bit clunky. Maybe just "If you like this please subscribe" and just visually suggest the use of the bell icon.

[@billyhatcher643]

i have a new intel ssd that i got for christmas last year and im loving it

[@ALFABETAS999]

0:09 yes i notice annoying ads in beginning and end of video.

[@ClayMann]

Great Techquickie. I'd like an episode in the future on how you can turn off the part of the video that asks you to sub if you already subbed. I'm kinda shocked KZbin hasn't provided a solution for that already. Like when you go to a channel you're not subbed to, the channel can play you a welcome video but once you are subbed, that welcome video doesn't play. Why can't we have that same idea applied to every video. Where you have a subscribe/press the bell clip that gets attached or prefixed to any video where you haven't indeed subscribed/belled but that clip goes away once you are. Another step for KZbinrs but one that I think the audience as a whole would really appreciate.

[@amanbeerkhanduja6490]

What software do you guys use to edit your videos?

[@SpikesSoRandom]

Amanbeer Singh I recall seeing Adobe Premiere Pro being used in their vids.

[@TheDarmach]

Can never controllers (i.e. samsung 970) use partitioned but free space as OP? I had read somewhere this, but can't find the info now....

[@malcolmholmes2596]

I'm tried but Samsung Magician is not letting me. I tried using windows partition tool to shrink my partition but it only let me shrink it by 9GB for whatever reason (I have around 1300GB filled up atm and still a lot of free space.) I'm in the process of freeing 600GB to another drive to see how much further i can shrink the partition on my ssd.

[@aikensource]

I had no idea. This answered questions I didn't know I had. Awesome video, and very tech quickie. Thanks lmg x)

[@cmmosh]

ლ(ಠ益ಠლ)ლ(ಠ益ಠლ)ლ(ಠ益ಠლ)ლ(ಠ益ಠლ)ლ(ಠ益ಠლ)

[@Ahmed-sl3mk]

Do a video about the The Life Reckoning Checksum Error

[@sklynexd]

That's an awesome feature!! Found out now in magician sw for my samsung evo ssd. SSDs should do that automatically!

[@deejay9730]

To send or not to send an error report? It's an easy to google but a Techquickie of it would be cool

[@bipbong2906]

When I head The intro I went to hit skip ad and realized it wasn’t an ad :(

[@mihaineg5605]

And part of it may be that on the box there are gb(gygabytes) and windows measures in gigibytes which are really close to gigabytes only bigger.

[@samulai]

I LIKE THE INTRO, IT GIVES A PROFESSIONAL VIBE or something like that.

[@WarriorsPhoto]

Good video. This was some valuable information and I was wondering what was going on.

[@andrewmccauley6262]

@Techquickie / Linus: I thought the differences shown between the bytes and the GB (at 0.42 and 0.52) were just because of the difference between KiB and KB, with one using 1024 and the other using 1000. Divide the numbers by (1024)^3 and they'll line up correctly.

[@Eggs.]

For some reason the SSD in my computer actually did the opposite of overprovisioning by adding .11 GB of space. My SSD was advertised to be 512 GB, but it is actually 512.11 GB.

[@drabberfrog]

You must have won the nand flash lottery

[@Eggs.]

@@drabberfrog yep I must have

[@jojolamont-charles6658]

Can you explain what causes windows to share your ram with your gpu? And have it listed as hardware reserved and any fixes for this?

[@TheQuestionmarkstudi]

I learned something today, yay! :)

[@axeli88]

Excellent explanation! Congrats!

[@fabianmendoza61]

This is the techquickie we all know and love

[@tyronenelson9124]

The fact that ssd drives have a limited lifespan puts me off ever buying one

[@notmuch_23]

Finite read-write cycles is the reason I want to stick with magnetic hard drives at least for OS storage as long as Western Digital and/or Seagate will make them.

[@reoencarcelado5904]

@2randomcrap3: The crappy part is that they (ie. hard-drive manufacturers) are intentionally making them crappier (secretly changing ALL-of-them to Shingled-Magnetic-Recording method, for example) to move-over everyone (by force) to SSDs :-(

[@onimuchingon1]

Did they change mics?

[@Surkrem]

I was a bit sceptical at first, but the new Intro is growing on me.

[@DusteDdekay]

Harddrive manufactures report the capacity is GB (Giga bytes), which is 1.000.000.000 bytes. While the operating system reports the capacity in GiB, gibibytes, which are 1.073.741.824 bytes.

[@martinsalko1]

Some nand flash memories allow page, or even byte erase, but it takes too much time to erase it this way, since this essentialy makes it an eeprom. Also these cost more..

[@spartemex2784]

Link to software that could help you overprovision?

[@VetBodGaming]

I liked this video just for the explanation of GiB. Also as someone who works in the storage industry this video is well done.

[@sathiyanarayanan688]

Hey buddy, I got some doubt about this. since the SSD manufacturer themself overprovisioned my disk, so Is it required to leave a unallocated partition in my SSD during disk management to increase the life expectancy of my SSD?

[@brothermine2292]

The Crucial MX500 series of ssds appears to have a firmware bug that causes them to waste most of the finite lifetime writes per NAND block, which will cause MX500s to die prematurely. My guess is that the ssd firmware's Static Wear Leveling algorithm is too aggressive about trying to maintain perfect equality of write count per block, which is foolish unless Crucial wants their ssds to die soon after the warranty expires. The bug correlates perfectly with another well-known bug of the MX500 series: the S.M.A.R.T. attribute "Current Pending Sectors" frequently changes briefly to 1. You can see the perfect correlation by logging two S.M.A.R.T. attributes every couple of seconds for several hours: "Current Pending Sectors" and "FTL Background Page Writes." The log shows the brief changes of Current Pending Sectors to 1 occur during huge increases of FTL Background Page Writes: it changes to 1 at the beginning of the FTL surge, and changes back to 0 at the end of the surge. Unclear is the cause and effect: is the change to 1 a weird side effect of the surge, or does the change to 1 trigger the surge? Each surge lasts at least 5 seconds so logging every 2 seconds will reveal the correlation. Each surge writes a multiple of approximately 37,000 NAND pages, which is approximately 1 GByte: usually 37,000-ish pages, sometimes 74,000-ish pages, occasionally as much as 5 x 37,000. I'm writing this hoping that LTT will reproduce my result and publicize the bugs in order to exert pressure on Crucial to fix the bugs.

[@justincase5272]

This is why I bought eleven 2 TB SSDs, used 1 TB for over-provisioning, and threw them into a RAIDZ-3 (raid 7) array for a useable volume of 7.55 TB. It'll last forever... Yes, I'm kidding. Six drives in three striped mirrors is nearly as fast, half the cost, and hot-swappable with minimal recovery time. For home, I use Samsung Magician's Power Saving Mode (PSM) on my 1 TB SSD formatted under NTFS. PSM enables both TRIM and Over Provisioning. Very stable, and I use A/B backups.

[@lancelindlelee7256]

Can you reduce over provisioned space?

[@jeoffer]

is there an update on this?

[@NekoMimiModification]

tfw the Techquickie channel has far better content than the actual LinusTechTips channel

[@redracer2797]

thank you for making a great video! i've missed these:)

[@darksmistres]

Great video as usual and honestly new intro is no problem but I did have a question. With evo 850 500gb rapid giving read write speeds of over 5gb/s why bother with evo 960 nvme with speeds of 3.2gb/s read and only 2.8 write doesn't the industry push towards nvme ssds seems a little pointless ? Or am I just missing something ?

[@tylerweigand8875]

Is everyone seriously disliking? Is it just because of the intro? This video is seriously an informative video. Even though I already know about it this is definitely a good video.

[@jment34]

We need new ways of data storage

[@RatRattus]

can you install windows in the ram? (create a drive that uses the ram to "allocate/stay" and then install windows in it) like in 256 gigs of ram will be needed