This SSD is Faster Than Your RAM - Apex Storage X21

[@noahhallman9174]

One of my favorite things in LTT videos is Alex being worried about jank things that other people do even though he is the jank master himself. He will be worried about other people doing things and do something 10 times worse a minute later. And I am here for it.

[@simenk.r.8237]

Thats because hes an engineer. That makes him able to do jank safely, ive never seen him fail EVER hahah

[@theisaacpigg27_32]

@@simenk.r.8237 The fail wasn't in the video itself but in his Intel Extreme Tech Upgrade he mentions how he fried the DIY CPU

[@littlejackalo5326]

​@@simenk.r.8237 he's not an engineer. He took a few undergrad engineering classes. FAR from any engineering degree, and miles from being an engineer.

[@SDMasterYoda]

Alex's janky ideas are my favorite LTT videos.

[@StormHawksHD]

do as I say, not as I do.

[@raistlinmajere1000]

Linus holding a 31.000k SSD? This is going to be a wild ride.

[@krzychhoo]

At least it's not as likely to break as a hard drive when he drops it!

[@nayan.punekar]

Just say 31,0000 or 31k bruh.

[@rapidfuge]

Saying it with “31 THOUSAND” has a more ✨Dramatic Flare ✨

[@rhandycs]

Casual 31m dollar SSD?

[@v1Broadcaster]

@@rhandycs theyre foreigners and use their commas and decimals backwards and not the way of us in the land of the free

[@andywallis6154]

i absolutely love this 'we shouldnt be doing this' dynamic that these two have

[@loicvanderwielen]

I love that Alex somehow managed to bring dodgy cooling to an SSD product review

[@veduci22]

It's like watching a shopping channel... "We shouldn't use the product like this!" "Oh wow, it really works!"

[@fynkozari9271]

I wouldn't buy Sabrent ssd, unreliable storage.

[@KaizokuSencho]

Pinky and the Brain!

[@shanent5793]

"Hot plug" refers only to the switch chip itself, m.2 doesn't allow for it. The mechanical interface still has to be designed to ground the SSD before applying power and limit the inrush current.

[@metaforcesaber]

You sound like you know what you are talking about. I believe you.

[@darkdragonx650]

@@metaforcesaber About what most people's thought process is watching these vids lmfao

[@n.shiina8798]

i remember Wendell from L1T talks about this on his nvme hot swap bays video. the whole design doesnt seem to be hot swappable in mind also

[@tzshzr]

Apply for job in LTT

[@klaik30]

I think Alex did say something like this at 5:36. He didnt fully explain why it doesn't work tho 😶

[@david_sanchez]

I remember seeing something similar to this way back in the 80's. They were essentially the first SSDs. It was a board that you'd install a bunch of RAM on. Back then RAM didn't come on DIMMs. It was a bunch of socketed IC chips that looked like EPROM. Then the board would be installed in an ISA slot (it was probably EISA, don't remember). There were also no drivers. The board would present itself to the BIOS as a native storage device, kinda like how ST-506 and ATA did. The BIOS would facilitate communication between the OS and the "drive". It was a lot like MFM and RLL drives that had their own expansion cards. This was all pre-Windows and GUI OSes.

[@edgarfriendly666]

There was a similar card in the 00s that too ddr dims

[@josephkarl2061]

​@Edgar Friendly I've just ordered one of those to finish off my insane Windows XP build. I don't know how practical it's going to be, but I just had to get one 😂

[@Cyhawkx]

@@josephkarl2061 I used a 4GB Ram disk way back when. The only impractical thing was copying the program over to the ram disk before running and then remembering to copy back when done. I had it down to a script. These days I'd consider some sort of filesync program (syncthing maybe?) that handles your files to copy back/forth in more real time so you dont even have to remember the second step.

[@josephkarl2061]

@Z C The plan for the card is to have XP installed on it so Windows will run faster. The Ramdisk is on a PCI card, and even though I've been into computers for a long time now, I never knew the PCI slot will still get power even after shut-down. It does have a backup battery, but we don't get too many power cuts where I am, so I should be good. I'm looking forward to seeing what a difference it makes.

[@Argedis]

@@Cyhawkx I almost bought one of those. I remember it used a battery to keep the storage alive when shut down. It could basically fit Windows XP and a few programs lol

[@smalltime0]

I can see the utility of this. When I was still at uni (back when the fastest way to transfer data was TAs with USB keys), I worked with a professor on a project where he was using datasets that were about 32GB each, and he was having to go through about 100 to map them out. The software , which he made, required it to be loaded into memory, chucked out and recalled later. So this was on the order of 1 test per night on a (at the time) top of the range dual Xeon system. And I successfully got it up to 2 tests per night, hold your applause. Something like this would have been a Godsend. I mean, I'd have to do more work writing code, so I am glad it wasn't a thing.

[@philb5593]

I love videos with Alex and Linus. Linus loves to do things the janky way, and Alex has an engineering background, so Linus has a hope that Alec will do things the correct way, but then when Alex does thing the janky way like Linus isn't happy, but then things work out, and he's happy again.

[@sellinganja]

Fake video Linus didn't drop it once

[@revdarian]

He dropped 21 ssd's on the desk at the start! Intentionally but it counts, right?

[@timurtchanychev2174]

Lllll

[@cyrilio]

This comment was a rollercoaster ride. Completely correct though.

[@philb5593]

@@revdarian Probably empty boxes

[@ragtop63]

Pros of BIOS RAID: - More "natural" path to installing your OS on a RAID volume. - Presents the volume to the OS as a single drive (mostly only significant because of the previous point). Cons of BIOS RAID: - In almost every case, you need drivers to use the volume in your OS. This is a common pain point during OS install. - For consumer boards, it's still just a software RAID (see impact in the next 2 points). - There are almost no performance benefits in regards to CPU usage (tested this many times). - Data throughput isn't any faster than using an OS software RAID (tested this many times). - If you ever move your drive(s) to a different system (especially a different brand) that doesn't use the same BIOS RAID, you can't access the data. OS level RAIDs will always be recognized by the OS (unless you toasted your drives somehow). Do not confuse this for a list comparing hardware vs software RAID because consumer grade BIOS RAID is not hardware RAID.

[@timramich]

Hardware RAID is dead anyway...

[@williamschnl]

yeah, i'd rather use zfs raidz1. easy to use, easy to replace broken drive.

[@fitybux4664]

That last one can really screw you. "If you ever upgrade your hardware..." 😆 Almost all hardware like this will always get upgraded or break in some way. Doing BIOS RAID is very not smart. Also, if the RAID algorithm is ever slightly bug fixed or improved, you won't get those improvements, because BIOS upgrades stop being released after a few years.

[@n.shiina8798]

@@timramich for a general consumer, yes it's dead. for enterprise use, it could be beneficial since hardware RAID with write cache usually have battery backup

[@astronemir]

We run enterprise database without hardware raid. Unless 50% of drives out of -100 in all nodes go Kaput immediately, we wouldn’t even lose data, and we can always bring up from backup and re-ingest the missing data during the downtime to get back up and running.

[@timothyreeve4630]

For the VFX Editor (this may be a simplistic view) things like Baselight X where uncompressed video with native 8K raster EXRs are used outside of a Proxy workflow for finishing, the sheer size of uncompressed EXRs combined with high frame rate requests now, means your bottle neck is storage speed. There are bespoke Linux appliances that are used for review and feedback for workflows in VFX where high-speed RAID Cards are used for caching these frames. This would be ideal for this purpose

[@mattp12]

I’m not so sure. A ram’s top speed is 20 mph. How could an SSD possibly outclass an animal of such swiftness?

[@naoltitude9516]

LOL

[@giancarloraphaeldeguzman8613]

A RAM has 395hp and 410lb-ft of torque.

[@danielshimko7617]

​@@naoltitude9516😊😊

[@TH3C001]

These ram jokes are great, before I could Dodge the first one I saw a second one lol.

[@ulrichkalber9039]

Well... drop the SSD from 60000 feet, it will certainly go supersonic before it reaches thinner air.

[@DisloyalGaming]

Sabrent really going at it lately first with one of the best options for steam deck now searching out large silly projects to sponsor just to show how much progress they as a company has made is just insane. I swear haven't even heard of them till last year

[@guspaz]

From what I can tell (and some of this is speculation), they started out just selling just cheap generic adapters and usb hub type things, not being a player in the storage market at all, and then started selling some minimal effort generic reference design SSDs... Only, they chose the controller/reference design well so they were pretty decent SSDs at good prices, which managed to catapult them into the limelight, giving them the revenue to put some actual in-house design effort into the things, and now they're a major player.

[@arkayngaming727]

@@guspaz Your analysis is spot on: Sabrent entered the SSD market in 2018 and are now a reputable brand.

[@arkayngaming727]

Sabrent has been around since 1998 so they're definitely not a new company

[@WarPigstheHun]

They are the Samsung of 2017

[@WarPigstheHun]

​@@arkayngaming727 yeah I bought my first Sabrent gen 3 in 2018 or 2020(?)

[@Sptn051]

I could totally see this device being used in massive weather simulations where you need to store the values of the atmospheric conditions within individual blocks of data and need the fastest access possible to that data. Being able to store the entirety of the information contained within a storm on a single device would prove invaluable to meteorologists, especially Dr. Orr in Minnesota who's been simulating tornadoes in his supercomputer.

[@roadchewerpe5759]

I’m a met student starting in the fall and I was thinking similarly.

[@hmcredfed1836]

noice

[@davidgomez5116]

I just want this for the small form factor...

[@tassadarforaiur]

Would love to see this thing loaded purely with Intel optane drives, i.e. 118gb p1600x ngff 2280 drives. It would only be ~2TB, of data, but imagine the iops.

[@Yamagatabr]

wow, isn`t Optane dead??? I tough that mdern nvmes had surassed it

[@NadeemAhmed-nv2br]

@@Yamagatabr they haven't

[@bosermann4963]

@@NadeemAhmed-nv2br why did the project get killed off then?

[@benjaminmudd2071]

@@bosermann4963 Nobody bought it. Most consumers did not and still do not need Optane and it is a lot more expensive than normal m.2.

[@visveshnarayan7964]

They should get a bunch of P5800Xs and do it with them. Those drives are fast as hell.

[@asdf232003]

Linus is doing this for more than a decade, you would think his enthusiasm will be gone by now but no, it increased by a ton. This is why LTT is so cool!

[@Sarcasshole]

To be fair this is a rapidly changing industry. It's kinda hard to get bored of it

[@AvaaSlays_Swiftie]

@@Sarcasshole yep I was gonna say the same thing. If your in the field that requires messing with lots of different set ups you’ll never be bored. It’s quite amazing how much stuff changes per year.

[@fynkozari9271]

Why would u lose interest about something u are passionate about? I've been playing pc since the 90s, still gaming today, should I stop? I like women since I was a child, so I should change to men now as an adult? What kind of logic is that? I was passionate in science as a child, I should stop liking science now? By that logic a doctor loving their job should change their career to become a farmer, because they lost enthusiasm.

[@kanokwanphuawongphat1021]

0:47

[@HedgehogY2K]

5:10 I don't know why but I felt a chill down my spine of someone out there jaw dropping at this zoomed out moment.

[@FeTiProductions]

I'm happy this has come up as a topic of conversation. I've been wanting someone to test SSD speed to say yesteryear RAM versions like DDR3 DDR2 etc. to see if SSDs using swap files are at parity with RAM

[@SpruceMoose-iv8un]

Imagine the day when SSD's become as fast as modern ram then ram can be deleted from a PC.

[@dial2616]

@@SpruceMoose-iv8un you're not thinking big enough: you could open a game, unplug your computer, and then turn it back on and keep playing where you left off. Volatile memory holds us back from a lot of stuff.

[@katrinabryce]

Access times are about 10µs, whereas RAM is about 10ns, so about 1000 times slower. RAID improves data transfer rates but doesn't do anything for access time.

[@Anti3D-0]

Intel's 3D xpoint was the closest thing to a NAND and RAM hybrid, too bad it didn't take off

[@AndrewTSq]

it would be cool if someone made some hardware that use lots of GDDR6X ram-modules as storage, and had some sort of batterybackup when the computer is off, to keep the data. (and then running them in Raid :D

[@playeronthebeat]

I'm in love with this thing because of NAS storage stuff. Sure, this card is really expensive and might be overkill but having 21 SSDs gives you a lot in terms of fault tolerance (RAID5 or RAID6) while also consuming less space. I'm excited to see where this is going!

[@bosstowndynamics5488]

It's very cool and I would love to have one but it would be cheaper to use 4 way passive cards in Xeon W or Epyc (including an upgrade to Xeon W - the card alone is 3 grand) if you only wanted one card worth of SSDs, it would also give you better cooling since those cards have decent heatsinks

[@mtrebtreboschi5722]

You can even get 4tb crucial nvme drives at best buy for $200 right now, so i could totally see this being in a consumer media server. If a drive fails itd take like an hour to rebuild from parity instead of like a week with hdd

[@playeronthebeat]

@mtrebtreboschi5722 still, for the price of one 4tb SSD, I could get roughly two 4TB HDDs or one 8TB HDD, which, in most cases, is more than enough. But yes, you're right: with the trend being that drives get bigger, faster, and cheaper per TB generally, it'll most likely be a thing of the near future.

[@mtrebtreboschi5722]

@@playeronthebeat yeah hdds are about at least 3x cheaper per terabyte than any high capacity ssd, seagate exos drives often go on sale for $14 per tb. SSDs have the advantage in size, power consumption, rebuild time, and read-only longevity, which will all mostly be negligible for most people, but I guess if somebody has the money, this is the way to do it

[@ohlala5681]

Cool tech indeed, but at this price range you're much better (and safer) with a dedicated device for storage (like NAS or even a server lol), read/write speeds through LAN network are very good these days

[@rawexploiterp6951]

my dad says: "if more data is stored in 1 point/place, then its scarier to lose that point."

[@AnotherAustin-z7b]

Imagine being a human that can only exist in one place and time and can't be replaced. Very scary!

[@harisjaved1379]

This is perfect for data centers! I would love something like this for computer vision models! But I am sure we need motherboards with a lot of pcie lanes, like on the thread ripper.

[@nadtz]

A lot easier with u.2 or EX.x in the datacenter for hot swap and cooling. And sapphire rapids/EPYC have a lot more PCIE lanes, I.E. it already exists. Not to take away from how cool this card is mind you.

[@DFX2KX]

@@nadtz Yeah, this card is rather niche. It strikes me as something you'd use when you needed the space but couldn't use a full rack mount for whatever reason.

[@phuzz00]

@@DFX2KX The other advantage of this card is that it takes completely standard PCIe drives, so you can buy them off the shelf, rather than having to pay enterprise prices for U.2 etc. Or I suppose if you couldn't get the budget to upgrade an older server, but it had a spare PCIe slot and you wanted to really spice up it's storage...

[@runforestrunfpv4354]

​​@@nadtz E1.L doubles a neat intruder protection.

[@lescobrandon3949]

Its definitely not good for enterprise use tbh. Those drives only have like 3800 tbw rating

[@QualityDoggo]

the insane part is how much of a "great fit" and "bargain price" this could be considered for high-end enterprise and workstation systems working on big datasets. This density of performance and storage without "custom" drives is unrivaled

[@username8644]

Machine learning is definitely going to be a big use case. Even sample datasets we use, given for educational purposes and are not meant to be very challenging , are easily 500GB in size sometimes. And they relatively small datasets since they really do not have that many different variables. Now imagine having to handle literally petabytes of data.

[@Foiliagegaming]

You know this just makes sense having cards like this with chips that can handle all of this. I can not imagine how much this could help once pcie 5 really starts to come around in the data center. If they come up with a card to be able to double the amount of drives using pcie 3 with the same card effectively that would keep more out of landfills long term. Love this techy

[@nadtz]

You are much more likely to see ex.x or u.2 in datacenters. Imagine how much fun having to swap one of these drives out would be compared to walking over and replacing the drive sled with the blinking light.

[@MostlyPennyCat]

​@@nadtz That's just an engineering problem though, I could imagine seeing a drive sled that contains 4 mini sleds (I name them Slugs™️) each with their own sub blinky blink.

[@nadtz]

@@MostlyPennyCat Not exactly sure why when the solution already exists.

[@Neoxon619]

I was actually expecting something jank when Alex showed up, but just 21 SSDs on a PCIe port surprisingly tame. With that said, I wonder how much of the performance would be retained if this SSD was used on a PS5.

[@ethancrawford197]

Alex and no jank? I’m disappointed Edit: got to the cooling part. I am now satisfied.

[@Simon_Denmark]

How would you even connect it to PS5? It’s not like you can throw a riser there. Or do you mean If Sony used one?

[@DLTX1007]

@@Simon_Denmark M.2 to PCIe risers do actually exist... you just need to figure out a way to power them

[@notme222]

I can tell you wrote that before they got to the cooling section. 😅

[@AGRACUTA]

Think he meant just one of those Sabrent ssds not the whole pair card

[@glassby5882]

Imagine watching this video 10-20 years from now, and you can fit that amount of data in your pocket. Tech is so wild, I'll never get enough.

[@testbenchdude]

Man, I remember back in the day running two of the smaller Raptor drives (32gb?) in Raid 0 and just loving life. I may not have had the best graphics card or processor, but I loaded into BF2 faster than any of my friends for a while. What a time to be alive.

[@BNEA02]

Always first to GET TO THE CHOPPA, remember.

[@hexacetat]

I was so proud of my raptor. Better days.

[@sim2er]

My raptor 600 is still going, but I use it as a temp/cache drive because I'm afraid it might reach EOL at any time

[@Romess1]

My colleague had one and I remember my ignorant brain saying 14,7GB 15k SCSI drives in RAID are better. Never mind the 2K setup costs.

[@David_Quinn1995]

its crazy to think just a few years ago Sabrent was the "try it if you want" brand I bought a 240gb drive probably 5 years ago and I was skeptical but damn they are on my list of good brands for M.2s

[@Argedis]

What are your thoughts on TeamGroup?

[@TechProFury]

@Valor_X teamgroup is not bad. I think they are similar to silicon power, but still a little early i think. May be better.

[@passmelers]

my sabrent drives died within a year. WD is better.

[@isaacbejjani5116]

​@@passmelers samsung is the best

[@n.shiina8798]

@@isaacbejjani5116 nah. hynix, micron and intel are the best at least from my opinion. idk about their consumer grade SSDs but some of Samsung's enterprise SSDs are just.. problematic. early PM863, PM883, PM1733 seems having issues with its firmware

[@uncommonsense360]

18:30 The Anthony phone-a-friend lifeline is my favorite thing ever

[@herbertjackson7225]

i miss him

[@JordansTechJunk]

The X21 is more than just a one-trick pony. The M.2 slot supports a number of other devices. For instance, you could use wireless cards with M.2 A+E converter boards to set each wireless card to a specific wireless channel for spectrum monitoring. There’s even an AI angle here. A company called Axelera makes an M.2 AI Edge accelerator module that could be used by the Apex card at some point as well.

[@puerlatinophilus3037]

Or the Coral TPU could also fit on this. *Slaps top of card* This bad boy can fit so much AI processing

[@Versuffe]

I love how we can just mess with funny brain replicas for shits and giggles

[@JordansTechJunk]

@@puerlatinophilus3037 we have one of the other 2* and are looking at those accelerators in it right now.

[@luminatrixfanfiction]

@@JordansTechJunk Meanwhile, here I was just thinking of using 21 Asus pce-AC88 wireless cards to pci m.2 adapters and running all 21 wireless cards in parallel for a grand total of a theoretical internet speeds of 44.1 Gb/s upload and download. Do you think that's too much RF radiation? 😁

[@jerryandersson4873]

​@@luminatrixfanfiction I who know nothing really, could speculate about interference making it not work. Not good enough anyway. But then again, with the right hardware and software that may not be a thing to worry about, I am simply speculating.

[@the_ratmeister]

We finally found a use for the Radeon VII: A measuring stick

[@ElFlacoCs]

Bro could have 66,945,606 (66 million) copies of the original doom

[@cropro4019]

Underrated comment

[@stephenlightning3023]

Sheesh

[@RSBickAKaby]

Thanks SABRENT for making this happen!

[@Soraviel]

They don't care about you 😂

[@RSBickAKaby]

@@Soraviel True but I got to watch a cool video for free so I'm not complaining

[@ownedmaxer607]

@@Soraviel forgot to take your happy pills again?

[@NonsensicalSpudz]

@@Soraviel true in more ways than one, their customer service is bad apperently

[@davidawaters]

I could see this working well for engineering simulations (FEA, CFD) that are effectively limited by the amount of ram that you have. Before something like this, maxing out the ram and letting the solver use the hard drive would increase solve time by something like 10x.

[@jeschinstad]

But you would most likely use DCPMM for that because it has much lower latency. You could probably use this for some kind of custom swap in some cases, but at some point there's diminishing returns. The advantage of this card is that it's compact. There are systems that have lots and lots of u.2 connections and can support far greater capacity and speed.

[@DigitalJedi]

The newest simulation machines where I work are for chip cooler simulations. They use CXL RAM as a layer between the SSDs and RAM. We also have sapphire Rapids HBM in dual-socket for it as well.

[@radugrigoras]

This would still be slower, 25Gb/s on ram is per channel, if you are running simulations that intense I would think you would have a very dece amount of ram and be running it in 8 channel. This is cheaper for sure but I don’t think the OS is designed to use swap like that, I think it still goes through ram first and constantly dumps back and forth from ram to disk increasing your CPU usage drastically. This would however be very useful in AI training, the datasets are massive and gpus nowadays especially if you have like 4 A6000s could eat up quite a few IOPs. I would like to see a water cooled version of this, maybe they will partner up with an ssd manufacturer and offer that later as a factory assembled package.

[@jeschinstad]

@@radugrigoras: There's nothing particularly special about this. It sacrifices speed for compactness is all. So it's great for a system with few PCIe lanes or systems that need to be small. There are very few situations where this is something you'd even care to have.

[@davidawaters]

I haven’t done this kind of work since 2013 (finite difference simulations on a 192gb, dual 8 core Xeon machine) so I’m guessing things have changed and gotten better in that time span.

[@LearningandTechnology]

This would be great for a Virtual Computer center - I’m biased towards education - having Lab VMs available on demand across a LAN would be fantastic. I’m only part way through watching as I post this, but I would be very interested in IOPS on a new heavy access load. Aaaaand… you didn’t let me down! You did the IOPS. Writes in a RAID will always cause a performance hit (especially because you won’t be able to use single parity bit and will incur extra cost on >8TB - which this definitely is!), but if I was using this it would be for VMs and Data with a heavier READ profile and it would be pretty cool.

[@Enclave.]

I always really love Alex's solutions, they're why I always get excited for a new video with him in it.

[@SuperHaloman22]

Those chips are used quite a bit in NAS and storage backups in my enterprise environment. Dell Avamar and Isilon units will connect to switch fabrics with those chips. Very fast stuff!

[@Thalanox]

I've been looking for some solutions for backing up my personal files and media collection. Can you recommend any resources that will help me do that? I have older stuff on old nearly-dead HDDs that have been removed from their systems, but that's clearly not a comfortable, current, or reliable storage method

[@MaxC_1]

@@Thalanox why not just build a NAS using TrueNAS or just ZFS as a base. It's very well documented, easy and can be run on a old system. Just grab a bunch of used certified drives, and a old PC and swap the power supply for something decent and done pretty much. Set up a RAID array and put the files on it and call it a day. Drive fails? you're still covered

[@BozesanVlad]

@@Thalanox electrons escape gates, so... keep using you backups on SSDs

[@deepspacecow2644]

​@@Thalanox If you want something enterprise grade get a dell r730. It's older, but will do pcie bifurcation and supports nvme

[@77kgggdkp]

14:07 (insert meme) when your ssd is faster than your ram memory...

[@ezrapierce1233]

13:49 there is something so hilariously silly and simple about Linus using cardboard in a cooling solution.

[@runningmelon3257]

Sabrent just asking for a shoutout and casually sending that many 8TB SSD over is a big W move! They truly support Linus craziness and we all benefit from it! :D

[@twocows360]

16:15 if i remember correctly, when task manager says a disk is at 100%, that just means it was being actively written to 100% of the time since the last tick that it measured.

[@nicknorthcutt7680]

Just imagine how insane the amount of storage you'd have with multiples of these! Its crazy that with only a couple of these and you're already at a petabyte, and in such a tiny amount of space. Crazy.

[@YounesLayachi]

12:25 55°C is apparently the sweet spot for nand flash, it doesn't like being colder or hotter Colder = increased data retention, write wear Hotter = increased hardware degradation

[@pandozmc]

Anywhere I can read up on that?

[@YounesLayachi]

@@pandozmc I think I first read this on a EKWB site but now I can't find it. After a bit of googling I found this anandtech article from 2015 back when SSD data retention periods was becoming a concern. I should note that my memory isn't quite accurate, so if you do look this up feel free to ignore what I said in previous comment. here's what anandtech says : _The conductivity of a semiconductor scales with temperature, which is bad news for NAND because when it's unpowered the electrons are not supposed to move as that would change the charge of the cell. In other words, as the temperature increases, the electrons escape the floating gate faster that ultimately changes the voltage state of the cell and renders data unreadable (i.e. the drive no longer retains data)._ _For active use the temperature has the opposite effect. Because higher temperature makes the silicon more conductive, the flow of current is higher during program/erase operation and causes less stress on the tunnel oxide, improving the endurance of the cell because endurance is practically limited by tunnel oxide's ability to hold the electrons inside the floating gate._

[@doctorvondoom6368]

Alex videos are always amazing and the best part about them is the jank engineering

[@Zarrx]

If you asked me 15 years ago where storage speeds could be I wouldn't have guessed this fast... It's hard for me to be super excited because I feel like the consumer application isn't really there... but the use case in cloud computing will be huge and we'll see it's affects in our services. It's interesting how obfuscated this technology is for general consumers even though we'll all see benefits.

[@Argedis]

I remember being impressed when early Sata 2 SSD's were breaking 200MB/sec read speeds and people would Raid 0 them for 400+MB/sec I'm still super impressed at my Gen 3 NVME 3,500MB/sec speeds... how far tech has come

[@isaacbejjani5116]

​@@Argedis yea, Gen 4 drives are so fast nowadays that there's really no reason to raid 0 for most people

[@johntoto5496]

Server motherboards already have a fak ton of ssd slots built-in. I built 2 servers like that 7 years ago with 10 Intel sata ssd (consumer grade) for my job. I don't remember the exact performance (probably 10 x sata speed) but it was insane for the relatively low cost. We put 40GBps network cards and a 40GBps switch between them and built one storage array spanning the two servers. It was a proof of concept for a cheap high availability hyper-v cluster. Good times.

[@lolmao500]

Yeah we need this in consumer hands. FFS I still have 2 mechanical drives in my computer and like 5+ HDD for storage because they have big capacities and cheap... even if way slower.

[@edwardkostreski6733]

Linus: I will suck on your toes for this many drives. Sabrent: Send it! 😂

[@Andytlp]

Yvonne would get jealous no way jose

[@fernandillobarros]

Gracias por agregar las pistas de audio en diferentes idiomas! Veo los videos hace tiempo y me gustan pero no se ingles y hablas tan rapido que los subtitulos de youtube no logran traducir 😅. Ahora puedo disfrutar de los videos al 100%

[@LanceBryantGrigg]

That is insane. As a database engineer I want one of these things.

[@JayzBOT]

Clicked on this video so fast that even the SSD couldn't keep up 😅

[@eshankanish1874]

First

[@Sup_D]

The Ads made me slow.

[@handlemonium]

Faster than a Honey Badger I gather

[@AaronJLong]

Over 10 years ago, before discovering Netflix back when it was good, I would be asked by my family to, find, and host entire seasons of their favorite shows as well as some of their favorite movies. I used to spend ages burning custom DVDs, but we were in the future with a 1080 HDTV and our Xbox 360 could connect to my PC using windows media center turning it into an HD streaming home server on the side. This meant a lot of time downloading overnight, and my 1TB-ish hard drive with more storage than I thought I would ever need was starting to actually visibly fill up, as I also had many multi-gig games as well as rips of the disc images for easily swapping into an emulated drive without swapping/scratching physical media, meaning my physical games needed space for the install and ISO, as well as gigabytes of music in my "My Little Pony Fan Music/Remixes" folder alone. Basically it was a well-loved PC that I volunteered my extra space to turn into a windows media center HD video streaming server for my family on the side. Now Netflix doesn't have all of the good shows anymore, and it is so expensive and inconvenient to be able to stream all of the shows you like as you juggle tons of account credentials, and it is getting harder if not impossible to have an ad-free experience no matter how much money you throw at them. So what if I wanted the entire library of every good show and movie stored locally in HD, or even 4K as we just upgraded a few months back? I don't want TV myself but I doubt the streaming services or our ISP are letting us stream much if any 4K content despite us having the fastest internet package in our area and I purchased a 4k streaming capable router last time we needed one so we could be 4K ready when the time came. Well, acquiring thousands of hours of TV and movies in the best quality available is its own beast, but should I ever win the lottery at least I know there's a product that can theoretically work with a home machine, with a modular nature so extra storage can be added as needed instead of having to buy a larger drive and copy the files from the old one, and also doesn't require that you buy $30k+ worth of SSDs up front and just add more as needed. Basically, if you're willing to spend your time ripping a massive collection of 4K blu-rays and whatever else it takes to get your hands on every episode of every show everyone in your household loves, and the movies too, in the highest quality available, you can make your own media server with no ads or switching between 3 different services to watch every Star Trek series and movie. No "we can't watch this because my parents in the next state are on the account right now" It would be a huge money and time investment to get the card, drives, and all of the media, but it is a lot more technically feasible now to have your own HD/4K media center just by adding an extra card to a regular PC.

[@SpeedyMckeezy]

Love it when people go "hey! that's a bottleneck" to setups they will never have and could never afford

[@pascallaforge375]

I could probaly see a card like that for bio-informatics use case. Wholegenome sequencing datasets can be multiple TB of data, a card like that would 100% speed up analysis of such masive amount of data

[@Wolfz_Gamer]

8:50 ah yes the classic “we don’t wanna break this part… I’m sure we got a cheap one somewhere”😂😂😂

[@anthixious]

Linus: "Under normal circumstances, you wouldn't do something dumb like configure 21 drives in a RAID0" Also Linus: Heh heh, you wanna do a RAID0? This product is bananas, I'm gonna have to watch this vid a few times more.

[@ryozukojima]

I love how they included that clip of shocking hardware to test if it can be killed while Linus was holding it with his thumb on the slot contacts. You just know someone had commented how he was going to zap the board. Edit: oh man, this just reminded me of something I had back in the IBM XT days. Back then I had a 20 mb hard drive built into an ISA card, aka a Hard Card.

[@lordcorgi6481]

I had thought of this when SSDs first came out. I thought to myself, what happens if storage drives become so fast that they make RAM obsolete. Being able to just read and write information straight off a storage drive has to be faster than going through a RAM middleman.

[@andrewcore7672]

Well it could be done, however you would need to do "SSDRAM" changes fast as write is the death of the ssd. Depending on workload etc i think in a year you would need to swap it.

[@sune9578]

The reason why we don't have SSDs replace RAM is that it's a little more than just raw read/write speed. Those reasons are latency and longevity, both of which are affected by how data is written to SSDs. With that said, I'm sure there are highly specialized computers out there that don't have RAM and just use HDDs/SSDs, but they certainly aren't common to consumers.

[@username8644]

That's not how it works. The closer you are to the cpu die the better. That's why cpu cache exists, which is essentially "ram" that is located as close to the die as possible. For example, the time to reference L1 cache is 0.5ns. The time it takes to reference RAM is 100ns. That is an absolutely massive difference. You can't only look at raw speeds, you need to factor latency. That's why lower memory latency improves memory performance even if raw speeds remain the same. Often a decrease in latency is much more significant than raw speed.

[@PiotrekR-aka-Szpadel]

just to be clear, bios raid limitation does not matter for anyone in professional space. Raid is basically broken for anything serious - it can detect if drive is dead and then migrate to spare one (in case of something like raid5) but the issue is when drive is not yet dead, it's failing - in that case it might corrupt your data. that's why for any serious data storage you want to use something like ZFS so it's able to check checksums of your data and detect that something was corrupted on drive and fix it on the fly what would be also useful use case that such amount of iops? ZFS deduplication, that required to add another layer before accessing data -> you want to get data block X, then you need to read from deduplication map, and get read addres for data Y and then access that data. This basically halves amount of IOPS you can do (assuming no cache hits in memory) that's why it's not used that often. In this configuration you could get a much more effective storage when expecting duplicated data

[@THE-X-Force]

I haven't built a computer in 20 years .. and I feel like I know absolutely nothing now.

[@AlexeiDimitri]

Well, Linus guys fall for this shit some years ago... search on channel "Our data is GONE... Again - Petabyte Project Recovery" They Rely solely on ZFS to handle disks and they lose.

[@Bob-nc5hz]

The AI thing does make sense especially when combined with DirectStorage-type tech.

[@MrNoipe]

it doesn't, because most datasets are precomputed and cached

[@eadweard.]

​@@MrNoipe How does being precomputed and cached negate Direct Storage benefits?

[@ryanthompson3737]

​@''/ad cached.... you mean stored on a massive bank of drives? Beyond that, there's still computing in order to mesh data together to create something new... this is where quick access storage helps. Being able to access multiple pieces of data quickly means you're only limited by computing resources, not storage resources which tends to be an issue.

[@affegpus4195]

​@@MrNoipe it makes sense when training the ai

[@rangefreewords]

That commercial chiller that you have for your lab should be used with this on a milled cooling block just for this application. See what you could do as far demos go. You might be able to see those numbers climb higher.

[@rakeau]

Would be nice to see a scaled down version of this, for those who want this kind of thing but without quite so much cost or overkill.

[@Torbjorn.Lindgren]

The primary use for these PCIe switches are actually in servers - when there's lots of SSDs in a server backplane they're sometimes connected directly, but often there's one or more big PCI-e switches driving the slots. And each switch will have a 16x or 32x (yes, this is a thing even if the standard only lists up to 16x) PCIe 4.0 or 5.0 uplink. This is the real reason why PCIe link speeds are again trending upwards quickly after a long hiatus (between 3.0 and 4.0), there's finally a user (servers) that are willing to pay for development (there's not enough entuast to pay for it by orders of magnitude). And I assume the reason the card doesn't have any fans is because they expect it to end up in servers where there's a large amount of airflow provided by the server itself (sometimes capable of cooling 400W GPU or AI accelerator with just the servers airflow, no fan on the card. It's also unfortunately why PCIe switches disappeared from consumer motherboards (many early SLI motherboards had them), the PCIe switch vendors jacked up the prices by 10x because most were sold to server vendors and they were willing to pay. "Better" (IE expensive) server backplane often accept PCIe (U.2 or U.3, both 4x PCIe), SAS (12Gbps) or SATA (6Gbps) in all slots by routing each slot to either to the PCIe switch(es) or the SAS switch(es). Yes, SAS switches offers all the same features (fabric, multiple servers, dynamic load allocation to the "uplink" and so on) to both SAS and SATA disks, they've been in server backplanes for a long time (long before PCIe SSDs were a thing, never mind M.2). It does makes me wonder if some of the PCIe switch chips also does SAS, that would reduce chipcount and make routing far simpler which means they can ask the server builders for more money...

[@bosstowndynamics5488]

As far as I can tell PCIe has been getting faster at a pretty consistent rate for many years, it's just Intel was a laggard in going to PCIe 4 so gen 3 was around longer and by the time they were on gen 4 we were already close to gen 5. If you look at it in terms of AMD instead gen 4 was around for plenty of time.

[@Torbjorn.Lindgren]

@@bosstowndynamics5488 No, 4.0 was seriously late. The official introduction years is 2003, 2007, 2010, 2017, 2019, 2022, (2025 planned) for 1.0 to 7.0 (check official graphs or the Wikipedia article). Note how they all are around 3 year, except one that took 7 year - that's the 3.0 to 4.0 transition and it's a big outlier.

[@BrunoSR1985]

You guys are doing the kind of thing that I always wanted, but never had the money

[@MikkoRantalainen]

Having two of those cards, each RAID-0 running as a RAID-1 would be pretty much perfect setup for a big database server. Combine those cards with say 1 TB of RAM and you can execute huge queries very rapidly against a 100 TB database.

[@AmaroqStarwind]

You might need a lot of CPUs or GPUs as well, to actually move all of that data around.

[@AmaroqStarwind]

Or perhaps those newfangled Data Processing Units, whatever those are.

[@PuppetMasterdaath144]

fart hehe

[@exorr81]

That's called RAID-10 😂

[@MikkoRantalainen]

@@exorr81 That's true. I explained that as a combination of RAID-0 and RAID-1 for two reasons: (1) RAID-0 and RAID-1 are easier to understand for most people than yet another RAID mode. (2) If you configure such setup as RAID-10 directly, changes are higher that you mess in a way that causes the whole RAID to be offline if one of those cards fails. (That is, you configure stripes and mirrors incorrectly over all 42 devices.)

[@Wayhoo]

Thanks to you Linus, I'm building my first PC this week!

[@GoldRaven-oe4by]

Imagine using this as vram

[@lurick]

Now if only Optane was still around! :D

[@DraggardArcane]

Oh Linus not the TOES! 2:25

[@jacobgames3412]

😭🙏

[@ChairmanMeow1]

This was a year ago and Linus was right. These cards did catch on a little, and they work. I put another brands PCIe 4.0 card in an older computer, stuck 2 M.2 drives on it, and it works great. I cannot tell they're on a PCIe board and not on the mobo. Worked great!

[@DmnkRocks]

On the Topic of Hot-Swap M.2: This feature must be supported by the Controller AND the SSD - and the Crucial P3 in the test does not support that. Through my personal testing, I've found not all hot swap feature on M.2 is the same - its basically a hit-or miss (for me at least)

[@eDoc2020]

I thought by the nature of its design all PCIe device chips need to support hotswap. The hard part is power switching and mechanical considerations which make m.2 unsuitable.

[@ryansather8851]

honestly if this gets affordable for the average consumer, this could be an absolute game changer for any system and game developers

[@jacob_90s]

13:30. There are brackets you can buy that let you attach pc fans to them to blow on cards in pci slot. They would actuallyvwork really well for this particular set up

[@bkucenski]

I was going to get a 2nd Synology and put 8TB SSDs into it. But it looks like m.2 storage is being taken seriously as an option for RAID. I'd much rather go with NVMe if it can be a comparable price.

[@Guru_1092]

Probably one of the more interesting videos as of late. Clearly I need to do more research on SSD tech, PCIe, and RAID. This kind of went over my head at points.

[@mcxgaming7341]

me in the back when my friend is talking too much 8:18

[@andreas7944]

@SABRENT I bought one of your SSDs recently. I am usually brand focused and I did not know your brand before I saw several LTT videos with them. I just wanted to let you know, that your sponsoring here actually works :)

[@Nerex7]

I'd be hyped if there was a budget version of this. You can get a budget 1tb ssd for ~40€ currently here in Germany, the only issue is I only got so many m.2 slots. This thing would solve that problem.

[@laboulesdebleu8335]

try this: ‎B07T3RMFFT -- should do the trick

[@MostlyPennyCat]

Turbo budget version, it's just a pcie to four m2 slots card. No logic, just wiring

[@MostlyPennyCat]

Yep, just looked, they're already on eBay for about £25

[@MostlyPennyCat]

About £50 for a 1tb crucial nvme M2, are those considered budget drives or middling?

[@tab8k]

Those ebay cards need the mobo to support bifurcation, so not the same thing as this Apex card that foes not.

[@ohyeah117]

Uhhh... I'm sorry did I just see a Leather LTT backpack?? @9:07

[@ImSenzoku]

Me: *buys one SSD* Linus: *buys a pcie SSD card the size of a graphics card*

[@Xenoray1]

cost: close to 30 nvidia rtx 4090

[@lilkidsuave]

Linus's face when Alex mentioned chia mining 😂😂😂

[@erockvaughn2190]

First thing I thought of was for video editing. A feature film at 8k raw can take up massive drive space and if you collaborate on a project this would be ideal. At about 8 tb's per hour of raw footage this would be ideal.

[@juhajuntunen7866]

Some 30k USD in movie budget is minimal investment. And it still exist when film is done.

[@8-bitcentral31]

Finally a solution to the 2GB DDR2 ram dilema. (you can only have max 4GB on a 2 slot moteboard)

[@jeschinstad]

DDR2 is still much faster because it has much lower latency.

[@hubertnnn]

@@marcogenovesi8570 Wait, why is anyone using DDR2? Does DDR2 have any advantage over DDR4/DDR5 that I am missing?

[@jeschinstad]

@@hubertnnn: I have some old systems running with DDR2. Work just fine. :)

[@hubertnnn]

@@marcogenovesi8570 Ok, I thought by "more recent" you meant, that they made a new DDR2 last year

[@Atsumari]

I think this could also be used for high output high input AI data processing.

[@MostlyPennyCat]

Yup. Especially with the new GPU direct read/write stuff, I forget what it's called.

[@vasiovasio]

Yes, in many ML applications :)

[@CR0Z]

wonder how long you would have to leave that puppy mining xch to pay for itself lol

[@angeldelvax7219]

I would LOVE to have one of those in my dev computer. Imagine the gain! Developing 3D games / VR / AR applications can take up a LOT of storage space. And compiling / rendering needs to read / write as much data as the CPU / GPU can handle. Add project management / version control, and both capacity and speed of a card like this become VERY interesting indeed! Of course I can't afford even a basic dev system (not even 4.5K euro), let alone add this card XD

[@3dchick]

I know! It makes drool. I caught myself considering selling my car, 😂

[@giusn]

Well I literally just attached 8 NVMe 2TB drives to my ITX server. I bifurcated the x16 gen3 slot into two x8 slots using bifurcation. In each slot I placed a PEX 8747 board carrying 4 NVMe cards each. Prices of 2TB drives really went down recently. They finally are under $100.

[@Neopopulist]

Where can you get a 2tb nvme for under $100, what brand if you don't mind me asking?

[@giusn]

@@Neopopulist my comment got deleted. In summary, Silicon Power.

[@nomisukeindustries]

One of three in existence... Linus: "I'm assuming we have to send this back, eh?" Alex: "I don't know."

[@danhenton1978]

Great video, would love to see more affordable non-Bifurcation options like the highpoint for comparison. Also thanks for the linux testing as well! Some of us don't use windows 🤣

[@jakobpavli2646]

how to build worlds most expencive toaster :D

[@chrisa405lp]

Your videos are really awesome to learn about hard and software. I found alot of interesting stuff in the internet when you were throwing words in the room from which i often never heard of and then made me google it. Keep up the good work

[@phizc]

It's faster than _a_ stick of 3200MT RAM. Not 2 sticks as you would use in dual channel. As for SLC cache, the Rocket 4 8TB has around 880GB of it per drive, so yeah, if you have 4 drives it'll slow down after you've written 3.5TB, but that's an awful lot of data to need to write at ~24GB/s. That thing still is insanely fast though.

[@benitollan]

2:25 "I would suck on your toes for this many drives" don't drop yourself like that Linus 🤣🤣 PS: these jokes come exclusively from love and admiration -please don't drop me from your channel- .

[@benniwd2077]

A PCI 5 Version would be very nice

[@seven7000_]

Finally something good enough to store my homework folder! 😅

[@larsjrgensen5975]

It sound like it dynamically routes pci to where it is needed, It is super cool that it is possible to run any 4 drives at full pci speed or 8 cheaper slower drives at their slower speeds at the same time. Onboard raid controller could be perfect, so that the pci bandwidth only needs to transfer to the drive controller and the drive controller does the mirror instead of using pci bandwidth to mirror.

[@infin1ty850]

I bought a 1TB Sabrent for my Steam Deck, and it has been great. I'm curiously about why the help the brand has exploded in what seems like less than a month. If the card ends up maintaining its functionality for the advertised lifespan, I will be extremely happy. I just get the "too good to be true" vibe from their products.

[@OdisHarkins]

Still running my Rocket 3 years later, they make a nice drive!

[@infin1ty850]

@@OdisHarkins when it comes to data storage very rarely gone with any company that wasn't a "household" in the US. I am still very impressed by the performance I've been getting out of the card so far.

[@xamindar]

It's not like their drives are the cheapest out there or anything. So no reason they would be "to good to be true".

[@bosstowndynamics5488]

​@@xamindar Plus they're pretty much just a Phison controller paired with name brand NAND. Hard to make a bad drive when all the hard parts are outsourced to experienced third parties.

[@Hortifox_the_gardener]

I want to see it with 21 Optane modules. Not for the balls to the walls throughput but the IOPS, low cue depth power and latency.

[@sebbes333]

8:42 Hot Swapping SSDs feels like Star Trek Isolinear Chip stuff. :D (How they "program"(?) something into the chip & physically plugs it into the star-ship or system it will be used in 20:23 )

[@BD-8171]

couldn´t you use an integrated GPU and then use the leftover slot to use 42 ssd´s total?

[@nabilthecheater956]

$62k ☠️

[@firenado4295]

I wish there was a small version of this with 4 drives so I can put the drive in my second X16 slot that doen't have bifurcation and is actually only wired for 8x. I hate that mobos give you slots that dont allow you to use all of them cuz using sertain slots disables bandwidth or the entire connection for other slots.

[@nadtz]

4x m.2 cards with switches exist, they just cost a lot more than the ones that work with bifurication.

[@firenado4295]

@@nadtz yeah that sucks but then that is cheeper than a new mobo these days that have more than one full 16x slot. I was looking at a sata card that takes 2 2.5" drives that screw right on the card but its only pcie gen 2 1x meaning that if you have two ssds on there you can only get the max speed of one drive even if two are being used simultaneously. there is a 4 way card that has more pcie lanes but that too is 200 bucks and not worth it.

[@nadtz]

@@firenado4295 I'm in the process of testing a few cheaper 4x cards in an EPYC board with bifurcation just for the lols, if you really *need* it there are some good deals to be had for older but still recent hardware. Yes it won't be top of the line and the absolute fastest but last gen Xeon W systems for example can be had pretty cheap if you need more PCIE lanes and/or features like bifurcation on a budget.

[@firenado4295]

@@nadtz my issue is that my new pc I just built a year ago the mobo only supports bifurcation on the main 16x slot. the second 16x slot is only wired for 8x and does not support it. I just really want it so that I can have multiple drives in one place and also use a pcie slot as I like things being consolidated and also I want to use all the pcie slots otherwise there is no point in having a full atx board.

[@nadtz]

@@firenado4295 I can sympathize with that.

[@GameCyborgCh]

you know it's fast when Blu-Rays/second is a legit unit of measurement for the bandwidth

[@atruceforbruce5388]

Guess that beats what is currently on the market even 6 months later. This product is still on pre order.

[@zergidrom4572]

1:34 im not expert, but these SSD bend is not looks healthy