The $1,000,000 Unboxing - Petabyte of Flash Part 1

[@esniperwolfe]

I love that kioxia said challenge accepted. They weren't " that's not we were thinking" or "here's a script for this." But that's an interesting engineering project.

[@wayland7150]

I can imagine Kioxia enjoying blowing LTT minds with what is normal to themselves.

[@fynkozari9271]

Why is human technology so depressing? Especially Gpus producing heat like an air fryer.

[@TheSimmr001]

The thing is... everyone who heard about this was just like "sure, this seems like fun!" and partnered with the project. thats so cool!

[@deansmith4752]

Kioxia had a a mishap a month or two ago and lost 600,000 exabytes of flash. I guess they are pretty good at catching up. So they lost 600 million times more than what is used here..... they are supplying the planet of flash.

[@ericneo2]

The engineers were like: "*He wants to do WHAT?!*" "Not saying we can, but assuming we COULD what would it take? You know for -science- LTT"

[@shadowtheimpure]

Kioxia was like 'That sounds like fun, let's make this happen!' For reference, each of those CD6 drive costs $3100.

[@vedpatel60]

How many were there? (sorry I don't remember them saying it in the video)

[@sekanderbast6183]

I think they had 12 per server and said they gonna have 6 servers so a total of 72… so… 220000$ of drives

[@danieljensen2626]

He discussed on WAN show that all this hardware is a loan, not a gift. After the project is done they have to give it all back.

[@Jack-rq7ll]

@@danieljensen2626 why would they start talking about setting it up to their systems? Can you send a link of the ep of the wan show where they talk about it?

[@baileysmith3920]

@@Jack-rq7ll because to test a machine like this you have to hook it up to a network to even test the speed/reliability of the unit

[@sql64]

"Building a data center is the most expensive part about building a data center" - LS 2022 Never in my life have my ears been blessed with such wisdom.

[@TurkeyOW]

been looking for a invisible character, would you be willing to give me yours? edit: actually visiting your page i can see it, im looking for one thats invisible when viewing the channel and have tried dozens of invisible characters but none have worked so far.

[@gangaskan2255]

we'll just use the welder and the mill plugs for this, we got it with extension cables. sounds about right.

[@william41017]

What did he mean with that?

[@jkmicha]

@@william41017 Linus meant that the cost of the servers in a DC is less of a factor than the cost of the actual building and infrastructure.

[@william41017]

@@jkmicha thanks

[@rhyansanpedro]

The excitement is infectious! The fact that they just unboxed this at a pokey part of their warehouse giggling like kids on Christmas morning was really fun to watch. This is going to be a great series!

[@TheSkippysan]

It is funny how Linus didn't know what part was the server.

[@evan5848]

Honestly the best part of this is Kioxia playing ball. "Yeah, that would be an interesting engineering challenge." This is the kind of stuff you like to see.

[@randomblock1_]

Kioxia really said fuck around and find out

[@xXPazifistaXx]

this is the attitude that keeps tech improving further and further… you love to see it

[@akhileshsadhu7030]

very easy to recreate at home, affordable as well 👍

[@NSJmakesMusic]

yes :/

[@aint_noway69]

Yes you could buy this and totally dont break the bank

[@strawmanfallacy]

Rofl

[@Lann91]

I've been looking for this tutorial for so long, and finally found a simple, well explained one.

[@jpegjpg]

He only runs his own servers because he can farm content and he gets the hardware for free.

[@HyenaEmpyema]

8:33 the "flappers" are to prevent backflow if that unit goes bad and the rotors go to 0 rpm. The internal pressure is so high from the other fans that the air would go the wrong way without those.

[@rabywastaken]

Ohhh that makes sense! Thank you :v

[@PureRushXevus]

When a case has so much air pressure inside, you have to start adding airlocks...

[@IM2awsme]

Nice

[@suicicada]

Ooh it’s like a bomb lol

[@AntoniusK]

@@PureRushXevus "gas escape valve went out on my case, gotta stick it in the freezer now"

[@withcookies]

Linus 2022 "we may never see performance like this again in our lifetime" Linus 2040 "Today we are reviewing the Samsung Universe XXII with 50 petabytes of quantum memory onboard"

[@ayporos]

ikr. It's like they haven't learned at all how fast this shit improves.

[@denshi-oji494]

2040 continued... Why not, everyone needs a starter system...

[@pacitoman9721]

At LTT we usually see consumer PCs that most enthusiasts can only dream of. This is enterprise level hardware that's so cutting edge and over the top that people who spec servers in data centers dream of this.

[@wongperson4909]

As a Systems Admin, I approve..

[@qwertpoiuy430]

@@wongperson4909 just wish we could see more supercomputers

[@morosis82]

I'd love to see Wendell or Patrick make a showing in this series.

[@OSkarSS20]

@@morosis82 I actually expect one of them, if not both, might appear cause I bet Wendell is as excited as Linus and Jake if not both of them together bout this much power... Just my thoughts

[@PlanetJeroen]

People who spec servers in datacenters stopped caring long ago.

[@votezoidberg2020]

I'm so excited for the part where he has his editors use it and respond with "yeah its ok"

[@CybrSlydr]

Taryn, paging Taryn!

[@kyleduddleston4123]

"Is this supposed to be better?" 🤣

[@shakenbake2k479]

Lol

[@wayland7150]

"I'm getting some stuttering on video editing" Linus panics.

[@HokageSama13]

Especially Hoffman. “It’s still laggy and shitty”

[@a-8183]

Every time Linus moves a part I sweat bullets lol

[@LinusTechTips]

We were nervous too

[@pangtundure]

@@LinusTechTips i guess so I'm nervous and Frikin Excited

[@austinfry5310]

Bread

[@crazyplays7900]

@@LinusTechTips You should have been

[@sylvainforget2174]

Same here. I want to add that college did not equip me to understand much, if any, of what is being said. But I like the excitement.

[@rapidsloth2]

I can already tell that this is going to be my favorite series on this channel.

[@SulliedLight]

I love that linus has a “pull out animation” for the screwdriver, every time he takes it out he flips it

[@zachylimaki2167]

And surprisingly he doesn't drop it either

[@PrisonYT]

@@zachylimaki2167 Maybe that's the only skill he has. otherwise it's Linux DropTips

[@BrianOrange]

Marketing and Practice

[@alexmills1329]

When you spend a few million on a screwdriver you damn well cherish it and this just shows in how he prefers to use it himself.

[@BoofPack69]

Like the "pull out" animation I had with your mom

[@matasa7463]

Gotta hand it to Kioxia, they really have some pull in the industry, and they went in this full send.

[@goodiesohhi]

They did literally invent Flash Memory. XD

[@hxd9321]

@@goodiesohhi oh forreally?

[@coldenvfx]

@@goodiesohhi oh didnt know that

[@mongmanmarkyt2897]

They heard Linus's challenge and were like "Alright, bet"

[@muhwyndham]

@@hxd9321 kioxia (formerly known as Toshiba Semiconductor) is one of the first company to made and commercialize flash memory.

[@RYTIME-fw1lr]

I can just imagine the folks and nvidia and kioxia covering their faces in fear as linus handles their $1,000,000 worth of hardware in such a care free way lmao.

[@billjamal4764]

@DJ idk how strong?

[@psedog]

Let's be honest. If they were that worried, they wouldn't have sent it.

[@jackbutler183]

Nah they probably wipe their ass with that amount of money lol.

[@mowtow90]

Dont worry , they dont care about them. They would not even feel the loss of one. I acctually used to support a competior version of this. This ladies and gents is called "High availablity cloud". I've actually seen a dataceter made out of those and yes they cost arm and leg (just to look at them).

[@DoubsGaming]

@@psedog idk man, Linus is known for dropping things. Unless they had a backup plan like Linus pays compensation for dropping I'm guessing.

[@jaredchampagne2752]

I love when people are genuinely excited about their passion like this, its amazing.

[@anthonyhernandez157]

i feel they were not professional and were horsing around throughout the whole video.

[@tahuluke6133]

@@anthonyhernandez157 who cares lmao

[@dankdopths6955]

I love how LMG linked everything they used in the description like the viewers would just snag some of it for themselves.

[@Renee_R343]

I'm sure some will. And I'm pretty sure taking a 1% cut on even one single 100K item is better than 1% cut on 1000 pcs of 50$ each. I've no clue how much they get from their affiliate links, plus the links are also just a good way, for people interested, to check out the further specs on items shown.

[@BobSentell]

Corporate IT folks watch LTT too. What Linus showed today could likely replace our entire Itanium data center.

[@dankdopths6955]

@@BobSentell I had a feeling. Just thought it'd be a chuckle anyways.

[@nesyboi9421]

I mean some crazy son of a gun may use an epyc processor in a gaming rig, I don't doubt it's possible, even practical.

[@lcrazy8l]

@@BobSentell as a datacenter tech, I can only say they've hit the nail on the head for things that cannot be discussed.

[@demmersify]

When Linus and Jake can't actually believe what it is they're looking at, even though they already know what's coming, you know it's going to be something special.

[@inflammatorycommentswithno2407]

wow fr?

[@npc4805]

@@inflammatorycommentswithno2407 fr

[@coreydurham1148]

The amount of times Jake hands Linus a piece of hardware then says “don’t drop this” is priceless.

[@EnsignLovell]

And then Jake proceeds to keep 1 hand on it. 🤣

[@MAGGOT_VOMIT]

Wher'd Linus find "Giggles the Clown" at?? I recommend 40cc of Euthasol .......STAT!! {0.o} 😆😂🤣

[@Azarilh]

And then Jake dropped on purpose one PSU.

[@cloudy3350]

wysi

[@joaquinvergara4699]

and usually that piece is worth more than your hole life

[@semibreve]

This is so fucking cool. You have to realise it's only because Linus and co have been so diligent about building their legitimacy, brand, reputation, and connections for YEARS that we got to this point. It's only because the industry trusts him so much that we got to see such amazing tech like this.

[@supertetleman]

Also that he did some pretty poorly done reviews of enterprise cards a few months back and nvidia didn't like the bad press and wanted to see him do it right.

[@7_Max_7]

I work at a datacenter, so I'm fairly used to high performance enterprise hardware, but I've never got to work with something this powerful. I'm very excited to see what's next with this project.

[@codyadams6514]

This is already outdated if only you could see it

[@AmrXcellent]

Yeah I get what you are saying, those numbers are a definitely high for a medium enterprise but for larger customers, $1M IT orders are no big deal. I have clients whose cloud monthly bill are close to that number. BUT I have to say, this is still next level performance that I am certain is an overkill for all but a very specific use cases where u need that kind of fast storage. I honestly can't think what you could possible need that kind of storage for, because basically anything that needs that fast, you load it (& run it in memory - which is still much faster than any NVME), Anything lower and u cache into NVME and then tier the storage like any other sane person based on usage.

[@Finger112]

@@AmrXcellent Basically Powering the Starships next.

[@Kevin_Rhodes]

@@AmrXcellent Agree - this is a "because we can and got it for free" project for what they are going to use it for (presumably video editing?)- in the real world of real budgets you would certainly tier it and size the fastest tier to your normal working dataset. I've been an Enterprise IT consultant in storage and backup for 15 years, now also part of the high performance computing team at my employer and I get to play with this stuff every week. Good times! I will say that some of our HPC clients do have this sort of storage in performance and amount for HPC work. Just absolutely enormous datasets, so the time to even load the dataset into RAM becomes a real issue, and many multiple datasets flying in and out of the GPUs for processing. I have to admit, I'm the hardware dude - I don't have that much of a clue about how any of the software they run on these things actually works.

[@SaddisticSpeller]

@@Kevin_Rhodes They're not keeping it, they have to send it back when they're done. Genuinely the amount of power draw this thing is pulling would probably make it too expensive for them in and of itself lmao.

[@Watchandlearn91]

The amount of computing power available today is absolutely insane. I work in a big data company and one of our hadoop clusters has 104TB of RAM and over 13000 CPU cores. When I first started working there about 3 years ago, I would sometimes navigate to the resourcemanager just to take another look to make sure my eyes weren't betraying me. I must admit that I have never seen 1PB of flash storage though so this will be a freaking crazy project and I can't wait to see what the result benchmarks are.

[@kaukospots]

How many racks was that, too? Probably not just the half-rack they had there!

[@Watchandlearn91]

@@kaukospots I have no clue as I don't work in the infrastructure side but we have multiple data centers so probably lots of racks!

[@skmetal7]

can you imagine what google or amazon has?!?!!?

[@Watchandlearn91]

@@skmetal7 Google, Amazon, and Microsoft probably have more than we would even think on a high estimate in their cloud datacenters for sure.

[@teo-7242]

What it's for exactly?

[@blahorgaslisk7763]

8:34 "They've got flappers!" Those louvers are there to close of the air path if the fans dies. When the air pressure get higher on the back the louvers will close so air cant leak back to the front through the fans. Pretty slick and low tech which makes them very reliable.

[@CattoRayTube]

300 watt* fans, 0 watt protections. *or wattever ;)

[@Mike2004Fede]

9:48 "Building a data center, is the most expensive thing about building a data center"

[@BiskoyJackson]

Alex walking into frame: "Nothing new here, we do this everyday"

[@michael7738]

I like that short "camouflage appearance" in the middle of the video. :-D

[@Braiam]

@@michael7738 Wait, Alex appear on the video?!

[@BiskoyJackson]

@@Braiam A wild Alex appeared for a second.

[@Fizz-Pop]

I saw him or his shirt slip around a box before. He had just reached "fuck it". I gotta be over there so I'm gonna be in shot. They can always re-shoot it.

[@KevinPope]

enterprise storage gear is bonkers, I've deployed some multi-million dollar solutions, but I don't think I've ever had my hands on anything with that much potential performance.

[@justbob333]

you have, probably took 8x the space of this however

[@KevinPope]

@@justbob333 or more in some cases, but some of the newest stuff I deployed fit into a rack or two, especially the flash solutions

[@codyadams6514]

I’ve worked with some 11+ figure projects that would blow your mind, the density is impressive but the speeds are last gen. Can’t wait to see what his power delivery solution will be.

[@jarsky]

I work in the Enterprise space, and I deal with Datacenters with massive SAN's, compute racks, etc....we have 4 DC's ourselves, let alone the 3rd Party DC's we colocate racks into. But the pure insanity of this sort of power, and the configuration with the NVMe-oF to a central GPU accelerated central compute, absolutely blows my mind...and the absolute density of this setup to fit in what...about 10U of space, so a 16RU rack holding everything....insane.

[@Finger112]

Can we get the Yottabyte Project next?

[@avroarchitect1793]

The engineers who worked on this must either HATE them and their lives right now or squealed like children when they were handed this project. Possibly both. This couldn't have been easy. Probably required some innovation and development to make work.

[@gabrielhmi]

@@avroarchitect1793 I kinda doubt it. Looks more like they get to test the next gen product lines. None of this looks custom, and it seems to be a future standard configuration.

[@AlternateDargon]

I still work in DCs. The density nowadays is so insane. 4kva racks are standard, customer trying to push like 6-8 kva per rack at just a colo facility the cooling is having a rough time. this kind of hardware is just so badass and fun.

[@dtiydr]

And at science databases there could be racks after racks full of servers like this one column after column side by side.

[@H.R.E.A.M]

i love the fact the intro has never changed, always updated but never a complete rework. classic man i love this channel so much & have been following for around 7yrs now. so proud of Linus & all the hardworking folks at LTT making all this possible. shoot past the stars ❤️

[@MysterySteve]

God, I barely know any of what you're talking about when it comes to this avenue of techy talk, but it's so satisfying to hear excited people talk about what they love

[@jacobbailey2950]

same

[@20blog28]

Basically, a small company got hold of the kind of hardware that you would find in a google data center

[@Andrei5656]

@@20blog28 did they buy this? Was it offered in exchange for a shouting? Sounds insane but you never know. Is this really a million dollars? Also do we know what it's for? They have a specific need or is it just because why not? Do they keep it or have to send it back? Thanks.

[@Reelix]

@@Andrei5656 Given the specs of what they've shown - Yes - This is easily a million dollars worth of hardware.

[@awk4722]

@@Andrei5656 They do have to give it back, yeah.

[@samantony4423]

Mad props to Kioxia... this is by far the coolest tech video I've watched in a long time

[@Wetheuntitled]

As a former amazon data center employee I’m super super super excited to see the benchmarks done with this unit. I’ve always only just fixed these types of servers. Replaced those dac cables seen upwards of 400 gbps dac’s and 15.6 terra-byte drives I believe but never ever once got to benchmark or see just how amazing they are. I am extremely excited for the entire series

[@Jerakk30]

Never in the history of the internet has an unboxing won my sub... until today. I NEED to see how this turns out. I've been in the industry since computers didn't come with display outputs.. when storage media was on magnetic tape... this is just absolutely amazing.

[@ids1024]

"Everyone you can possibly name in the server space" - RIP Intel.

[@mamamia5668]

):

[@shadowmasterlord]

doesn't already matter :D everyone has new cool "home stuff" :D marketing is business ...

[@IM2awsme]

I really want to see this running a Minecraft server.

[@aronseptianto8142]

@@IM2awsme lol 1 petabyte minecraft world

[@juliankandlhofer7553]

@@IM2awsme finally a server that can run modded minecraft worlds that don't crash when more than 2 people are exploring lmao

[@JeffGeerling]

So... will you start installing petabytes of flash storage in collabs with other KZbinrs now? A friend would like to know.

[@erdragh]

Try doing it with a raspberry pi ;)

[@profblack]

@@erdragh Imagine having all of these servers and equipment and then routing all of that traffic through a Pi.

[@michael7738]

@@profblack And still, having all running through a Pi and then check the capacity of that array/pool with 1PiB would be crazy impressive for that small board.

[@PanoWorks]

As long as that friend isn't one of those people who immediately turn around and go back to an off-the-shelf product because either A. it works very so slightly better with their mac because macs, or B. it looks more aesthetically pleasing on a desktop. ( valid yet vapid reasons )

[@Samuel.Mwangi]

It would be interesting to know if it would beat HashiCorp's Nomad 2 Million Container Challenge but this time around running Kubernetes. Linus and Jeff please make it happen 🙏

[@Viralbutnotyet]

Linus: "we may never see this again in our lifetime." Technology: "come see this cell phone in 20 years"

[@spicybaguette7706]

He's underestimating Moore's law xD

[@flinx]

@@spicybaguette7706 unless process node density slows down as gate features approach fundamental atomic limits.

[@noname-gp6hk]

@@flinx Dennard scaling seems to have hit a wall, just wait until you see the TDP of next generation server CPUs.

[@jamescamil]

Future: “remember cellphones”

[@wayland7150]

Future: This old IBM PC AT went on evolve into mind blowingly powerful technology. Sadly this little IBM is all that remains and we no longer have the technology to make one even this simple.

[@godspeedfx]

I swear to god I've never been so nervous watching an LTT video.. you guys are killing me! Setting that thing on two edges of an open cardboard box.. I was actually clenched the whole time.

[@MA16v3]

Favorite thing about LTT was when we'd get to see some absolutely bonkers over-the-top hardware. Glad that is back.

[@wesrihn]

I’ve been watching since Whole room watercooling.

[@MA16v3]

@@wesrihn I came for the tips, but Whole Room Water Cooling is why I stayed. It was either that or one of the Compensator builds.

[@albertoroche9831]

I work in manufacturing and assembly for these machines and watching these two casually take components out and handle them with such "care" is the reason I have work nightmares

[@Jimmy_Jones]

Lol

[@corpsman]

this video must have given you nightmares D:

[@Finger112]

I am sure they can get a replacement part!

[@CaelVK]

I don't work in manufacturing or assembly for these machines and I was still sweating

[@innoillust]

14:50 here you go

[@MidnightCityMusic]

Imagine a day like 30 years later where this is the equivalent to a portable ssd at that time...

[@NemoConsequentae]

One day in 30 years: _Remember when that phone you're holding took up a full 16U rack & needed more power than a house?_

[@SaddisticSpeller]

I mean, probably. 40 years ago the Cray Y-MP was as powerful as it got. It barely meets the requirements for Vista.

[@NemoConsequentae]

@@SaddisticSpeller And right now, that phone is far more powerful than the Apollo guidance computer. And probably has more sensitive accelerometers.

[@talibong9518]

@@NemoConsequentae Well the guidance computer was built with reliability in mind, taking a phone through the van allen belt would instantly corrupt the contents of it's RAM, whereas the guidance computer went to the moon and back going through the van allen belt twice without crashing

[@nos676]

@@talibong9518 the amount of gold insulating it is not comparable.

[@sharkeystudios]

"Warranty void if removed" Jake and Linus: Who?

[@thatautogarage3644]

I've never been so excited to see someone unbox something before. This is going to be an Epyc series! Thanks Xioxia, Nvidia, and SuperMicro for making this happen!

[@SphinxKingStone]

Kioxia

[@thatautogarage3644]

@@SphinxKingStone must’ve auto corrected or I’m just an idiot, either scenario is likely.

[@VetBodGaming]

I sometimes forget how insane some of this stuff is because I deal with it every day. It's always fun to see someone not from the enterprise space see these things and be reminded how cool they are

[@boltinabottle6307]

Yeah it loses a lot of it's appeal when that insane hardware is powering slow as shit VDI workstations.

[@kellymoses8566]

@@boltinabottle6307 why are they slow?

[@maxhennessy6676]

@@boltinabottle6307 ahhhh a man of culture I see. Best part is when you have to manage those POS VDI's....

[@RamyWarda]

@@Abbrahan can confirm; I work for a financial firms enterprise data center, and our virtual workstations are allocated 8 threads of a Xeon Gold 6xxx (I forgot the exact chip), 16gb of memory and around 512gb of storage and even then they are atrociously slow.. when I WFH, I try my best to just remote into my office pc 99% of the time lol

[@boltinabottle6307]

@@RamyWarda A big part of it is network congestion too. I work in NYC and the upper floors of my building with fewer employees do just fine. The 2nd and 3rd floors (which are much larger, with many more users) are slow as hell. Doesn't matter which pool we put them in. Perhaps the 2960x switches are the bottleneck. (edit: 2960, not 2690)

[@Baelthaazar]

I remember those days... Retired from IT Infrastructure now. I was the SAN guy at the office and the day the two+ million dollars of equipment and a couple of petabytes of storage (SAN storage racks, controllers, Brocade switches and boxes of fibre to connect it all) came in, well... I remember that feeling. Christmas does come early some times.

[@markp2085]

He Mark, I just left them a similar message. I was a network admin back in the 90's and early 2000's and was just like they are today. I miss getting switches, routers, storage, wiring, tape backups, learning to work with fiber, even making hundreds of patch cables back when I first started.

[@carlsoll]

8:11 Lol Jake, the Heat Sinks 😄. You guys are Awesome in this one, Love the Energy & Tempo!

[@ASOTFAN16]

This is exactly why I love seeing enterprise stuff on the channel, and especially the more exotic stuff, cuz you get to see things like this power supply 5:05 and this weirdo connector for all that massive data 5:39 and the insane amounts of RAM with all the drives. I love it and I seriously can't wait for the next video to come out about this, which doesn't happen often for me lol

[@NFreund]

Yep. That's stuff i can't get my hands on, and i work in a data center...

[@dirtymike69420]

The little editing subtitles are absolutely hysterical and I appreciate every single one.

[@BUDDIgaming]

I forget how much working in a datacenter desensitizes you to seeing awesome hardware like this, I love how excited they were

[@covertmisnomer7726]

Mood

[@user-rd3jw7pv7i]

Do you see these insane tech on the daily basis? That's insanneeee

[@Kevin_Rhodes]

@@user-rd3jw7pv7i I helped install a *dozen* nVidia DGX GPU servers a couple weeks ago. They are $500K each or so, and are basically nVidias own version of this. HPC in the enterprise (or in that case a large research university) is both fun and mind-bendingly expensive. Which is a great gig to have. I have to admit, *I* got excited seeing those giant 450lb monster servers racked together. They certainly looked every bit of $10M bucks. I've been doing Enterprise storage, backup, and virtualization consulting and implantation engineering for 15 years, just getting into the high performance computing stuff. Looked to me like they have the wrong PDUs for those high-amp plugs on the GPU server though. And those DGXs use *6* of those EACH. A mind-boggling amount of power.

[@user-rd3jw7pv7i]

@@Kevin_Rhodes I don't even know what to say. I'm speechless.

[@jeremyscherbert7336]

💯 I just order some new 400Gb network cores and servers with CX6 nics. As you are tossing them around and installing them... you forget they are worth a corvette each.

[@ACuriousTanuki]

18:00 It's a whole lotta fun to see these guys be this excited over such exceptional hardware. A few moments though where I couldn't not be aware of just how much Linus was breathing directly onto $100,000 of ultra-high-end electronics 7:17 🙊 10:38 😅

[@Hobbles_]

I’ve been so excited for this! After hearing about it from the WANShow! This kind of content is always super entertaining, and the dynamic of these two is so fun!

[@ugogatto]

free stuff its always good

[@mikee7579]

As a enterprise IT guy, the MSRP for that server with the A100s is roughly 150-200k USD. I've looked into it before for some projects that we did. Edit, my vendor tells me each 12TB ssd from Kioxia is about 5k. That's another 360k on top of the servers.

[@ozgruntsyd4281]

So here in Australia that would easily be AUD$1,000,000 allowing for exchange rate, GST and 'the Australia Tax' which is a random markup put on because of 'distance etc.'.

[@pepperroni6252]

@@ozgruntsyd4281 'random markup for distance ' yeah it's called shipping costs. If you look at shipping lanes they basically make a path East to West meaning that Europe and North and South America are all along a roughly straight line so it's efficient and cheaper to ship whereas Australia they have to head south from China just for Australia and New Zealand which is a lot less efficient so the shipping costs are higher.

[@johnmccallum9106]

@@pepperroni6252 We usually get charged a higher base price and shipping on top of that. As for inconvenient shipping the ship can be back at Singapore Japan Taiwan or China before it could have made it to the USA or Europe and no pirates to dodge.

[@pepperroni6252]

@@johnmccallum9106 the base cost is usually to do with manufacturing costs, Europe Asia and America all have their cheap labour countries. There's many more people in Europe, and the American continents than South Asia and Oceania so it's still more economical for them to ship to those places, also ships will return with products from those countries whereas there'll be less to bring back from South Asia and Oceania so another loss. It's all about minimising loss and increasing efficiency.

[@dragons_advocate]

What would you say in your estimation the engineering cost of the whole thing would have been? Let's say, another million across all partners?

[@ConfusionFace]

Oh yeah. This is the kind of content I can get behind. Also, it's brilliant to have Linus next to all those boxes and crates in the intro. It really makes them look super large.

[@DrProfessorOzzie]

this is the coolest thing I've seen, cant wait to see it all together!

[@TristanMaiolo]

I'm super jacked for this series! Can't wait to see it going all together and up and running!! Freaking awesome!!

[@dna3215]

hihi

[@andrecinelli]

I have a SuperMicro 200TB storage with some processing servers in a 10Gbps switch at work, and it is sweet. This monster that they are mounting is just mind boggling. I am very pumped to watch this series unfold.

[@NikTek]

2:17 can’t wait for people to comment 25 years later and say “we have 1tb vram nowdays”

[@aryanjha8841]

yes

[@thegreenxeno9430]

It's 2047 and 1TB of memory is less than my breakfast subscription.

[@HippityhoppityGnW]

Niktek boi

[@Rbwars]

They did 640gb vram in the video

[@deztructo123]

25yrs later and we no longer have pc's at home. Just VR interfaces and everything is owned by someone else.

[@remochovsky1056]

The amount of high pitched laughs just shows how excited these gamer bois are about the new servers! Gaming days at work just got alot more real lol

[@themagickgoblin840]

How else is make going to maintain his minecraft server. Clearly this is what hes been working on since he dropped work on the server last year. Coincidence I think not lol. 1mil mc server hahaha

[@joshse8709]

Except for they don't get to keep

[@shanebluebutterfly]

Not for gaming....

[@themagickgoblin840]

@@joshse8709 almost as if you didn't read sarcasm. Nobody would use this for gaming it's over kill and stupid.

[@themagickgoblin840]

@@shanebluebutterfly no shit Sherlock when did you become a detective

[@DreamKOne]

As a Datacenter Technician I find it very cute how you are excited so much about such small things :D

[@laief-kgolden6738]

lol mate working with like 1000 of those and call it a SMALL system

[@kevincarlos973]

They're laughing out of excitement like Sponge Bob and Patrick and honestly, I'm laughing along. These crazy projects and the adventure sense they always have about them are one of the top reasons I love LTT so much.

[@pulsar9681]

5:30 it's incredible that Linus can flip a screwdriver so nonchalantly, while also being known for dropping thousands worth of equipment

[@runeseeker993]

Cause it's his own, when it comes to anything not owned it's a drop

[@goldenblood9316]

One does not get good at flipping and catching random assorted shit by being careful and not dropping things, they get good by dropping things trying to flip them. He's just an expert at dropping things such that he has gotten to the point that he just drops them intentionally with style back into his own hands. You're merely witnessing a REFINEMENT of pure dropping technique.

[@qiou29]

Part of his attention is focused on the teleprompter, while handling pieces of hardware, presenting it to the right angle for the camera, making sure A roll and B roll shot are made. In the contrary, flipping his screwdriver is something that requires less attention and something he's used to handle

[@niklaskoskinen123]

There's enterprise level hardware, and then there's data center level hardware.

[@FlyboyHelosim]

There's data center level hardware, then there's your mom's beside drawer level hardware.

[@niklaskoskinen123]

@@FlyboyHelosim your mom out there blowing circuit breakers using over 12 kW.

[@VexingRaven]

This is like... HPC level hardware. No enterprise or datacenter is running this level of hardware for normal compute... If you're running this in production you've got a seriously niche need.

[@niklaskoskinen123]

@@VexingRaven yup. I mean Linus talks about density, but there has to be a limit. It's hard to believe this is worth the money just for the density.

[@BiologyIsHot]

And then there are research clusters/HPC

[@JonnyDarcko]

18:04 is Linus in a candy store where he was told he could get whatever he wanted.

[@Neoxon619]

Hearing about how this unboxing came about on WAN Show had me even more excited for this video. Glad to see it finally come to fruition, & I guess you’re really going full tilt with this LMG server overhaul (albeit not with this gear specifically since they’re returning it later).

[@hamcha]

If you followed on WAN Show you also remember they said they have to return most of it sadly

[@PoleTooke]

It's not an overhaul lol theyre not keeping

[@IAmDistractedRn]

G u haven't even watched the video, it was released 9 mins ago 😂

[@crazyplays7900]

I believe they are returning all of it and they are definitely returning most of it

[@Neoxon619]

@@PoleTooke True, but the other server stuff that they’re getting is an overhaul.

[@metalxpl]

I work at a data center for a cloud provider and we've been deploying rows and rows of this hardware. It's been pretty fun to deploy and play with the hardware. You will definitely need to rethink your power and cooling solutions to support this stuff.

[@blackbriarmead1966]

When I see stuff like this, I have to wonder about the absolutely insane amount of bandwidth that AWS or Google has in total. It has to be at least exabits per second. I don't even know what's past exa but that might be a reality in terms of flops (maybe?)

[@katech6020]

@@blackbriarmead1966 Giga Byte Tera Byte Peta Byte Exa Byte Zetta Byte Yotta Byte

[@Pussalia]

Yeah, they're pulling power from wherever they can but there was no mention of cooling at all. They better have something special lined up.

[@Jam2109]

i'm woking in a data center as well, i would love to see something see to install something like that for a customer in my queue... until now only had smaller netapp shelf or hp vault setups... just like linus, i giggle to myself when see such rediculus brilliant setups!

[@metalxpl]

​@@Pussalia Yeah, I hope LTT revamps their server room infrastructure specifically to support this hardware. I don't think they've thought that far ahead yet haha. It'll be fun to watch them figure this out.

[@vinity5202]

Holy sh*t has always been one of the most entertaining series on this channel. Love every installment no matter how long it takes between two 'episodes' haha. Keep pushing the boundaries!

[@websterleone]

The modularity of that hardware is wonderful and I hope we get some of that sort of thing in lower-end/DIY servers in the future.

[@pyramid011]

The amount of giggling in this video tells me everything I need to know about just how insane this all is.

[@stefanhoffmann8417]

Well if an average gaming computer has or had 1 GBit at max speed, which barely ever gets fully utilized, then his server rack had a capacity of 12 800 GBit networking. - That means it could handle almost 13 thousand gaming computers at once, all at max speed which they ever can utilize. If you drop this value down to lets say FullHD (1080p) content streaming which is something like 3MBit per computer / client. That'll make it capable of serving approximately 4 MILLION 267 THOUSAND customers at once! (Tho can the rest of that server handle that many clients?) Almost 4,3 Million computers running FullHD video at once? Is this crazy enough? Just one server can serve almost every citizen in my country at the same time, streaming some 1080p content.

[@austinveenstra7186]

this is a completely insane level of hardware and I'm so excited to see what it can do. Thanks for sponsoring this madness Kioxia!

[@ScytheNoire]

I hold my breath every time Linus is holding things. And I love how Jake gets to tell his boss "Don't do that!"

[@nicholasmitchell8184]

Seriously… watching this hardware being handled this way makes me cringe. Casual box dropping, tossing and torquing chassis, forcing mechanicals, no regard for static. I’d fire Linus if he worked for me

[@MultiSneakerLover]

@@nicholasmitchell8184 dam linus sweating bruh u rlly got him

[@DjVortex-w]

It's actually one of the reasons why I don't watch his videos much anymore. He always handles very expensive hardware extremely carelessly for no reason whatsoever. He clearly isn't even doing it for views or anything, he just does it instinctively. He may take a multi-thousand-dollar heavy piece of hardware and flail it around with one hand like it were a coctail shaker (heck, even cocktail shakers are handled more carefully because they are usually shaken with both hands, not just one). This video is no exception (eg. he does that at 8:55). And, of course, every time he unboxes some really expensive server hardware, instead of doing it safely on a table in a clean environment, he insists in doing it in some dirty storeroom, on the floor, placing it precariously on some cardboard box. I'm surprised he doesn't do the unboxings on a piece of plywood propped up onto some rickety garden chairs... on the roof during a windstorm.

[@olivert.7192]

man i LOVE server / enterprise content. This is next level

[@edwincook266]

Beautiful, something really awesome about the raw magnitude of this build. A note on the power, hopefully these two power connections are in sync, or being run through a central UPS/building or otherwise to clean it up, but running extra long cable to sensitive equipment of differing lengths can cause a dirty power input, not something to problematic but not ideal and in brown out scenarios can cause a fault down one side of the rack, not sure on the tolerances on the kit. On oneside it should be bullet proof as it's DC equipment, on the the side it's DC equipment and may expect incoming facilities to be within DC tolerance. Can't wait for the follow up videos

[@kirkanos3968]

With what they are plugging in i would have thought they would get it a direct line of power

[@JamesMarsack]

@@kirkanos3968 Seriously, they repeated how long this project has been in the works. Was Brian the Electrician not available to extend the service? Oof!

[@jonathanberry9502]

I hope this comment gets some attention, they aren't really going to know how serious that could be so hopefully there can be some input from the few who might be able to answer this.

[@MichaelNatrin]

Agree - those extensions need to be the same length.

[@rustyirish]

Agree, with a million dollars of high end equipment why wouldnt you run dedicated power from a panel to it? No extension cables.

[@arthurmint]

Thanks Linus for this video! Ive ordered mine and it arrives next week 👍🏻

[@ericdn3825]

wow I'm so jealous, I hope one day I can afford it so I finally can run minecraft effortlessly

[@yodizz1241]

This for mining?

[@thebaum64]

This is INSANE, love seeing crazy stuff like this.. just.. insane to see the progress tech is making

[@roycephantom8563]

I didn't think chungus could become a more appealing word until chunk-tastic came to be and now I'm happy man

[@ZanifyYT]

10:03 this made me laugh harder than it should’ve 😂

[@pyromaniacpenguin]

that shit got me so hard i swear, tbh i thought about it and when he said it, i just fkin died

[@justinedzard]

The fact that it came outta nowhere really caught me off guard

[@Daelsky]

@@pyromaniacpenguin I also thought about it at the same time he said it haha that was amazing

[@goat8629]

Same here bro I almost literally rolled on the floor

[@jm.aurelio27]

Of all the server hardware that I never seen it before, I think it was the most beautiful and the most insane server hardware period. NVIDIA has the design appeal on the A100s plus the memory, NVMe etc. This is the datacenter's wet dream

[@drewnorth3816]

another kick ass video about the bleeding edge of server tech. i love it!

[@GothDarknessRadio]

She's a gorgeous piece of kit. Love to the sponsors for this project, can't wait for the rest of the series.

[@Vilmar22]

I just love the "chaotic smart" energy of Linus & Jake. Whenever I see a video is with both of them, I gotta watch it right away.

[@dragonraizen]

At this part I'm halfway convinced sponsors provide Linus with hardware, let's say, 50% for the advertisement and 50% because some engineers somewhere are wondering "What's gonna happen if we hook up a week of merchandise together?"

[@DasGanon]

Engineers: "There is a point where we needed to stop and we have clearly passed it but let's keep going and see what happens"

[@BMGraham]

I work for Supermicro (although I am not replying as a company representative) and this makes me really proud! Thanks for a great video!

[@chedatomasz]

I was in Student Cluster Competitions in uni and I can vividly remember the feeling of finally assembing a server when all the gear arrived from sponsors. No biggie, just a $100k chunk of metal dented because someone at the airport couldn't care less

[@JasonEllins]

Its here! Been hyped for this video since you talked about it on The WAN Show!

[@realchonkity3547]

Linus looks like he has been having a lot of fun on the channel lately, happy to see him enjoying it more

[@sonofage]

I handle mostly cloud servers these days but watching this video, made me miss the ol' data centres I use to visit for work.

[@snapzzz2153]

This video made my day. The excitement while seeing every piece of equipment was awesome

[@carterbeals9771]

Seeing Linus and Jake's tangible excitement has me looking forward to this even more. Lookin like kids in a candy shop lol.

[@KristiansKazmers]

"performance we may well never see again" I'm willing to bet that it will be just a couple years before LTT does the next upgrade which will make this rig look just ok.

[@5eeeeeb5]

I can see it now... 2028. LTT is about to unveil their new "Editing Server".... And Linus goes... Yes ladies and gents... This thing will have 2 Zettabytes of storage. What happened to our Petabyte server you ask? It's in the media/gaming lounge. It has just enough storage to have COD 22 - The Venusian Wars and expansion packs installed.

[@danieljensen2626]

More than just a couple years probably, as they aren't actually getting to keep this.

[@pieceofschmidtgamer]

@@5eeeeeb5 I know this is a joke, but for those who don't realize, yeah, this is a joke. There's no way a single game will be a petabyte in just 6 years.

[@xani666]

I doubt they will be able to use fraction of this setup's performance

[@Pussalia]

I thought that too. Go back 10 years and tell Linus that he'll have a petabyte of nvme flash in his hands and he'd either scoff or be absolutely floored.

[@jackalski]

I have never seen them so giddy. They are like kids on Christmas unpacking best-freakin-gift-eeveeeeeeer

[@Intermernet]

As someone who used to install enterprise gear, I wince every time you guys handle that kit. I'd be in a prepared room with almost zero dust, with anti-static strapping, adequate room to set everything up, have the rack ready to go and in the correct spot, have tested the power and network links, and a thousand other things before that first box got opened. I love the way you guys do this stuff, but it makes my teeth itch and my eyes lose focus when I see a cool mil of kit get thrown around! Can't wait to see exactly how over-powered this is compared to your needs ;-)

[@simonjo1984]

Ah there’s a difference, normal people lose jobs when they drop things … Linus dropping things be like “ok let’s send him more shit to break for fun” then he makes another 100k dollars for the added twist …

[@Atexih]

@@simonjo1984 Normal people definitely don't lose jobs* when they drop things unless there's gross negligence involved on the part of the person doing the work (not in company procedure planning). * = assumes the country has worker protection laws AND the workplace isn't the kind where you get fired for taking a week of sick leave.

[@andrewjaxe399]

I spent the last two years as a systems engineer for a large saas company working with gear this big or bigger and it wasn't a big deal. I feel bad for you guys with ridiculous procedures and bosses

[@echidna8857]

I was nervous through this entire video lol

[@cornevisser6123]

Yeah it's kinda pissing me off how they manhandle that gear..

[@MrTherule10]

One of the happiest videos I’ve seen in a while. Seeing you guys like kids at Christmas put a huge smile on my face, even though almost everything went over my head

[@jp-ny2pd]

SuperMicro, good call. Love their hardware. On a side note, as crazy as that architecture setup might seem, it's got a 3 to 5 year shelf life in the enterprise space before it's decommissioned and replaced by something that's probably twice the performance. The companies that can afford that level of gear outright are constantly seeking higher performance/density. Your bottleneck will likely be the CPU core interconnects depending on how you segment the compute and storage and the software you overlay on top. Definitely going to need Linux and some creative heavy hitting to really get the 'full spec' out of this setup.

[@Baelthaazar]

3 to 5 years is about right with the gear decommissioned from main data handling to backup pools.

[@karenwang313]

Supermicro servers are great, theyre so easy to work on compared to the lenovo servers we have at work.

[@Jimmy_Jones]

Linux go burr Windows go 😱

[@sheldongroom18]

Love this so much, this is my third time watching. Can't wait for the rest of the videos; this is going to be fun.

[@tylerpuszkar]

Watching Linus unbox things I can't afford in my lifetime is the best part of my every day.

[@sebastianguerraty6413]

The huge heatsinks next to the GPU coolers, are the NVLink heatsinks, they are the internal network switches between the GPUs :) Also, please don't remove them, they are not your average heatsink installation (patric from serve the home did a video on why its a bad idea with the previous gen Nvidia GPU node, TL;DR you need like a 1thousand dollar screwdriver to do it without breaking something) I cant wait for the performance video from you guys, this is a really cool project, really goes to show how far the enterprise segment has come vs gaming hardware

[@noname-gp6hk]

Yeah, pretty sure they are bare die chips without integrated heat spreaders. Really easy to crack the die if you aren't extremely careful or are using calibrated torque screwdrivers.

[@ionstorm66]

They are direct on the silicon, and it's die is massive.

[@soloyoujo]

HOLY FUCKING SHIT I LOVE THIS. Kudos to Kioxia for balling out so hard, I won't hesitate to buy one of their drives if I ever need an SSD.

[@soloyoujo]

@@Lebon19 maybe just a small NVME consumer one... XD

[@wayland7150]

Yes, I've considered Kioxia last week. Not the best option this time but they get my consideration now. I know that sounds big headed but my customers would know Western Digital but not Kioxia.

[@soloyoujo]

@@wayland7150 exactly that! A while ago I'd thought the same as your customers. Now I've changed my mind and would shortlist them in my comparison against drives by other manufacturers. I guess that's what they try to achieve with these videos. I won't autobuy them, but I will consider them as I would Samsung, WD or Kingston.

[@planetjakebomb]

I love when Linus is excited because he starts creating new words to describe things

[@arch800]

I work with a system similar to this from a Chinese brand called Inspur, those CX6 cards give me quite a bit of issues since they are supposed to reach ~100Gb/s per interface, but they require a LOT of tuning to see those speeds If you need a bash script for Ubuntu Server or RHEL that gets them up to that speed with AMD Epyc processors, let me know ;)

[@NonsensicalSpudz]

god damn

[@obadanw]

tbh didn't expect these type of speeds anytime soon i guess i was very wrong

[@LegionRRTX]

he is going to feature this server in few more videos before he sends back, who know, maybe they will figure it out on their own.

[@orencomputerelectronics8751]

I dont belive that mv ssd can read upto 64GB, i think it 64Gb. the fastest ddr5 can get about 64GB. But flash memory more slow then random acsess memory.

[@barney9008]

@@orencomputerelectronics8751 this is NVME in RAID configs thogh,

[@menpee]

"Performance which we have never seen and may well never see again." I'm not a fortune teller but I strongly feel the second half of that sentence will age really bad really fast.

[@satellitereigns]

He did self correct and say their lifetimes. But I guess we'll see

[@menpee]

@@satellitereigns Yeah, I heard that. They are really young tho. I'd consider 5 years really fast compared their remaining life and I'd be shocked if today's existing tech would be still the fastest at that time.

[@petymeg2033]

Exactly my thoughts. If we are looking at how computers evolved in the last 30 years we can safely assume that even in their lifetime (Linus is around 35) there will be grander builds than this. I might gamble to say that even in the consumer space, not just enterprise level stuff.

[@jubuttib]

9:00 Not gonna claim that I know a whole lot about it, but yeah you do need to do something other than just have stacked fans spinning the same direction. You don't really need to have any spinning in the opposite direction, you could also have a set (or multiple sets of) "stator" blades that are curved the other way and stay still. This is how the axial compressors in turbine engines do it, between each set of rotating blades (all going the same direction) is a set of stator blades pointing the other way. These blades (be they stators or contra rotating) are there to convert the velocity into pressure. Fast flowing air has low pressure, and if you have all your blades rotating the same direction you're basically just speeding the air up, instead of generating pressure. So the rotor blades ("fan blades") impart energy to the air and accelerate it, the stators then redirect and slow it down, which converts the part of the velocity into pressure. Stack multiple of these on top of each other, and you have an axial compressor. And since physics is all relative, it doesn't really matter whether you have have a stator and a rotor spinning at X rpm, or two contra rotating rotors each spinning at 0.5X rpm. =)

[@AnarexicSumo]

I'm sure the contra-rotating fan shrinks the footprint and makes it more reliable. Not only is there no need to stack multiple stators you have a lot more reliability using fans at half the rpms (to borrow your example)

[@jubuttib]

@@AnarexicSumo Yup, completely agree.

[@anotherluke4710]

Having worked as a mechanical engineer for a variety of companies I can say I do know a whole lot about it, and you gave a perfect explanation. Seriously, that should be in a textbook. Well done 👏

[@jubuttib]

@@anotherluke4710 Those are mostly where it came from. Thanks, relieved I didn't mess up too bad.

[@benhemmings1290]

Kioxia's response just proves to me that the people LTT were talking to were engineers. Engineers love an interesting challenge like this

[@0newheeldrives]

So that's what this hardware shortage is all about. Linus has it!

[@paulstubbs7678]

Well if this is the way big tech is going, well the amount of silicon in there is crazy, if everyone wants to upgrade to this level for the data centres, it's going to burn a lot of high end fab output.

[@Yggdrasill8]

@@paulstubbs7678 We gotta build 10 more 20billion dollar semiconductor fabrication plants essentially