Fixing our server's biggest flaw

[@LinusTechTips]

What do you think of our Nu Nu...wait, how many Nus? Anyways, what do you think of our new server? Let us know below! Buy a SABRENT Rocket 4 Plus 8TB NVME M.2 SSD: lmg.gg/qgDC3 Buy an ICY DOCK EZCONVERT MB705M2P-B NVMe SSD to 2.5" U.2 SSD Converter: lmg.gg/fjTFz Buy a StarTech U2M2E125 NVMe SSD to 2.5" U.2 SSD Converter: lmg.gg/76FvY Buy a GIGABYTE R282-Z9G 2U Rackmount Server: lmg.gg/CxlsQ Buy an AMD EPYC Milan 75F3 CPU: lmg.gg/DzxJF Buy Micron 3200MHz CL22 DDR4 2x4GB EEC Memory: lmg.gg/k1myU Buy an Ableconn E1s-DT157 NVMe M.2 SSD to NVMe EDSFF E1.S SSD Adapter: lmg.gg/PC1kk Purchases made through some store links may provide some compensation to Linus Media Group.

[@shadowkiller5520]

Pin comment lol

[@prathameshlotankar405]

Nu nu means something else in 8ndia

[@orenraveh1162]

​@@prathameshlotankar405 bruh

[@i-am-toast4235]

Add a cow decal and call it Moo Moo Whonnock

[@blueban9252]

Not Bad. Its not like the FASTEST

[@winter9087]

Cant believe linus would lie to us. This is truly worse then the hard r incident

[@PizzaPowerXYZ]

The hard L incident

[@joggypaster8959]

​ٴ linus thought that saying hard r meant something different, not the n word so he said he has used the hard r before on the WAN show

[@seeingblind2]

The Hard Based incident

[@MarioKarasuma]

It's ok, he had his fingers crossed

[@jaimingreer3400]

LIEnus

[@adhdengineer]

Every server update seems to start with "our last server update was a bit of a lie..."

[@forthex]

So the "high school chemistry curriculum" approach

[@aimenalawdi9705]

@@forthex true but, not a bad way to teach chemistry.

[@IdentifiantE.S]

True !!

[@gallium-gonzollium]

They changed the title so I think that was a bit too good of a statement lol

[@yuryzhuravlev2312]

because they use OpenZFS again and again, and even didn't try to read and check alternatives!

[@xmchonkyx]

I like how he said "leftover 8 TB " drives.

[@doctordothraki4378]

Around 1:49

[@Masterzx32]

Sad😢

[@Metal_Maxine]

sabrent sent him a ton of them for a pc build

[@SixOThree]

He has to make sure sabrent gets their money's worth. They sent him $20k+ worth of drives. They've since gone up in price since the first video though.

[@Michalosnup]

Linus: We can use cheap consumer SSDs Also Linus: proceeds tu put in sabrent 8TB SSD, which costs more than my whole computer

[@aurunemaru]

gives a perspective on how wild(ly expensive) server stuff is

[@IngwiePhoenix]

I mean... its his version of cheap, i guess. xD

[@BobSentell]

From an enterprise perspective, those consumer prices are rounding errors. We recently priced a temporary database using existing hardware for a client at $800,000 and their response was essentially, "how do you want to be paid?"

[@descendency]

@@aurunemaru And how expensive running a company is... vs a personal home thing.

[@Thatonefuckinguy]

to be fair, in the server space, "cheap" means "this didn't cost me close to a million bucks."

[@DrathVader]

Linus and his son messing about with server hardware has to be my favourite type of LTT videos.

[@GrueneVanilleWaffel]

xDD thank you for this comment, sir !

[@clodman84]

Thats his boyfriend

[@sorcierinfernal]

You mean his boyfriend

[@Urboyfromfuture]

Not lying, server videos are my favourite content on this channel. Not to mention that I gained vast amount of server knowledge from these videos. Also I need to know who is the new editor. 4:42 8:04 😂

[@christopherrenn8137]

Also 12:09 :) lol

[@jefez75]

nightmare fuel of edits edit: OF COURSE IT'S APRIME, how could I forget him being the king of meme editing in LMG

[@NicosLeben]

You can always see all the people involved in the videos at the very end.

[@WienerschnitzelFett]

stop the effects

[@dennispremoli7950]

Alexandre Potvin. All credits are at the end of the video.

[@mirrorsandstuff]

Storage requires performance - but it also requires reliability, availability and serviceability. It's been fun (if painful) to watch LTT make mistakes and correct them... Admittedly, for something so vital to your company, one would have inter-site replication. Currently, my concerns are underlying software issues (as hit previously) and stuff like the server mobo itself failing. It's relatively rare, but you'd have a bad time. A twin canister based approach would probably be more bulletproof, but would still have a midplane to crap out. So, yeah, good replication and redundancy over separated failure domains feels like where I'd go. Admittedly, I'm basically suggesting getting a second storage array for no additional capacity. But keeping your data is always handy.

[@drstefankrank]

With 100 employees a well proven SAN storage with vendor support is not too far away. We have customers way smaller who can afford this. The problem with LTT is the huge amount of data and the requirement to be extremely fast. Our "normal" customers only have the requirement of being reliable, but not necessarily huge and fast at the same time.

[@username8644]

Most problems Linus encounters are all software related. Everything from all his wireless tech in his house, to OS they run on their servers.

[@username8644]

​@@drstefankrankThe solution would just be to have multiple servers for their editors rather than one huge one. One server for like 5 editors for example. This is what is normally done in the industry lol.

[@mirrorsandstuff]

@@username8644 yeah - their performance requirements may be high, but honestly so are many customers these days. And I'm honestly not sure one can call it /huge/ - multi-petabyte footprints are pretty common these days.

[@drstefankrank]

@@username8644 Yeah, it's mostly end user stuff for the cheap, but no enterprise. There's a reason it costs more. Having a storage that just opens a ticket at the vendor and having a replacement part waiting the next morning without any manual steps is gold.

[@adamleszek389]

Regarding identification of failed drive you can do using M.2 Serial number where it is visible in OS.

[@Programmdude]

They'd still need to turn it off, pull out each of the bays, and read all the ssd serial numbers. If the SN isn't visible from the top, then that also involves unscrewing and unplugging each drive. Not hours of testing, but enough time that I can see why just slotting an extra spare in the front was a better way to go.

[@tylerebowers]

10:27 Those blanks are actually to equalize airflow across all drives.

[@giacomo.1574]

Yeah i guess they know that but the remark they were making was about how overly complicated they were, with the full sled and mechanism and stuff, while their only purpose is to be a plug

[@tylerebowers]

@@giacomo.1574 Yea they are unnecessarily complicated.

[@corner_store_bill]

5:39 i love how he blows the dust up and then away. thats something everyone should do when its laying down. if not then the dust lands back into the case...smart. i thought i was the only one

[@jonmayer]

I don't know why, but these server builds are always really fun to watch. So much faster than anything I could ever need or afford.

[@snip3d]

It is indeed fun.. for the first few.. then it becomes annoying, slow and heavy to unbox when you have to populate an entire DC.

[@Nick85]

I am loving the server content! Been learning the hard way by diving into the deep end. My team has no one else to configure or maintain our servers...and I'm relatively new at sysadmin type stuff. Lots of limitations to work with and things to learn. So, standard IT job? 😂 Would love to know more about what you use to stress test your server configuration. Thanks for the show and tell!

[@firesyde424]

We have a build like this in progress currently using a Dell PowerEdge R7525, a pair of AMD Epyc 7763 CPUs, 1TB of RAM, and 24 of Micron's 30.72TB 9400 Pro U.3 drives. There's so much to learn about tuning these to run in TrueNAS for workloads at this performance level. It's been quite the long haul but I'm happy to say it performs better than anything I've ever seen, even on this channel.

[@ericneo2]

One of the things they didn't cover is how the ARC Cache reduces latency If you get your DB, Web Server and file contents into ARC Cache your read performance skyrockets. You go from making a queries, building a page from something like 2600ms to 60ms. With multi-threaded DBs and Web Servers seeing the most improvement.

[@memerified]

O

[@SixOThree]

Did they mention what OS they're going to be running here?

[@ericneo2]

@@SixOThree 10:40 - They are using "TrueNas Scale"

[@SixOThree]

@@ericneo2 thank you. I did miss that

[@dylanguerrero8053]

Been getting into making a homelab. Ill never need something this insane for my home but its great information for my already packed brain.

[@Holycurative9610]

I've used Startech products for years now and have found all their stuff to be incredibly reliable and really good value. The only problem I had was the casing came lose on an HDMI cable and they replaced it despite it being over 2 years old.

[@filpoamati]

But you know what Linus never lies about? Our sponsor, Glasswire!

[@benover17]

Linus smiled when jake said he doesn't have a bugatti knowing damn well he can afford one

[@GrandNebSmada]

I could feel my soul starting to leave my body at 4:42 that was actually slightly terrifying lmao

[@Zyrchin]

Hey Linus, thanks. I put a 1TB SSD in my Steam Deck today and got a ton of help from your last videos and the LTT forums - it was awesome.

[@memerified]

Why not rog

[@Zyrchin]

@@memerified because a 1080p screen on a handheld is like a 4k screen on a laptop - too much battery drain for not enough visual uplift. Unless you're playing plugged in, it's not worth the extra pixels. It's like a less egregious Pixel Book - specs for the sake of specs without thinking them far enough through not to mention the software problems. W11 on a handheld is hell on earth, especially without trackpads (I tried W11 on Deck and only the trackpads worked). Just. Fucking. No.

[@gachzedek]

The first minutes of this video reminded me of my old boss at a former work place, all bells & whistles, no documentation, backup plan, disaster recovery plans in place.

[@Neoxon619]

At least now you have a solid foundation to build your home server from as you expand it.

[@architect_kev266]

6:32 I kinda like it they are more enthusiastic about the special wrench then about the server

[@not-another-dev]

Careful with sabrent nvmes had two die in the space of a week after a firmware update over a pcie riser, which nuked firmware on both drives. They’re no good for mission critical stuff

[@Thenewmikelmyer]

"Take your hands out of my pocket sir; I don't appreciate this." Has me dead.

[@shalipe]

HAHAHA Jake was particularly excited in this video.

[@guidowinter]

Linus + Jake is fun to watch. Especially when they try to do things their way. Why would there be professional stuff? 😄

[@markminch1906]

1:35 "at least its a good transition (pause) to how were going to fix this", you can see the other guy cracking up because he knows hes going to troll all of us who thought he was going to switch to a sponsor ad

[@esaedvik]

Just keep in mind that SDDs perform better when warm. There is an optimal temp, so don't cool them to an absurd level.

[@Darkk6969]

This won't stop Linus from trying his insane artic cooling solutions on them. 😁

[@StompySan]

4:41 Best edit in YEARS. Whoever is responsible for that deserves a bonus.

[@tactoad]

Imagine to be able to run an internal infrastructure for a company this size with consumer hardware/non-HA solutions based on "content". Kinda jelly NGL 😂

[@112Haribo]

I know right? For a company that was valued at 100 million dollars recently they sure run janky infrastructure.

[@carlosdgutierrez6570]

That is part of the charm and a source of future income, after all their viewers want to see them repairing their janky infraestructure.

[@Respectable_Username]

I love these enterprise tech videos! Consumer stuff is all kinda samey, but there's so much cool problem solving that goes into enterprise systems designed for very specific use cases!

[@carlsoll]

11:45 Sounds like a Fighter prepping for Takeoff

[@ThatGuy-ou4ev]

Linus is pumping out content so fast that I don't have enough time to keep up with watching. I hope he's not disrupting the other employees workflow or the new CEO might just need to have a word with him.😂

[@KrisLipscombe]

When Jake one day snaps it’ll be about the Whonnock naming

[@dragon2knight]

The fact this janky server works at all is amazing at this point......starting from scratch is it's only hope. Or you can just continue using this beast until it explodes making for good content...and LTT is all about that approach all the way 😂

[@Hirako_desu]

The face morphs give me hardcore Cow Chop nostalgia and I'm all for it

[@DrivingWithJake]

I love watching you guys play with servers as it cracks me up sometimes. I know a few weeks ago for us we had a customer having issues with our 10gbps ports we linked up for him on another switch in a different rack so we installed one of those connectx4 100g ports and stuck them on the same switch with a pair of 40g ports and bam issue solved. :) Consumer SSD's are often times the same speed if not faster than most enterprise drives. You only get more endurance out of the enterprise drives which is why we mostly use them in the data center world. We just racked up 3x 2U 24 bay nvme systems the other day.

[@brendonwu1416]

"At least it's a good transition into....how we're going to fix this" really got me. Me screaming TO OUR SPONSOR and getting played sadge

[@ham5877]

If i’ve learned anything about LTT, it’s that the server room will never be fully upgraded.

[@MozartTheGOAT]

Naahhh, I need that secret screwdriver RIGHT NOW!!!

[@ChristianWheel]

WORD OF WARNING with these adapters! I've tried a few different brands but every now and then they like to drop offline for a bit and then come back. That's not too big a deal for my smaller use case, but in a ZFS array that can be real bad news. Even a successful rebuild will invisibly eat away at the endurance of your consumer drives, and if you have multiple simultaneous failures in just the right configuration, it's game over. These adapters are great when they work, but they're the weakest link in what sounds like a critical server for you guys. Something worth setting alerts to monitor and if you experience dropouts like I did, time to move to a few Micron 9400 Pro 32 TB drives.

[@126sebi]

When Jake threw that card at Linus then the edit of him being like thank God I caught that good moment lol.

[@djangoryffel5135]

Enterprise SSDs aren't that expensive, if you look for the right ones. Intel P5510 7.68TB is around 435CHF with taxes. Samsung PM 9A3 is around 500 with taxes. So around 640-740 cad. Thats cheaper than some M.2 consumer drives are, at least, if you only compare to TLC and Gen4. But none of this consumerdrives is rated for 1DWPD @ 5years. And we haven't even touched features like powerlossprotection or continuity.

[@incandescentwithrage]

Yep the m.2's will be dead in no time

[@theElemDragon]

Jake: "Catch!" Me: ".... You DO know Linus.... Right?"

[@leexgx]

Or just log what drives sn are installed in each card so you know where its located

[@krispychiken]

Some of my favourite videos on LTT are Linus and Jake getting giddy nerding out about fast servers lol😆

[@kaoru288]

I love the editing. its reminiscent of the good ol YTP's from the 2010's

[@DakPrescottlol]

Linus is now in his element. Glad he doesn't have the stress of day to day operations. No price can bring you joy.

[@jessechristman1471]

Jake is just present to annoy Linus and its the best dynamic

[@MRPtech]

2030: Linus: Hi everyone. In today's video we will build nu nu nu nu nu nu nu nu nu nu nu nu nu Whonnock server Jake: "face palm"

[@dominiklukacs7677]

Linus drops things, Jake THROWS them

[@chowhiyeon]

Let intel decide who has worst naming convention.

[@RB-pp9cx]

7:55 Woahhh Nick Light is back?!!! Nice seeing him on camera

[@TheTechwizGuy]

❤

[@EonNShadow]

"just like this" at 2:07 had me dying lol

[@Frostycrypton]

4:41 here we see Linus regret his decision of stepping down as CEO since he can’t fire Jake.

[@BudgetGamerz]

Woah... Things are actually "expensive" when you have to pay for them??

[@TheTechwizGuy]

😂

[@brucejamesj]

Welcome to the future! I did that months ago on my old Dell 13 Gen servers (a rack full of them) that used SD cards for their boot device (don't ask, it wasn't my decision). I now use the StarTech converter and the loads of M.2 we have, as the boot devices on all the servers and do all of this as Metal-as-a-Service. Granted, it's not for production use but for our lab to allow us to move more quickly!

[@Call_Me_David]

The editor most have had a blast with all the crazy eyes in this one.

[@Dimmers]

As I continue to watch videos from LTT, I am realising that it is more of a hobbyist/enthusiast channel and should not be taken too seriously. It seems that if they had consulted with IT professionals, they would have avoided some of the silly issues they make from their own lack of knowledge. While this makes great content, it also highlights their lack of knowledge in a professional setting, which shines a light that they have limited knowledge and are curious about what other info/knowledge they lack when they produce other videos. That said I do find their videos entertaining.

[@gabrielenitti3243]

hi, do you mind sharing in what ways they could make a more professional job? Most of us are here to learn and LTT inspired many of us to go into tech careers. What do you think they are doing wrong?

[@Dimmers]

​@@gabrielenitti3243, I used to be in the IT industry and I think it's great that LTT inspires people to learn more about it. However, as someone who has studied IT, I can say that while hobbyists and enthusiasts like LTT only focus on the specific chapters or pages they need at the moment, someone who has studied IT must read all the chapters and be tested to ensure they have a well-rounded knowledge of the field. LTT tends to focus on new technology and often makes mistakes that they later have to correct, which could be problematic in a professional setting. My advice is to follow IT professionals in addition to LTT to get a better understanding of the industry and consider pursuing a diploma or degree in IT if you're serious about it. Many IT professionals enjoy LTT's content for entertainment value but don't take it too seriously. For reference, I have a Diploma in IT and studied Computing Science at university.

[@SamiulIslam-dr3ew]

Love your contents Linus

[@nate2838]

8:32 Love the sound effects. Sound effects make life more interesting :) 9:46 Is hilarious! "What is wrong with you? Why do you think you drop shit so much..... Can I just show them what going to happen?"

[@skawtch]

Is that "Girls Just Wanna Have Fun" playing in the background while Linus and Jake are installing SSDs in sled? 😂

[@TheKolikolik]

Can we just appreciate the editing on this one though?? I love the Gen Z styling we're getting with the meme-faces

[@TheTechwizGuy]

❤

[@TeaObvious]

i hated it, maybe i am to old, but WTF! >_

[@TristensMadness]

Nick: "There in my pockets. Take your hands out of my pockets sir I do not appreciate this." HR: Eyes bigger than nicks. Nick: "Here you can show that." Linus: "AHHH SICK!" Greatest part of this whole fucking video. I love these little hilarious moments. And we still don't even get to see what they are talking about, although it's clearly screwdriver V2.

[@B4WZeR]

whoever randomly decided to do content aware scaling in the video, thank you for that, had a good chuckle and few cursed images

[@Mighty_Dork]

This is truly one of the server videos ever made on the LTT channel

[@CombatClient]

I love the editing in this one! The eyes at 12:07 Hilarious😂

[@Poi244]

The editor today was doing gods work with those faces

[@Haruka69]

4:41 Holy crap that's a face I'd see in my nightmares.

[@rekkitc1587]

12:07 good touch with the eyes. Subtle. Screen shot and memed now.

[@wraithwrecker_]

For as much as Linus raves against terrible naming schemes, it's surprising how terrible LTT's naming scheme for Whonnock servers is. Every time they do an update, they add like three new's to the front of whatever server they're working on.

[@TheDwarvenDefender]

By the time I'm a productive member of society, Linus will be recreating the old Batman theme. ♫ Nu nu nu nu - nu nu nu nu / Nu nu nu nu - nu nu nu nu / WHONNOCK! ♫

[@JustAPersonWhoComments]

The suspense of finding the dead drive, the dilemma of mismatched SSDs and the heroic entry of the m.2 to u.2 adapters

[@CODTerracraft]

4:41 is absolute gold

[@Gamer-ct6hb]

How dare you lie to us. And make maintanence bad. Next server video you're probably gonna talk about losing the data again (in a few years) because some cosmic rays messed up the file systems of multiple drives.

[@caterhamnz]

Linus on USB and intel naming: "This is insane, what were they thinking!?" Linus on server naming: "This is nu nu nu nu nu Whonnock"

[@pimperorpimpatine3199]

I really like this video. It radiates the same fun energy as some of LTT's old videos.

[@Juhcarro]

How dare you lie to us Linus

[@kienanvella]

I love how during the fio test, you can just hear the fans continuing to ramp up as the test continues

[@108kitsune]

Wtf is up with the editing?

[@rome2580]

i dont think i can count how many times I rewatched the part where he tosses the "fancy" network card at Linus and says its "old now." when Linus realizes what it is you can see his neck tense up a bit.

[@nathanscarlett4772]

I was waiting for Wendel to come out of nowhere and scream "Ic3y D0cK!!!"

[@jacquesburger4103]

Give whoever edited this video a raise!!

[@djwillcaine]

Can't wait till the nu nu nu nu whonnock server vid drops

[@giov4nn1]

dont know shit about servers but still watching these videos because its fun to watch linus and jake goofyng around:D

[@just_eirik]

Did you remember to document which SSD is in which slot?

[@franciscopena7859]

3:55 Jake's face: Why do I work for this guy

[@tilgare]

I'm sure it's been talked about loads of times by now, but I just wanted to say I've been enjoying the longer intros before the sponsor bit.

[@Rainbow__cookie]

4:43 im dying that was funny thanks editor 7:57 there again love your editors

[@Delistd]

I used to hate Linus, now I freaking love him. I see so much of myself in him now for some reason.

[@rafaelpernil]

I like the term "manufactured garbage" for placeholder 😂 10:28

[@djr093r5]

It's like watching Doctor Who: "Strictly speaking it's the 15th nu Whonock. That makes it nu, nu-nu-nu-nu, nu-nu-nunununu, nu-nu nu nu, nu Whonock"...

[@CPPRODUCTIONS1001]

The editing was hilarious this video

[@JanoPral]

4:42 man this is beautiful

[@TheBurg229]

Gotta love the hearing damage you get from those servers

[@rubikfan1]

So when are you building 10pb project. Its defently possible now. With 22tb drives you only need 454 drives. With 90drives in a 4u slot. And 42u per rack. You could fit 900 drives in. So only 5x90 drives should do. Plenty of space for other drives.

[@BigBoiYT651]

The editing on this is absolutely hilarious 😂

[@JSON_D]

At the size you folks are hitting, you should really start considering something like a Pure Flashblade. I'd love to see you drag race one against something you put together yourselves.

[@nathans5773]

Best sponsor segue I have seen in a while.