$90000 NVIDIA A100 GPU Server

#ai #gpu #workstations
CPU: Intel Xeon Scalable 5220 (2EA)
M/B: ASUS WS C621E SAGE
RAM: SAMSUNG DDR4-3200 ECC/REG 256GB(32Gx8)
SSD: SK Hynix PLATINUM P41 M.2 NVMe 2TB
VGA: NVIDIA A100 80GB (4EA)
CASE: 4U RACK
POWER: SuperFlower SF-2000F14HP LEADEX PLATINUM
FAN: Phanteks PH-F120T30 (9EA)
CUSTOM PARTS: Alphacool 3647 (2EA), Alphacool A100 Carbon (4EA), Alphacool 360mm 60T (2EA),
Alphacool PUMP, Manifold 7Port, Quick Disconnect 6Set, Black PVC
Yangcom Home Page
www.yangcom.co.kr
Yangcom Instagram
/ yangcom_official
Yangcom Facebook
/ yangcompc
Yangcom Blog
blog.naver.com/combox0

[@filipe972]

You know shit gonna be real expensive when you don't even recognize half of the hardware's names.

[@Nemazares]

Could not be for cheap one

[@BlackJobZ]

But all of them are easily recognizable?

[@MobileGamingMK]

tell them that you get nvidia A100 to some average gamer and see their reaction@@BlackJobZ

[@O0OMega]

​We r talking about kinda above average pc user​, not tech professionals@@BlackJobZ

[@kliniktech2485]

Jelous 😂😂😂😂

[@des7royerz]

Finally a build that can run Crysis in 1080p 30fps,nice 👍🏼

[@Porsche_x]

640p 20 fps Maximum

[@des7royerz]

@@Porsche_x my results are using Frame Generation and low settings

[@Porsche_x]

@@des7royerz So yes, I said 640p at 20 fps using graphics very low without dlss and without frame generator

[@TCLG6x6]

LTT ran Crysis on AMD Server CPU with software rendering and got like 10 or so

[@mikolamy2677]

with dlss 3, fsr 3 and low seting 🤣

[@thenasiudk1337]

This PC consumed more power than my entire house electronics combined

[@aa-qx9cx]

about 2kw when all processores is max-loaded

[@NowhereNear42]

Your water kettle would easily consume more power than this machine.

[@thenasiudk1337]

@@NowhereNear42 we talking about electricity, not heat

[@NowhereNear42]

@@thenasiudk1337 You talking about power. This PC uses electricity to produce heat. So does your water kettle.

[@user-yd9wf6kn1l]

Doesn't use more than 2kw.

[@imfakeris1]

Finally, a server for running Latest version of minecraft in the future.

[@BOTLT1]

😂😂😂😂😂 Minecraft

[@DespaceMan]

Tetris

[@plaguegaming3642]

still only get 45fps in vanilla MC

[@kode4420]

Vastly underrated comment. 😂

[@misterfox3464]

А ты в теме😎

[@Sykuro42]

finnaly a pc to compile gentoo

[@ayanamisuki]

You would have the fastest emerge times in the world

[@AIC_onyt]

my i5 13600kf took 4h to emerge -avq this thing would do that in 10 sec xD

[@goodfodder]

would not like a coolant leak in that

[@karely_ai]

I can't imagine how satisfying it must be to train LLM´s on that thing.

[@user-vp2tv8ff8j]

you can easily rent set up like this for around $4 per hour

[@rd_626]

@@user-vp2tv8ff8j Renting is not satisfying as owing and running and training LLM's locallly

[@sohailmd123]

​@@rd_626what the hell are you talking about?.The satisfying OP said isn't about “owning and training”...its about how fast it will train LLMs. Try renting tpuv4 or even the new ones tpuv5s....smooth as butter. you will never ever run anything on gpus again lol

[@rd_626]

@@sohailmd123 Just FYI..... I wasn't saying that to the op

[@sohailmd123]

@@rd_626 “satisfying” is literally OPs point of contention. you can't take it out of OPs context....any ML engineer only gets satisfied/orgasms on how fast his large data is being trained before his eyes....not by owning costly shit just to see it train mid compared to tpus

[@user-de2qx4pc2u]

-Для чего тебе такая сборка. -Чтобы Excel работал без лагов.

[@and7770999]

Наконец-то я смогу открыть 4 вкладки в хроме))

[@alexanderandreev7151]

В перерыве можно и пасьянс разложить по-человечески.

[@parkminjae8994]

LOL

[@ThemNoodlesthickasf]

I'm afraid to ask this question and rather just look at this beauty but "Does it even run..?"

[@AlphacoolGmbH]

Crysis....

[@rd_626]

Used for AI backend stuff. Mostly for training. Runs only on linux

[@mundocpc]

I am not a fan of liquid cooled servers, but we have air cooled units with similar specs (mainly Supermicro) and they are way more crowded and noisy as hell. That one looks really nice and neat, and you should be able to sit next to it without going deaf. Also, in the long run it won't end so full of dust and crap. This one of yours is a custom unit though, so the client probably had certain requirements in mind, but not others. I see he/she decided to skip things like plug and play redundant PSUs, for example. Also, any leak could cause catastrophic failure and down time, which is not always acceptable. Anyway, very nice.

[@noJobProgrammer]

I completely agree, liquid cooling in the server environment is a complete nonsense. It doesn't matter how qualitative is the cooling system, it will leak sooner or lately.

[@Mic_Glow]

​@@noJobProgrammer I know some servers use liquid cooling but it's probably more like AC, with heat exchanger close to the server racks rather than using water blocks directly on components

[@mph8759]

In high density applications such as HPC or AI training liquid to chip can be used, particularly in the 80kW/rack+ range

[@edmondhung6097]

IBM Mainframe can be liquid cooled. Since its reputation for reliability, I’m sure reliability isn’t an issue if do it correctly.

[@Mom19]

​@@noJobProgrammerif it leaks, you haven't done it right. Does your house plumbing leak every few years for example? If you do it correctly, there is absolutely no problem to be had there

[@janjuliusvannieuwenhuyze9853]

It must be so scary to work on gpu's that expensive

[@rohi6ec]

interesting setup. is 2kw power supply enough to fuel system like this? and what about temperatures with closed cover?

[@acarrillo8277]

Where are your CPU heat sink clips? Or do those water blocks not allow them?

[@Apollo49152]

Love to see the performance stats on it once it's powered up.

[@jrcat2258]

Is that 2kw PSU enough to run two Xeons and 4 A100s?

[@Porsche_x]

Yes

[@NegativeROG]

If you assume 500W per component at full power (it could happen), then it's 1000W short.

[@Mr.Not_Sure]

​@@NegativeROGA100's are 250 W.

[@thechadbuddha]

@@Mr.Not_Sure lul

[@Kenichitr]

@@Mr.Not_Sure A100 on AWS can use upto 450W. Still, in most local setups people will limit its usage to 350-ish because even a good liquid cooling won't cut it. Fyi, the instance i use is p4d.24xlarge so they are 40Gb versions. not 80Gb. i don't know if 80Gb ones work in lower watt or not.

[@sinchrotron]

Any reason it should be mounted this orientation? Why not upside down, so leaking coolant will not damage the mobo?

[@metalhead2476]

Why don't you do an actual review of the power it has? Some benchmarks. It would be awesome.

[@flamixin]

Kinda want to see the thermal performance of this build. The fans don’t seem like powerful enough.

[@divinehatred6021]

Its not about the fans. Its about shitty MX-4 that he put on the everything

[@Turborider]

Yeah, the most overrated thermal compound. Noctua NT-H2 is way better for example.

[@MustafaKhan-hg8lu]

​@@Turboriderthermal compound isn't making or breaking this build lol. Maybe the most unimportant part of cooling as long as it's applied right.

[@Turborider]

@@MustafaKhan-hg8lu I have my own experience that I have made over the last decade on many different computers and laptops. But I'm not going to argue just do whatever you think is right.

[@Mom19]

​@@Turboriderthen you should use Kryonaut Extreme or a Kryosheet. I myself work on a lot of stuff and MX-4 is completely fine for everything you could want as a "normal" person. It also really depends on what you want to do with it. For example I've had a bunch of issues with NT-H2 squishing away from my GPU die due pump out caused by the extreme heat and power I was pushing through that card (3090 with an XOC BIOS). On my 7900X, its another story. No direct die setup. NT-H2 was fine and pretty okay, one of the better pastes that I used. But with Kryonaut Extreme, I got way more stable clock speeds while pushing the same amount of power and thermals. Heat transfer is simply just better with this one. However, I would not recommend it to anyone that doesn't want to push for the absolute best results. It's simply too expensive. But for everything I use personally, I use not much else anymore.

[@sadr-yt]

i guess a single cooling fan is worth my entire house but okok 👍

[@user-uj8qn9ed3c]

I'm waiting for the benchmark test, do you have it? how long does it takes to train nanoGPT medium size model?

[@shidongxu3410]

He just wanted to show off and prove he could afford one.

[@z4k1_zaki65]

@@shidongxu3410 They are an actual computer shop! This is for their client

[@Anthonyg5005]

@@shidongxu3410 This is probably his job and he's just showing the process

[@rd_626]

@@shidongxu3410 no way someone can own 4 A100's and use it for personal usage

[@thefrenchspacer]

@@rd_626 a lot of people can but why would these people do it is the proper question.

[@emilpopovic9742]

Why you didn't put ram in all slots? I think you crippled the memory speed quite a bit. 🤷‍♂️

[@whyjay9959]

Why leave 4 memory channels unused? Is the client buying more DIMMs later?

[@norteal7110]

guys thats pure power, nothing else

[@Magovit]

I can't imagine how satisfying is disassembly and repaste all again in the correct way.

[@DonaldJPump24]

Watching that cloth glove get close to the socket in the first 5 seconds was nerv racking

[@cf9699]

How long will game streamers have to play before you get your money back, including the energy bill.

[@ToySeeker]

Are the Xeon’s thermo-electrically cooled? Is condensation still a problem? 😔

[@fenio81]

There are no Peltier cells there. These are ordinary water blocks.

[@TNG88]

Thanks, amazing, will be nice if you power on the server. Windows? Linux?

[@NegativeROG]

2 questions: 1- Why not fill the remaining memory slots with 4x32GB? 2- Would custom length cables have removed some clutter and added to the airflow in the U4 chassis? Nice job, I've already got a perfect spot picked out for it.

[@RedBeardedChen]

Это для 4ой вкладки в хром? Или для 20 ФПС в киберпанке с пастрэйсингом?:)

[@sakilakhtar]

Bro build his own personal super computer 😮

[@Stehaufmaennchen101]

Just one A100 would be my dream frfr

[@cooooooooooooooool3]

why would you need one ? It's mostly for data centers and stuff, unless you're doing something to use that 80gb of vram, because for gaming it would be pretty uderwhelming, as the driver suport wouldn't be the best.

[@Stehaufmaennchen101]

@@cooooooooooooooool3 because ai applications in general, aswell as LLMs run like shit on the RTX 4070. Training obj detection nets also take quite a while even with pytorch+cuda :(

[@cooooooooooooooool3]

@reapiu8316 That makes sense, you have pretty vram intensive workloads. My dayjob is video editing, so I never exceed 4gb of vram use even with 4k editing

[@Mr.Not_Sure]

​@@cooooooooooooooool3my Firefox uses 11 gb vram :(

[@TheJimmyCartel]

Depending on the task. Nvidia Tesla P40 is not a bad entry for 24gb of vram in the used market. Runs RVC smooth as butter in my experience

[@divinehatred6021]

MX-4? Seriously???? Why didnt you use Noctua NT-H2 thermal paste? Or Thermal Grizzly Kryonaut Extreme?

[@MustafaKhan-hg8lu]

Y'all have been marketed to too hard. The thermal paste is maybe the least important part of cooling this over here as long as the paste is applied evenly. You don't actually need thermal grizzly unless you wanna overclock or if you just really like KZbin sponsors

[@divinehatred6021]

@@MustafaKhan-hg8lu you know its A100 we are talking about, right?.. its not your average 4060

[@sergeigenin8180]

там и GD900 справится

[@pitterpatterlf]

Which quick disconnects are these?

[@Chris-kc4qh]

What's performance can you show any performance.

[@matthasaname]

It's crazy how much tech goes into pumping around less than 2 volts through a few chips, and then we need a hoover dam to keep it all cool.

[@alipsa823]

what gpu server used for? first time i see this monster

[@JamesSmith-ix5jd]

What's the reservoir with many tubes?

[@quasaristmagnetar2658]

what are those holes on the IHS?

[@oldsk00l]

All zero maintenance tubing too. Very nice.

[@scalty2008]

Where I can buy this water cooling for A100 ?

[@verminfate7074]

Props to the guy building it, has to be the first person I have seen who isn't deathly afraid of a little extra thermal paste.

[@kode4420]

How it felt to work on the big box palsma tvs back in the day.

[@game-tea]

no threadripper or epyc?

[@megatonpolska8579]

Question, why Xeon and not Epyc platform? If i recognize correctly, Epyc is made for servers, and its powerful

[@mowtow90]

It doesn't matter (whatever was available/affordable in terms of CPU+mobo). Its a GPU node , the CPUs are only there to provide the PCI lanes, run the OS and handle the IO. Everything else will be handled by the GPUs on application level. That is why he didn't put much RAM in it because , it doesn't need it.

[@Giovani_Avelar_BR]

Can anyone tell me what model these frosted hoses are?

[@Dem4in]

What is this server for?

[@Alte.Kameraden]

Question? Can it run ARK Survival Ascended without using console commands?

[@rykit8726]

Скажите пожалуйста , эта сборка потянет MARIO или TETRIS ?

[@Araqnov64]

Is it necessary to have two cpu?

[@DeadEndX]

It sounds like a jet engine while its running and needs cooling made for a small office to keep it running. Unless you are 100% gpu and 100% ram usage, it won't hit near its total wattage consumption. In comparison to a dgx1, it can do 40% more work while consuming 20% less power doing a task that would max out a dgx1.

[@HansCombee]

That's progress. In the 90's we would pay this voor a DEC VAX 128MB memory expansion.

[@ManuelKibarian]

Bros getting ready for gta 7

[@ZoruaZorroark]

i bet this rig can finish the f@h workloads my rig does in a week, in like an hour

[@techthis]

What are you using this server for?

[@jawunk]

엔비디아 폼 지린다

[@nguyendanh8828]

Why use a football field to replace a CPU socket?

[@tizio_996]

now im ready to play minecraft

[@and7770999]

Ready to open google chrome with 10 tabs)))

[@Nemazares]

What the hell IS bro cooking

[@asparagusp5216]

His CPU's most likely with that thermal paste application.

[@caspervon3880]

Bro gonna create another dimension

[@mattm1773]

out of curisousty...why 2 Xeons and not the 7995WX Pro Threadripper? sweet server build though!

[@AlfaPro1337]

That has so much glue, latency and bottlenecking. Plus, it's overprice AF. You think that 7/9980XE asking price of US$2K was nuts, AMD's line-up takes the cake. Thanks Evil Su!

[@Todd_Manus]

Maybe it has to do with some compatibility issues on AMD side. Although the Intel/AMD CPUs share the same instruction sets for the most part, the software that is going to be running this hardware might be very picky.

[@treniotajuodvarnis5503]

budget system with last generation nvidia ampere GPUs even v3 or v4 haswell or broadwell xeons would be ebough

[@lilunchengsmiles]

For machine learning, this is what the purpose of this build is for. For ml task, use Xeons due to Intel’s math library

[@Porsche_x]

Amd threadripper is for workstation Intel xeon and amd epyc is for server

[@dooonot]

Nice boiler!

[@jefflucas_life]

Hmm, this build needs a bigger acrylic case, awesome setup!

[@minerzcollective6755]

What case is this?

[@MrGoThrough]

amazing how they could get the cooling plate of the gpu on the market..

[@joseperez-zo6fr]

I would’ve mounted this in an enthoo pro 2 server case😊

[@abenxio87626]

Can it run 5 chrome tabs?

[@imperia777]

Why not samsung ssd?

[@PedroManzoli]

Hell yeah

[@ollpa-on6nd]

What is it good for?

[@rodrigocunha34]

Very nice build, but this watercooling loop seems underpowered

[@therealpepsicat]

"bro the servers are bad im lagging" The servers in question:

[@mick2d2]

Why are you wearing gardening gloves? 😂😂

[@Kezooxinua]

зачем горячий воздух гнать в корпус а не сразу наружу?

[@EinSwitzer]

Everyone talked shit until the snow part of crysis then parts started to melt

[@Tim-Kaa]

Finally, something adequate to run Tetris

[@alekstactic]

А где тесты?

[@tjgonline1304]

One can dream.. but never have.

[@Kalifriki]

no ram, vrm, eth cooling, different length of tubes lead to uneven water flow, correct me if I'm wrong

[@kier7850]

i need this for my school works

[@gravelhs]

Q: What does this computer do?! A: yes.

[@de-todo-un-poco-argentina]

hola esa super pc sirve para minar alguna cosa?

[@sloanNYC]

Insane.

[@denazick]

Why 8 channel ram? If you have 12 channel

[@nehemiasalvadora3881]

oh so that is why we have a pc part shortage

[@HisNameIsRobertPaulson01]

Such beauty.

[@FelixBuilder]

I actually have 2 of those SK hynix M.2 2tb for my pc

[@paulwais9219]

did this thing actually work?? you have six components on one thick 360 and normal 120 fans. I cannot believe temperatures under load this system better than 60C

[@lillee4207]

60c is ridiculously cold, especially for server shit. There are thousands of those on earth running 80°+ right now, and they're doing just fine

[@paulwais9219]

@@lillee4207 if it's intended for loud operation / server closet then can go air-cooled and save a ton of money / complexity

[@lillee4207]

@@paulwais9219 100%. But don't discredit the thiccboi rad

[@James-xu3vc]

Almost got to wormhole phase 😂😂

[@diegotor5643]

This PC goes into the category of:"Nasa Super Computer" 😅

[@user-rw3mp6ng3t]

Man, this has become a car machine😂

[@Testty]

you can have the best waifu simulator on this thing

[@rakzbdgames1948]

wooo why ont use a better quality of thermal paste?

[@willdrunkenstein5367]

The lack of redundant power supplies worries me

[@invisiblehand6051]

Let's see on Facebook marketplace 10 years later

[@heyAnshuman7]

finally a PC that can run MS word at 240 FPS👍

[@BronxBoys81]

Diesen Arbeitsplatz würde ich auch gerne haben. Den ganzen Tag mit Teurer Hardware basteln .

[@pedroteixeira4369]

I would never ever place the thermal compound on the bare GPU chip in that way. The CPU has an heat spreader so it can work well even if some part of the spreader ends up without thermal compound be the bare chips of the GPUs don't have so much luck. I would spread the thermal compound with a plastic tool so as to make sure every part of the gpu chips is covered.

[@6Azamorn9]

yeah if pasting on a bare die it's definitely a better idea to manually spread to cover the whole die

[@einherz]

but can it play crysis without user?

[@omizoKa]

Ok I can build my setup I have the Alphacool A100 Carbon, now I need a A100 80GB.

[@MortalKombatSector]

2 киловатта могут легко разогреть такой объем воды