AMD’s 128 Core MONSTER - Epyc Bergamo

[@LinusTechTips]

At 6:17 Linus uses the unit 'foot pounds' where he should have used 'pound force inches.' We're working to update the video.

[@kaiserbeelzebub4th]

ok

[@GnomeFoundation]

ok

[@C-R-l-M-S-O-N]

ko

[@protogenxl]

SP5 waterblock needed the ThermoFlex 5000 Hungers!

[@dividion]

Thanks Steve

[@nadirqg]

I was looking for a CPU to run Cities Skylines II at a least 15 fps, I think this one will do.

[@pixelpirate6]

nah this prob gonna give you max 10 fps

[@Fluffy_g3]

Might need a better graphics card tho

[@matt-eu-poland]

It's going to be 10 fps after they release new patch

[@snehanshourya3850]

You'll need three of these. Probably.

[@dereineGorden]

The problem with cities skylinies is simply that it is relying on single core performance and just isn't optimised at all. Meaning more cores won't give you anymore performance rather it will hurt performance because each single core won't turbo as high. Love the game but pls just optimise for miltithreading.

[@Trentonyt]

I can’t wait to spec out a full system I’ll never afford just to see how insane the performance would be😂

[@thegermanguy9323]

i litearly would do the same

[@jackhemsworth7515]

Cheaper than a fully specced out Imac desktop

[@beeseechurger]

@@jackhemsworth7515definitely not lmao there’s NO way

[@IceKoldKilla]

I did this is 2006 a lot. Dreaming of the best gaming PC money could buy.

[@Crecross]

​@@beeseechurgerIt's cheaper than a whole imac pro

[@romanpul]

The most insane feature of Bergamo is its power efficiency. Wendel from Level1Tech mentioned that Zen4c is even more power efficient than most currently available ARM CPUs

[@User-dd2xv]

What!!!

[@romanpul]

@@User-dd2xv you can compare it to an Ampere Altra Max, which also has 128 cores. The Altra consumes about 130W in idle and 350-400W under load. Bergamo consumes abkut 120W in idle and 500-600W under load. But Bergamo is up to three times faster than the Altra Max

[@dudao4163]

​@@romanpulPower comsumed per unit of work done. For server chip, it kills :)

[@DeenaMilkers]

dang, very cool

[@AffectionateLocomotive]

Comparing to arm only for watt/power, nah it sucks. However with 3x the power. Its EPYC.

[@shize9ine]

Linus - buys and implements full workshop with cnc Also Linus - only have this one heatsink

[@paulbrooks4395]

We do cloud computing and have been discussing and testing vCPU ratios and core contention. The performance effects of overlapping VM vCPU and VMs with more vCPUs is something we are always tweaking and eventually resolving with better hardware. It’s something that is surprisingly more strange than straightforward, since VMs experience slowdowns from neighboring VMs on the same CPUs/clusters/cores/caches. The perception of performance is related more to cumulative contention at any given instant than it is to peak capability (specifically in reference to user-facing experiences, not infrastructure which can often be measured in terms of load metrics). In many cases, there is no direct software solution, which leads to scale up or scale out. For us, the only way to see how the hardware perform is to benchmark and create these scenarios to see how we can load balance physical and virtual systems. My hope is that the 4c provides better small-mid scale VM performance and responsiveness in a way that is affordable for our needs.

[@matsv201]

I use to work in a factory that made telecom servers. And one day coming to the work there was a batch from might shift where every single server blade of the production line overheated. Open upp the first. The plastic cover was still on the cpu, the second.. well every one of them. Well someone asked the dude that assebmled them and he claim that there was no part in the instructiin to remove the plastic cap. The person who made the instruction thought it was so obvius so he didnt write it.

[@iseceepcool2]

He probably knew but wanted to make an example for why you idiot proof your instructions

[@spencerbair1137]

This is a prime example of exactly why an instruction manual must contain the most blatantly obvious instructions possible. Because someone, somewhere, is going to be brilliant enough to mess it up.

[@B0B_BELCHER]

When you write manuals or instructions, you have to think of all the possible stupid things that another person could do...😅

[@BasicMewMew]

@@B0B_BELCHER no matter how well you write instructions there will always be an idiot who will beat it.

[@Num43]

"Use your brain to command your arm to move towards the CPU, use your brain to command your hand to grab the CPU..."

[@si1entdave]

I was genuinely shocked at Linus using a non-LTT screwdriver.

[@yourimpossibletoisgn]

Torque extension on the store when ?!?!?

[@kazoolians]

Came looking for a comment to figure out why?

[@AlphaSputnik]

haha same

[@nordithen]

@@kazoolians Torque specifications.

[@spinaltap22]

@@kazoolians It's a Gear Wrench 1/4" Drive Torque Screwdriver 1-6Nm ...a ~$220 screwdriver! Perfect for not overtightening the CPU screw and costing yourself $12,000.

[@gadgetmerc]

Generally speaking those "cloud native workloads" are based around virtualization and/or containers. For example, you generally give a container soft/hard cpu and memory limits. Then run lots of them per system. The more cpu and memory you have the more you can allocate. Linus made a comment about them not needing to share memory between cores and that is generally correct in this type of workloads.

[@littlefrank90]

Openshift benchmark when (not sure how that would work and what the meaning of such a test would be) 3000 apache pods on a single cpu let's gooo

[@FaZekiller-qe3uf]

Serverless L

[@username8644]

That's what I was thinking too. Thats what this CPU makes sense for anyways. Usually the only workloads that benefit from more cores (even if the cores themselves are weaker) are anything to do with containerized workloads.

[@quanghuyvu2649]

So it's like virtual Box but in a bigger packet

[@gadgetmerc]

@@quanghuyvu2649 virtual box is an interesting example for this processor. It could very easily utilize all of those cores with vms. Outside of a lab, dev, or test setup it will rarely be used. In the path to prod you'd use something like openstack, docker, K8s, or something similar.

[@wileymonair]

Comparing a server CPU to an enthusiast CPU is like comparing a semi truck to a sports car. It'll pull way more weight, but it's not built for speed (frames in games)

[@BigDrewski1000]

This! A lot of people really don't realize this kind of information. It's also why Threadripper cpu's are more pants at gaming than a lower core count CPU, but are WAY better for content creation.

[@roseealexandra5111]

Thank You Dear Sir, You just solved my issues in terms I can understand.

[@atoxax]

yes mom, I need it for my power point.

[@roybuscht.9997]

What an epic analysis! I can't wrap my processor around the fact that this beast accommodates 128 cores. Good point about the tech in high-end chips eventually trickling down to our home PCs. From raid controllers to cloud-based workloads, it's fascinating how our everyday tech is influenced by these monstrous CPUs. Thanks for the thorough walkthrough, I was on the edge of my seat - almost fell off when you started to spray the coolant! Maybe next time you can try gaming with a liquid nitrogen cooling setup, just to keep things chill. Looking forward to seeing more from the wild world of CPUs!

[@Licher_]

An "EPYC" analysis if you will ;D

[@kaz49]

@@Licher_ Dang it you got there first xD

[@viktorianxd]

They could have named this entire lineup EPYC Legion cause of the 6096 socketpins

[@DeviloftheHelll]

and if todays programmers wouldnt be paid off by hardware manufacturers to put out even worse code that uses all 128 cores to full while providing the same performance as a 20 year old processor :)

[@haven216]

@@DeviloftheHelll ???

[@MostlyPennyCat]

I wanna see this CPU run GPU tasks. Like, i wanna see DirectX ported to the CPU and have it run something like Doom 2016.

[@mme725]

God yes, I need to see DX-for-CPU happen lol

[@gabenchrist7331]

If I remember correctly someone ran crisis on the 64 core epyc back then. Would definitely be interesting to see this on the new epyx

[@jittertn]

mesa 3d exists, and doom 2016 runs in opengl or vulkan modes (no d3d if I remember correctly) So your wish might already be possible today Ltt make it happe

[@poodlemeister22314]

and if I recall correctly, it got what...10 fps @720p? Which for CPU only is not bad at all @@gabenchrist7331

[@kernelpickle]

It would actually be pretty bad compared to even entry level GPUs because the core sizes for those are so small because they run a very limited number of instructions compared to x86-64, and they perform mathematical calculations with much more precision to make sure things don’t look all shimmery/warbley like a Sony PS1. For comparison the number of GPU cores on any discrete graphics card is going to have (at a minimum) at least 4x the number of threads as this CPU, for the closest comparison you’d have to look at iGPUs, like the Intel UHD 750 that’s included with the 11th Gen i5’s and up, which have 256 cores. We’ve reached a point where the most powerful GPUs have 1:1 core per pixel ratio. So, what you’re suggesting might not be as exciting as you think and might make it look far less impressive than doing what it does, which is perform a ton of complex instructions in parallel and host a ridiculous number of containers and VMs that can all be allocated a reasonable amount of cores and memory, that it wouldn’t fare too poorly against older workstations that shipped with similar specs years ago. With the setup LTT had, they could setup 16 VMs with 16 cores and 48 GB of RAM, which is overkill compared to most virtual servers I’ve ever worked with running on a VMware server farm. If you needed fairly robust virtual servers you could easily provision 32 servers with 8 cores and 24 GB of actual memory. More than likely these are going to be used in a mixture of uses where you’ve got VMs dedicated to specific virtual systems that will reserve the cores and memory, while others that are more dynamically allocated so that at idle it won’t use up very much, but as more demand is placed on the system, it will just start allocating more memory and CPU cores and cycles as needed. If you’ve never seen how VMware server farms show the CPU and Memory usage it’s weird the first time you see it, because it will say goofy shit like 15 GHz CPU used, which is a running total for the usage within a particular timeframe, because that’s how they bill for some of these things, even though it’s not their hardware, they charge licensing fees based on usage, because people are willing to pay that much for their software. Anyway, as interesting as these CPUs are for the most hyperconverged data centers, it’s still really boring for games because GPUs are just so much more parallelized and have been that way for a much longer time. The takeaway that’s most interesting is the CCDs being so jam packed, because it means that we’re going to have consumer desktop and workstation CPUs with 32 or even 64 cores on a much smaller package with higher clock speeds within the next couple of refresh cycles, and/or more PCIe lanes for even more I/O and memory capacity. HEDT is just going to be overshadowed by regular desktops, and laptops that will be able to handle more multi-threaded workloads. Also, the power efficiency of those cores were pretty impressive as well.

[@fierrogutierrezmariodariel5234]

It would be awesome to see such a cpu compiling a big project like the linux kernel or something else to see how fast it is, the clock may not be so fast but so many threads could do it so fast I can't imagine

[@KushagraJuneja]

Some other cloud native workloads, in addition to containers, as another commenter mentioned, are people running bare metal servers and they have their own virtualisation layer on top of it. How this helps is since they own the virtualisation also, they can have multiple different VMs running on it, performing different operations on the same set of data. And since that data resides in the same CPU/Memory space, the latencies are ultra low (~10-100 ns), what is called HPC in the industry. My org runs simulations on market data and these are hundreds of files spanning 10s of GBs each. Being able to load all of them into memory and then running parallel simulations, all on 1 single CPU would be a game changer in terms of performance as compared to running 64x2 CPUs in NUMA config as currently, we are maxxed out at the CPU level, only limited by the memory latency and memory throughput.

[@Teluric2]

@@KushagraJuneja can you elaborate what software do you use for that simulation and what os,runtime?

[@jcugnoni]

15 years ago, 128 cores where only available in compute clusters with high speed network interconnect.. I remember preparing computationnal fluid dynamics on this type of cluster and waiting a few days in the queue to run a 32 core job...

[@morosis82]

Even worse than that, it was only 5 or 6 years ago that you couldn't have this many cores in a quad socket system.

[@lucasrem]

We could stack Xeons in DELL servers, we did 32 Cores max on one system. running VM's, Oracle

[@funbucket09]

Yes. And 30 years ago many PCs still ran on MS-DOS. I guess that's how technology works hey?

[@robertt9342]

@@funbucket09. Did you see that….. it was the point going over your head.

[@Bruce1Parsons]

​@@robertt9342people like them can't understand what a KB even truley meant. How large a system like these would have been 10 yet alone 30 years ago. 30 years ago half a GB of storage cost ~300$ That now would get you over 20tb of storage. That's roughly 12 million dollars worth of storage in 1993. Not counting for inflation which make it 25.5 million worth of storage. 🤯

[@Chrono1713]

I always think about how sooner or later they'll just run out of Italian cities and they'll have to use smaller and smaller tows. Like, imagine AMD EPYC BASSANO DEL GRAPPA

[@elianjaku9523]

Si gode

[@vitogalante9874]

Commento inaspettato del giorno ahahah

[@t3chgeek]

Lan party AMD da Nardini 😎

[@theagentsmith]

We have 8000 towns and villages, not happening anytime soon, where is my AMD Epyc Maranello? :D

[@kosymo]

Da un pò che aspetto AMD EPYC VILLARICCA

[@LinusTechTips]

Special Thanks to @wolfmanmods1428 for the use of the case! www.youtube.com/@wolfmanmods1428

[@majinplaton]

how about a phone buying guide next

[@SimanSlivar]

cant this umm you know be in a 2P system?

[@Nobe_Oddy]

WORST. SEGUE. of. 2023.

[@CharizardSnyper]

​@@SimanSlivaras long as the sku doesn't end with "p", you should be able to run them in a dual socket set up

[@zslemp]

these videos just don't hit the same or have the pop they use to after all your scandals and accusations.

[@acuraonly]

glad to see AMD crushing the competition my 3800X is still killin it till this day.

[@stan.yordanov]

1:56 The WinRAR reference is not lost here! Epic!

[@fedupguy2004]

Linus the way Maxons bucket rendering works the larger memory you have the larger bucket it has. Bucket rendering with small cells was designed to prevent out of meory errors or slow disk swaps on systems with little memory. The new version automatically optimises bucket size, which you can manually do on say Arnold or Vray.

[@DewittOralee]

As a server technician that works on these daily, I'm happy you mentioned the motherboard CPU pins and what problems just one can cause.

[@chrisbaker8533]

some days, it makes me miss PGA. some days.

[@theairaccumulator7144]

​@@chrisbaker8533Imagine 6000 tiny pins

[@Demopans5990]

Maybe pseudo BGA is on the books. Something a bit less delicate than pins

[@lbgstzockt8493]

I would love to see you attempt some software rendering on one or more of these chips, we are approaching GPU levels of core count here.

[@PhyrexJ]

Crysis on CPU only

[@taliesinsilvercrow9736]

​@@PhyrexJI'd love to see that

[@Ornithopter470]

​@@PhyrexJthat's been a thing for a while.

[@MostlyPennyCat]

Yeah, a CPU port of DirectX!

[@ScreechingBagel]

they did a while back with Crysis

[@kikibrown1385]

This video was the last video my dad sent to me before he passed away last week. He was a genius with newer PC technology and I relied on him a lot for any computer questions I had. Recently, I had asked him if he knew of any CPUs that I could upgrade to, and he sent me a link to this. I knew he was looking around to find me something powerful for gaming but within budget before he passed. I'm not exactly fluent when it comes to computer parts, and most of the finer details in this video have gone over my head, but someday I want to learn what it all means. I currently run an AMD FX 8350 but it seems to be somewhat incompatible with my new NVIDIA GeForce 3070- it reaches max CPU usage and gets hot when trying to run games such as Baldur's Gate 3- and now fails to run beyond the title screen. I've tried delegating my GPU to handle my gaming apps with high performance prioritized, but saw no improvement between the games or what task manager clocked my CPU at. I feel strange asking the youtube comment section, but I was hoping if anybody who knew their computers would be able to tell me if the Bergamo would be worth investing in for an upgrade?

[@harryniedecken5321]

Hi, your father most likely sent this to you just to show where the technology is heading. Instead look at some videos about the ryzen 5600x3d and 5800x3d. Good luck and keep thinking good thoughts about your father.

[@morosis82]

No, Bergamo is not the kind of processor you want for a desktop. These are designed to run cloud apps, not super fast but very efficient and many tasks at once. It's not a fast CPU in terms of running single tasks quickly, only that it can run so many at once. And the cost of a cheap car for a single CPU. Depending on budget you'll be wanting either Ryzen 7000 series or Intel 13/14th gen. If you need a workstation and want the types of cores this thing packs, then you're after either Intel W-2400 or Threadripper, but don't expect much change from $5k for a board, CPU and memory.

[@noth606]

A bit late I think, but I figured I could contribute something, if not to you then to someone reading this. A massive amount of "small" cores is likely not going to give you much joy, certainly not in most games, as @morosis82 says. However you could get something almost as special and very closely related by going for a higher clocked Threadripper. Your current setup is very very severely hampered by your CPU, those bulldozer chips were not particularly good when new and at this point your 3070 isn't able to do a lot of what it has the potential to, because of your CPU. I had the 9590 or what it was called, the "fastest" of that family of chips and even overclocked to the max it never did games well. Anything Ryzen based will be a huge leap, at the same clockspeed or lower, because it's massively more efficient and optimized, which includes both Epyc like in the video and Threadripper which I suspect would both make you get a large speedboost, as well as stay within what I would guess was the intent he had when he looked for something powerful for gaming.

[@DigitalJedi]

With AMD aiming for compacted Zen-C cores and Intel aiming to put something like 300 E-cores in one socket fairly soon, the days of a Kilo-thread box are rapidly approaching.

[@RonnieMcNutt666]

yep sirrra forest successor is supposed to have 512

[@gmdking]

It’s crazy. Soon we might be referring to CPUs like: “4 Kilocores and 8Kilothreads” In 20 years.

[@morosis82]

Depends what you mean by box. Some of the server manufacturers have already done 4 node 2u chassis that support 8x Epyc CPUs across the nodes.

[@tomstech4390]

Intel was talking about 144 cores last year and they still haven't done it meanwhile bergamo is 6 months old. Intel are like 3 years behind.

[@DigitalJedi]

@@tomstech4390 Clearwater Forrest is on pace. Intel is behind in server core count overall yes, but this isn't another Sapphire Rapids situation with a year of delays.

[@OverwatchOff1cial]

You guys should try running a super massive factorio megabase on it. I wanna see how big one can be too bring that CPU to its knees.

[@RaeKiyari]

Factorio is limited by cache-, ram speed and timings followed by clockspeed for its ups calculations. Those cores might only be usefull for speeding up map generation

[@HD7970]

What happened to the blowiematrons? This would have been a perfect scenario for one or 2 of them.

[@triodak]

Two super fans on XE04-SP5 cooler was doable. But better would be water cooling with ThermoFlex 5000 Chiller and water block taken from XE360-SP5 😁

[@solverz4078]

I can see this being VERY popular in the HPC industry

[@DS-pk4eh]

12:50 It explains the best what monster of the chip this is.

[@billyeveryteen7328]

I'm always astonished how quickly and how far technology has advanced. The first PC I built back in 2003 had 256MB of RAM. This PC has 768GB. Granted, this is not a home PC and it's likely nobody here will ever be running this setup at home, but it's still crazy to me that my first PC, which was only twenty years ago, has 0.3% of the memory that this one has.

[@Kycilak]

You have the decimal point at wrong place. Your first PC had 0.03 % percent of memory.

[@WoobsBallJesse]

I was talking to a coworker the other day about my first USB thumb drive. A whopping 128MB that probably cost in the neighborhood of $40-$50. A full gig was way out of the question for me at that time. They're sold in packs of 5 for about the same as cigarettes now.

[@albertlong3492]

I think some Ivy-bridge-EP processors already support 768GB RAM, those were released back in 2013

[@naomie2680]

Consumer hardware takes 128GB of DDR4 or 192GB of DDR5, but that could go to 256GB if they end up making 64GB udimm sticks (which would already be 1000 times more than your first computer, still on consumer hardware)

[@ydid687]

@@albertlong3492 yes i remember people buying HP Z 80something workstations with 1.5 TB of ram around 2014, however that is much slower memory than what's available now

[@peasant_shots]

I'm never going to get over how big the die is on EPYC.

[@davidbelecci6970]

“When your socket is almost as big as your memory slot” #justepycthings

[@jfolz]

There's 9 dies and they're not that big.

[@theohallenius8882]

It's the same as Threadripper, in fact Threadripper are just consumer versions of EPYC

[@Qardo]

Compared to all other CPUs, it is GIGANTIC.@@jfolz

[@Yuzuki1337]

One day we're gonna have Epycs that are gonna be the size of a 2.5" drive :D

[@coveps1325]

2030: Budget 128-core Gaming PC using psrts I bought from eBay!

[@ehhhhhhhhhh]

This one chip has more cores than my entire high school did in 2004.

[@Sylkis89]

I remember how when I was a kid everyone had 128MB or 256MB of ram and when someone had 512MB it was like, whoah what do you need that much for. And once 512MB became normal but 1GB was still kinda extravagant, people would buy a 512MB stick and then wouldn't know what to do with the old 256 stick, and so they'd put both and run 768MB in single channel. This computer has 768GB. Similarly, when I was a kid a 1GB disk was considered a big one. Now we have disks that can have several TB each. It's like, in some 25-ish? years we got to a point when 1GB nowadays feels like 1MB back then, whether storage or memory, and 1TB today feels like 1GB back then. And it's messing with my head now lol

[@DemoniteBL]

Well, you gotta factor in that eventually adcvancements will slow down. At some point we will reach hard physical boundaries.

[@morosis82]

This computer supports way more than 768GB, it's just infeasible to go higher unless you have a reason to spend the money. 256GB single dimms can be had for $3k each. What's truly crazy is that the 768MB of memory you're talking about is now how much on-die cache these chips have, or a little over 1.1GiB for the X3D Genoa variants.

[@imglidinhere]

Worth noting that we may yet have an interesting tech development in the future. 16 core complexes plus some form of Vcache might not be completely off the table! :D

[@HoldandModify]

Our render farm back in 2003 had 100 3ghz single core INTELs. This one damn chip has 128.

[@DeerJerky]

You should definitely put the giant overkill chiller on the CPU to cool it

[@HedgehogY2K]

Well... Yeah. CS2 is DX11 where as Doom Eternal is straight up Vulkan. Of course multi-threaded performance is out of this world. The problem is most people don't really like dealing with DX12 or Vulkan just for the performance gains of a game they're not putting special attention to. It's why most indie games are closer to single or light multi-threaded APIs like OpenGL 4 and DX11.

[@TheWebstaff]

This is why you should have pallets of spray air on hand. Turn it upside down and go for gold. I used to do that back in the early 2000 as the only way to try and keep up with Gibbo and marshy when doing over clocking comps at work.

[@Level-ts7xl]

can't wait to get my hands on this... in 20 years time when im ready to build a retro PC

[@ProcessedDigitally]

lol

[@noobexed3948]

"But who's gonna spend 12.000$ on a cpu?"

[@Rhtzjgbgg]

Data centers

[@thedaredevil1907]

Many many company's will buy hundreds of them not just one ...but I get what your saying

[@ConnorVisser]

They missed the sarcasm

[@fatbloaterdave]

People who make more money from having more CPU power.

[@bigmacbaconator1]

Intel

[@poms97]

waiting for a chiller cooling setup with this processor

[@jondonnelly3]

He could at least grab some delta server fans for it like it is supposed to have. He is so cringe I can't stand him. Seriously I threw up a bit when he went to squirt it with water.

[@pilkycrc]

The M1 Ultra comparison is pretty interesting when you consider it’s a 20 core/20 thread chip vs a 128 core/256 thread chip. I know Apple’s cores are pretty great in terms of IPC but I would have expected more than a 4x difference (and this is as an M1 Ultra owner). I wonder if there’s some other bottleneck in the system or in Cinebench r24 that’s limiting the performance

[@Theworthsearcher]

What is the TDP of M1 Ultra? 50-60 W? Let use 60. So it has 20 cores. That means, 1 core has 3 W TDP. So 128 cores should have 384 W TDP. But it only has 250/300W? That mena, that it is about for 100 cores the same but it alsi has multithreads (2/core), which makes it a bit more difficult.

[@Teluric2]

M1 is a 5nm chip unlike bergamo.

[@Hammerhead547]

To linus's point about F1 tech eventually making it into our daily drivers, there's actually a fantastic BBC documentary from 1984/85 that shows the entire process that went into the creation of the Ford Cosworth GBA 1.5L Turbo V6 that went into the 1986 Beaatrice/Lola-Haas/Ford (Carl not Gene). At the end of the first part and beginning of the second it shows the development process of the ECU and they show the electronics engineers from ford motorsports europe working well into the night chasing down problems in the circuitry before the "big box" (the ECU was the size of a toaster oven) went into the car for its first track tests. At one point they realized that there was a huge issue with detonation that was being caused by electromagnetic interference from the combustion chambers interfering with the ECU's operation, so they had to change the design placement from on top of the engine to inside the tub. They even showed the IBM 286 desktop that the engineers in europe used to communicate with the head of ford motorsports over in detroit and explained how the multi-layer cryptographic encryption system it used to prevent competitors (like say Bosch) from getting into their system to steal proprietary information worked.

[@bobbobi4702]

Take a look at GPU and cores affinity; in a worst-case scenario, you could potentially reduce GPU performance by a factor of 4. Only a few cores have direct access to the full PCI bandwidth. If the software doesn't manage this properly, it might need to go through another core, causing latency issues that could impact performance significantly. I'm familiar with these kinds of problems as I work with computing clusters.

[@Cty87]

Not much of a PC guy but, can it run Crysis?

[@TheXev]

I used to have a Opteron X2 170 with a 1Ghz overclock (on stock cooling!) for a gaming rig. Older CPU's of that type had a lot more cache and could have similar clock speeds to their Athlong 64 counterparts, and it meant a lot more performance back then.

[@rklrkl64]

I suspect most end-users of this monstrous Epyc CPU will be running Linux, so it's sad to see LTT yet again put Windows on their test bench for a server CPU. Phoronix Test Suite is probably something LTT should have looked at, because that has quite a few server-related tests in it.

[@flintstone1409]

Especially the gaming benchmarks as always. Yes, those CPUs suck at them, because of the low clock speeds. Just in the last video about a server CPU and the one before it and the one before that. Would be interesting to go through some real workloads for that, even if they would have to introduce most viewers to some other benchmarks for that.

[@joee7452]

The plurality will probably be ESXi followed by Linux and Windows. These really aren't the current best option for Cloud data centers currently, so for right now you would be looking at in house clusters or specialized systems. That means ESXi followed by Windows followed by Linux. And before anyone jumps on me, I do prefer KVM over HyperV, but Windows also has RDS virtualization which helps give them implementation numbers.

[@funbucket09]

Thanks for confirming Linux users are the vegans of the PC community. We get it you like Linux.

[@scott420]

they said at the end of the video none of these benchmarks are real tests of what they are for, and that the people buying this sort of stuff would either optimise their systems for it or let the customers who are renting the servers to figure it out themselves, i seriously doubt the real end users of this cpu would actually be getting data from ltt in help with their purchase

[@ZipplyZane]

The point of running Windows is so that it's a like-for-like comparison. To use Linux, they'd need to go back and test all the others on Linux. And any viewer would need to run Linux to be able to compare it with their own system.

[@jordanwright5795]

My primary workstation has the 64 core 3990x which I use primarily with Arnold Render in Cinema 4D and Houdini. Been curious how much faster the 128 core CPU is. Looks like about 30% faster based on your test numbers. Great video! Cinebench 2024 is using Redshift XPU which until recently was a GPU only renderer which is quite a bit different than the old CPU based physical renderer on previous cinebench tests.

[@williamowens2063]

Editing for this video was amazing! Really seems like that new work schedule got everyone more relaxed, which in turn makes far better videos. I'm glad you guys were transparent with your viewers. 😍

[@PhaythGaming]

This is iconic for me. I remember watching similar videos on early intels from you and it’s nostalgic.

[@thavionhawkmkii4509]

I loved my Opteron 190. A duel core unlocked CPU on AMD's desktop Socket 939 was amazing in its day.

[@rare6499]

A 190 was super rare! I’ve still got my 185 which was the equivalent of an FX-60. Good times

[@Wadley225]

7:12 -- only 768 GB of RAM. I remember way back around 2003, when building my pc with the (at the time) awesome Abit NF-7 motherboard and getting it up to 768 MB of memory, and that was amazing!

[@XtreeM_FaiL]

Pathetic. That is only 16 GB more than I have HDD space.

[@Mio96O-O]

I remember my first PC in 2005 with only 1 gb ram anda a 16gb hard disk. I feel so superior at that time

[@adrianomart]

too bad Linus didn't remember the windows WARP thingy that runs DX11 in software mode, he did bench that in the past with a threadripper on crysis 1 iirc... would love to see it on this CPU

[@AviatorMage]

Do a full build in the Opteron case, PLEASE.

[@Atoll-ok1zm]

Jesus fuck the specs on this thing are insane. 128 cores, 256 threads, 128 pcie 5.0 lanes, 12 channel memory, 1/4 GIGABYTE of L3 cache, and apparently you can slot two of these fuckers into the same motherboard. The sheer amount of power and data infratructure just to keep one of these systems fed, let alone banks of them, is insane. You can fit a whole damn super computer in like one server rack.

[@DavidBrown-bs7gg]

As a 3970X (32c/64t) owner I’ve been waiting a long time for these replacements. I’d be interested to know how reliable they are at hitting their max boost clock, because mine rarely did, even on a single core

[@a564-c3q]

Water cool it, bro

[@saricubra2867]

@@a564-c3q What about undervolting a Threadripper?

[@DavidBrown-bs7gg]

@@a564-c3q Tried that, also tried the IceGiant ProSiphon, in the end none of them allowed it to clock appreciably faster so I've stuck with a NH-U14S. I've tried undervolting too, but it wasn't stable.

[@arg8763]

Would love to see what something like this would do encoding x264, x265, AV1, etc.

[@rndincircles]

I'm going to absolutely spec these for my next vcenter cluster.

[@erplayerj]

Genoa and bergamo r italian cities, as an italian im so proud of amd rn

[@pepoCD]

13:55 this just made me appreciate modern desktop CPUs even more. The 14900k (a 32T CPU) can hit over 43k points in the same test, which is almost half the score as this 256T CPU! (8 times the threads!!!) And remember, this is a test that can actually use all of those threads. Just insane how far technology has come.

[@lastone032085]

Don't. That cinebench test scene wasn't anywhere near heavy enough for the cpu to shine. The gap is huge.

[@andrew15_5]

I checked my AMD CPU and found out that they use SI units on the spec sheet on their website to represent IEC units for L3 (and other) cache. Please start using IEC/binary units where applicable!

[@manicdan481]

6000 points in CB2024 is 6x that of my 5900x, but its also only 60% of my 4060 that can break 10k points at 100w. I think the biggest thing CB2024 taught us is that CPUs need to leave the rendering to GPUs.

[@Ornithopter470]

Less that and more that GPU architecture is highly optimized for rendering.

[@mephistoxd2627]

…unless you want to render a real scene for a big budget movie, in which case the textures alone might be in the range of 100 GB - good luck fitting that into any GPU memory.

[@Pasi123]

A bit more than the 822 points my i9-10900X gets lol. My GPU, GTX 1080, scores 3993 points

[@xthelord1668]

till you realize that GPU's with a ton of memory cost a whole alot more than this CPU decked out 24GB VRAM costs you 2 grand USD and that translates in roughly 144GB VRAM worth of cards while this CPU can do well over 1TB for smaller scale GPU might be fine but for 100+GB projects CPU's start to be a king due to capacity unless you get a board which can support that many cards

[@parabolicpanorama]

@@mephistoxd2627 Nvidia H100 says hi

[@mikeloeven]

Magic Effect at 00:21 seconds is just there to hide the fact he already dropped it

[@naoeemerald8720]

Steven Chow movies are legends in my childhood. This relates me back when watching Gintama in my teens. Too bad it's hard to find anything likely in these days. 60 million dollar man, fight back to school, cj7, KFH and etc. are also best watch. It's full of parodies sourcing from anything anyone might encounters in life. This is why I like his movies.

[@JonLaRue]

I like David’s audio being included it made the video more entertaining.

[@grinps]

4:25 no love for LTT screwdriver anymore? 😢

[@ConnorVisser]

Now we just need a new Linus personal server update with this bad boy

[@thekhanbaby]

This is epic, this will defo change the web hosting and game servers.

[@ryanhamstra49]

It’s spelled epyc

[@thekhanbaby]

@@ryanhamstra49 I don't wanna offend Epic Games 🤣

[@TheDemocrab]

@@thekhanbaby You should absolutely go out of your way to offend Epic Games as often as possible.

[@paulschrader1803]

Please make a test with Crysis CPU only. Yes you did the test with a 64 Core Epic years ago. Im just curious how the perfomance has increased . Thank you

[@rowans.corner]

Man, I love server hardware. I'd totally watch a whole other LMG channel about server hardware.

[@glareeedowotb]

If Linus dropped this, he would have to sell the lab to pay it off

[@TheAdatto]

This cpu isn't multiple 100k

[@ShimadaSharra]

Its only 12k. Linus could afford it. But he will cry over it for years.

[@daltonmckee4788]

This is without question my favorite LTT series. Love looking at things I will never afford

[@Ethen_B]

Fun fact! They used a miniature version of the CPU for this entire video, as to show it's size against a normal person. The real one can be seen in the thumbnail, with linus standing next to it - Yes, he's short.

[@ziggomatic5772]

I wasn't expecting a big star reference in a video about computer hardware loll

[@robertomontenegro9260]

Que bien que tus videos cuente con doblaje al español!! eres un excelente KZbinr dedicado a la tecnologia computacional, es mas, no hay casi ningun KZbinr en mi idioma que abarque temas como este, sobre todo con procesador OEM.

[@epencrep]

To think consumers may soon get a 16 core CPU on a single CCD or CCX is impressive and a worthy upgrade for my 5800x3d

[@BottomOfTheDumpsterFire]

@@LordApophis100 16 core CCD with 3D Vcache is exactly what I would want as a content creator, and give me another 16-32-48 without it for rendering processes.

[@romanpul]

Zen4c will come to the next generation of AMD mobile CPUs and APUs, but at lower core counts.

[@justincarter7954]

@K.C-2049 I bought a used 3900X for cheap recently and its so nice, you might be able to upgrade if you're concerned since they use the same socket

[@watercannonscollaboration2281]

And if you do need more cache, Genoa has 3D V-cache CPUs too

[@raptorjesus5488]

You should have tried the crysis CPU renderer you showed off with the last high core count amd cpu

[@francishechanova4192]

Just a friendly advice from a "thumbnail maker" and someone who loves looking at them., I know this is irrelevant but the shadow of the CPU is way different than the "drop shadow" on Linus. Anyway, I am a long-time fan and I appreciate how your thumbnails evolved and how "catchy" they are now.

[@ozjohnno]

Im surprised that the p/o pins on the 24 pin connector are only 5V until now, If you think about it, P=VI where V equals voltage and I = current, so to increase the amount of power you have to either increase (V) or Increase (I). The Problem is however that when you increase (I), you are increasing losses which equals increased heat, so to increase the amount of power delivered to the chip you have to increase (V). The only problem with increasing V, is that you have to make sure that the dialectric strength of the insulators on the board can withstand the extra potential difference (P.D) between 12V rails on the board and earth. As they are moving away from 5 to 12V, the chip designers have clearly already done this. Luv ya work OZ

[@O1ez]

IIrc you ran crisis on a cpu once. Please do that with this cpu too. I would love to see if the performance improved

[@SeventhCircle77]

What would be interesting is somehow do some waterblock on the vrm and the cpu and let it rip. Wonder if you could get a custom bios to allow overclocking?

[@tokisaru]

I literally won't ever use or touch most of, if any, of the stuff reviewed in LTT videos - I mainly watch for the sheer excitement and human that is Linus. You, fun sir, are a treasure ❤️ and are cherished as one, thank you for the joy you bring and share in each video and thing you do ❤️

[@koh1dendy979]

When x4 Epyc with quad socket motherboard test?

[@vladmocanu9802]

You guys should've tried to run Crysis with the software renderer on that thing

[@btarg1]

This would make an insanely good cloud gaming server or multi-user gaming rig for a lan party, would love to see that!

[@tanmaypanadi1414]

untill the game DRm or anticheat realises it doesn't like to be virtualized

[@curious8692]

Now this is truly epyc

[@imcrow6674]

hardware in another ~5 or so years is gonna be wild, with AI in rapid development we are probably going to start seeing a lot more consumer AI tools which need powerful hardware to run maybe in 10 years or so something like this will even be commonplace

[@mahavishnuthegreat]

You should have run crysis on it. That was designed for multi-core.

[@wolfmanmods1428]

Awesome to see LTT could use could so heavily upgrade the rare Opteron Cabinet I had on the 20th anniversary of the Opteron Launch!! The result is truly EPYC 😁

[@jasonhemphill8525]

Have you guys ever tested Ampere's 192 core CPU?

[@LeLe-pm2pr]

isn't that ARM and not x86 ?

[@fireeraser2206]

@@LeLe-pm2pr Where's the problem? Those cores perform pretty similar to modern x86 cores and due to the higher power efficiency of ARM there are far fewer issues with boosting.

[@LeLe-pm2pr]

@@fireeraser2206 a huge amount of applications are built to run on x86, and not ARM. don't get me wrong, i'm all for ARM being the next big thing in the cpu market, but, as of right now, it cannot be considered a viable alternative for a lot of things

[@dy7296]

@@LeLe-pm2prmore cores is more cores

[@jpracing893]

Us tech enthusiasts are an odd bunch, we'd think nothing of dropping loads of money on a 128 core CPU just to run benchmarks and be like burrrrrrrr squares go quick

[@justincarter7954]

But think about the potential! Then I go open a browser and vscode and the computer basically sleeps the rest of the day while I type into a text editor

[@vampirefox7]

i want a video of you guys touring a movie/vfx studio to know what they use. do they use this stuff for rendering. could be a fun video instead of boring data centers

[@bigpod]

well they would also have just a boring old datacenter

[@vampirefox7]

@@bigpodno you would have a vfx or movie studio talking about how long it took to render your favorite scenes/movies. talk about the progression from now and ten years ago. there is a lot more juicy content there than a regular data center that just crunches numbers.

[@bigpod]

@@vampirefox7 hardware at those studios is still justa datacenter and honestly big datacenters can talk about much more interesting stuff. And honestly cloud datacenters are realy inzeresting

[@JagerEinheit]

Linus is making me feel old.. i had an opteron and a 939 mobo, we OC'd the heck out of it, even had a friend break and keep the world record for OC on it on air. twas quite the time to be alive. technology was literally leaping ahead in terms of pc components.

[@TjayK2]

Let Jordan get his shine on these Linus, he should definitely be building these with you imo.

[@RehaanPlayz0306]

Meanwhile my 12th gen i5: 🗿

[@swollenaor]

I think these chips are great for hosting multiple game servers on one host. Think, minecraft or your space engineer like games.

[@AuftragschilIer]

or mutiple whatever on one host

[@IrredeemableGhost]

What I'm thinking is office thin clients. With CPU overprovisioning, you could fit several hundreds of simultaneous users on a single node.

[@LeLe-pm2pr]

minecraft would probably run quite poorly, as even with paper it is extremely reliant on at least one fast thread

[@IrredeemableGhost]

​@@LeLe-pm2prRight. As much as a lot of cores sounds tempting, this is a job for the frequency optimized variants

[@Pasi123]

Like others have said, for Minecraft you'd prefer a high clocked CPU. Minecraft server providers often use servers based on consumer CPUs like AMD Ryzen and Intel Core. I went a bit wrong route back in 2013 and bought an old dual socket server with 2x Xeon E5420 2.5GHz (think of a slightly lower clocked Core2 Quad Q9450 but two of them) and 32GB RAM. It did fine and it was fun to play around with real server hardware, but in reality it would have been better to go with a modern, at the time, i5-2500K or i5-3570K with 8GB RAM. A modern i5 system would have cost more but I ended up having to buy two different servers in 2013 because the first one died due to a lightning strike. The money I spent on the two systems combined would have been enough for a custom built i5 system.

[@ZeFoxii]

I think the real reason why it “eventually” gets to consumers is because it becomes too expensive to separate the processes and is cheaper to move consumers to what they already use.

[@Hortifox_the_gardener]

I am a bit disappointed you didn't run the Crysis software mode. That was the big thing about the Threadrippers (and you did it multiple times!): it was somewhat running. I fully expected you to show it to us and it would have been a tremendous uplift.

[@ElMalito187]

128 Cores - It can read and predict the future in real-time with low latency.