New Intel Ethernet 800/ E810 Series 2x 100GbE NICs

[@MiniArts159]

"So this server NIC really is something interesting..." Linus: *did someone say workstation upgrades?*

[@jameswhitehead6758]

About a week ago on KZbin's "stories"-esque area he teased 40 gigabit upgrades for all the editor's workstations, each with their own fiber line.

[@rullywow3834]

“Speaking of workstation upgrades, now a message from this episode’s sponsor...”

[@Birdulon]

How cute, Intel making NICs for zen2.

[@Wfmike]

Gonna have to make up the lost sales somewhere

[@_c_e_]

Check out Bluefield Nics by nvidia/arm, no heatsink rofl. Intel are getting wrecked.

[@inlinesk8r477]

@@_c_e_ i mean, at least nvidia has SOCs with PCIE 4.0 support

[@suoyidl2654]

@Birdulon @CE @Blake Vargas - I gues you never heard of IBM then, - cute.

[@inlinesk8r477]

@@suoyidl2654 ??? Bruh, I have open power

[@jllerk]

I love it that you pronounce the whole length of the product name. Most of the times it feels so nerdy and awesome ;)

[@mistakenotou7681]

So something that really benefits from gen 4

[@Felix-ve9hs]

as well as NVMe Storage :D

[@ServeTheHomeVideo]

What is very interesting here is that many of the SSD vendors and those making other parts in the NVMe ecosystem think that storage is going to be slower to transition to Gen5 than other areas such as accelerators/ NICs. I have probably heard this consistent message from 4-5 companies in the last 30 days.

[@shammyh]

@@ServeTheHomeVideo That makes sense though right? You can shove a bunch of Gen4 devices together in an enclosure/backplane, and get a huge amount of aggregate bandwidth on said backplane, but you're still bottlenecked by the interface to go to/from a server or other switching fabric. Essentially, it's easier to put a lot of nvme drives together physically and aggregate the bandwidth, obviating the need for faster diskbackplane interfaces, but you still need the faster interface to get from backplanefabric/host. As always, appreciate the excellent content Patrick!

[@ChrisSmith-tc4df]

PCIe Gen 5 interconnect is going to be really hard. I wonder how far off moving to optical slot connectors might be - for the clock/data lanes. Just stay optical from multi-chip module to multi-chip module.

[@ServeTheHomeVideo]

@@ChrisSmith-tc4df we actually covered that a few hours after this went live in www.servethehome.com/intel-labs-day-2020-a-photonics-integration-future/

[@ITVOIP]

I am just hoping these are popular enough to drive down the price of 10GB nics/switches.

[@majstealth]

i have yet to encounter a 10GbE switch in the wild. i only see maybe a stacking or sfp+ above 1GbE...

[@JamPanha007]

@@majstealth there are plenty on the market, even tplink now has 10Gb switch. cost about 300$ (8ports)

[@majstealth]

@@JamPanha007 sure, but not at the customerbase i encounter. a few months ago we sold multiple "special" ring-switches, 100mbit only

[@johnlucken4426]

What’s funny is intel doesn’t support gen 4 but they make a gen 4 nic.

[@ИванБрагин]

amd forever ;))

[@wildmanjeff42]

I love supermicro server boards just for their IPMI. thanks for the video

[@GeoffSeeley]

Same here, love Supermicro!

[@p3chv0gel22]

And they aren't as overpriced Second Hand as HPE and other vendors. At least here in Germany

[@unijabnx2000]

Figured Intel would've not launched these until they had gen4 pcie available... Kinda like how they've held out on launching any gen4 optane ssds.

[@MrNeo64]

Linus: *breathing heavily*

[@virtualinfinity6280]

Meh, i'd rather pick Mellanox ConnectX-5. Very similar features plus the ability to run Infiniband EDR - cheaper switches, lower latencies, ideal for clustering. And the Mellanox-cards boast excellent OS and infrastructure support (E.g.: OpenIB/OFED)

[@ServeTheHomeVideo]

There are a lot of folks that will use Mellanox/ NVIDIA as they do today. We use a lot in the lab racks for that VPI feature (not all CX5 cards can do both.) Still, more competition from a big competitor is good even if you are a ConnectX Ethernet shop.

[@virtualinfinity6280]

@@ServeTheHomeVideo Yeah, competition is always good - who would deny that. And Intel always comes up with pretty decent ethernet-controllers. The late xl710 series is really good. However, they always come somewhat late to the party and never delivered up to their claim to supply the fast interconnect customers. Yet, they stubbornly refuse to support Infiniband (Nih). And recently Omnipath fell flat on it's face. All the while Mellanox (yep, I still can't call them Nvidia..) already delivers 200G and 400G infiniband interconnects. Some more Infiniband competition would also be very welcome...

[@thetj8243]

Hmm... I've not yet seen this positive site on the fact that PCIe gen 5 is already in the pipeline 😀 but for enthusiasts with "just" a home lab these PCIe gen 4 NICs could get affordable in 3 to 5 years 😀

[@ServeTheHomeVideo]

Thanks Tobias. I had that realization doing the video which is why we covered both of those in the end of the video. These NICs just started hitting the market so they are still a bit expensive, but with Gen5 we will get the ability to run 400Gbps off a single x16 slot and that will be a big deal especially in the NVMeoF market.

[@andibiront2316]

So.. In which Xeon based server does this NIC go? I've maybe missed a CPU launch... (I see, just had to watch the entire video before commenting lol )

[@slithery9291]

Great video Patrick.

[@ServeTheHomeVideo]

Thanks for the kind words!

[@ricsip]

Does it also suffer from some design defects, similar to the infamoud 2.5Gbps I225-V chip does?

[@ElijahPerrin80]

Awesome thank you, I was hoping you would have more content on networking.

[@vadymie]

He scares me every time with his "Hey guys, this.." into words. Too much emotionality.

[@furionn]

Crazy to see these massive heatsinks on network cards, I'm wondering if in 10 years the 1TbE NICs will require watercooling lol. Again, great video!

[@whitenite007]

almost certainly not. Server grade and water are things that do not mix. You can run top end consumer processors with active air cooling still. There's very minor benefit besides looking cool to water cooling.

[@furionn]

@@whitenite007 I was most definitely NOT being serious pal

[@charlesturner897]

​@@whitenite007this comment aged poorly before you even posted it.

[@whitenite007]

@@charlesturner897 did I miss something? are our datacenters all water cooled now?

[@der.Schtefan]

I think it might help if he would display the name of the cards he is talking about when he is shooting out model numbers. Like in the corner somewhere. I keep losing track when he shoots out half a dozen number and letter combinations in rapid succession.

[@TooliusTech]

now all we need is cheap-ish ethernet switches ! Would love to have like a 4 port or 8 port 100Gbe switch for a home lab !

[@ServeTheHomeVideo]

Totally. The 100GbE switches, even used, are in the $1200-2000 range. Check the STH Great Deals forum as sometimes people post deals with them in the $1000 range for 32 port models.

[@thetj8243]

I think I would prefer something with two 100GbE ports and 16 10GbE ports or something similar. Because my home network won't exceed 10GbE soon, because I'm going to put some meters of CAT 7 cables though the house... And the sockets are just CAT 6a...

[@TooliusTech]

@@thetj8243 Look at cat 8 now since that can push 40Gbe upto 30 meters with ease and the prices are falling quick :) . I agree with you on the switches too.. except have about 4x 100Gbe and if possible 8x or 16x 40Gbe/10Gbe. Since modern nvme drives can saturate 40gbe pretty much :) Even for laptops a thunderbolt to 40Gbe nic would be awesome to have. I think the jump to 40Gbe should come soon. Just about any laptop and desktop can push that kind of performance with the nvme drives today !

[@Damicske]

or a 40 port 2.5G switch with 100G backplane and SFP+++++++ (don't know how much + you need for those ) connectors :)

[@TooliusTech]

@@ServeTheHomeVideo i have seen IB 100Gbe that low but ethernet switches at that price would be pretty damn sweet :) Will check the forums for sure ! Thanks again for the great video and good to see someone else apart from mellanox with their VPI cards come around ! competition is a good thing for us !

[@thatLion01]

This is an amazing card and another great review. Keep up the good work!

[@misium]

What is "offload"?

[@edgarmatzinger9742]

Nice NIC for professional (datacenter-based) equipment. For at home? Not so much.

[@patrickjoseph3412]

is the "DEEP DP " for the WAP ?

[@FliesEyes]

If this card was used on a pcie slot gen 5 (x8) would it be enough for gen 4 (x16) card?

[@LeGoog2008]

Really good video once again! Thanks man 👍!

[@joeldoxtator9804]

What's the practical application of this? Wouldn't you be hitting massive transfer speed bottle necks in the system itself?

[@MarkRose1337]

Are the STH socks comfortable? I'm thinking of ordering them along with a mug.

[@ServeTheHomeVideo]

For comfortable socks, I prefer Bombas. I know, I am a bad salesman. The socks are cooler looking (to me) than they are maximum comfort socks.

[@ws2940]

Great video, thank you for creating it.

[@RylTheValstrax]

The AOC-S3100G-i2C is actually missing the second not the first C :D Great to see another product in this category. Also at the time of posting the page served up by youtube to me has the description pointing to a review of the AOC-S25G-b2S. The correct review is here at www.servethehome.com/supermicro-aoc-s100gc-i2c-100gbe-intel-800-series-nic-review/

[@ServeTheHomeVideo]

Link fixed!

[@MisterRorschach90]

I’m looking forward to seeing epyc zen3 motherboards with these built in. That would be insane.

[@Majidiof]

perfect overview

[@fishermansnook3415]

Can you recommend a Thunderbolt 3 to 10G dongle based in an Intel chip? I install FTTH 10G service and need to show the customer that it is working. The adaptor from OWC does not reach full speed. I use a 2020 MacBook Pro. Thanks!

[@rematchrepeater]

owc thunderbolt pro caldigit

[@netrunner1987]

what 10gb copper ethernet cards would you recommend on a budget?

[@GoodOlKuro]

used intel nics on ebay for around 100 bucks. Aquantia chip based 10G cards also around 100 moneys. used mellanox infiniband 40gbps cards for ~25 bucks and wire for something like 40-50 bucks.

[@taraka77]

Another Awesome presentation 👏 👌 👍

[@noobian3314]

I reckon they will look like GPUs when we get 1Tbps cards with big coolers

[@opiniondiscarded6650]

So how do I buy one?

[@DM-sc4zy]

What kinda servers can benefit from these 100GbE NICs when PCI-E x16 can only provide 16GB/s throughput?

[@user-2FABE7F]

AMD servers.

[@rido8864]

500 series still sells for hundreds on the used market where i am

[@thibaultmol]

So ADQ is nic-level QoS? (Sorta)

[@youtubecommenter4069]

This will be soon be exceeded in NVMe PCIe Gen 4.0 storage JBODs and cloud hosting servers running Arm-based SoCs.

[@Felix-ve9hs]

You can't spell "Important" without "Port"

[@ServeTheHomeVideo]

Ha!

[@opiniondiscarded6650]

@@ServeTheHomeVideo I knew you was a goober 🥴

[@ABUNDANCEandBEYONDATHLETE]

I've been waiting... 100gb was out in 2009. Whatever I'll take it

[@johnmijo]

OMG, old skool jumper blocks :p

[@mauisam1]

So I don't mean to complain, but your channel is "Serve the Home". Although this is interesting who in the Home or SMB would us 100GB network? I would like to see more things related to the "S" as in Small. One thing I need help with is WiFi access points. I have many times a year I have my kids (and now Grand Kids) at the house and everyone is on phone, tables and laptops wanting to connect to my WiFi. I have a L shaped house and my primary router/firewall/wifi is in the corner of the L and I have a fireplace 45 degrees from that corner, plus many wall for it to go through. WiFi extender is confusing for everyone because the name is modified/extended from the main WiFi, as in ServeHome (primary) and ServeHome_ext(2G/5G) for the extender. So having a AP that extends the WiFi but uses the primary WiFi as in ServeHome would be save me from having a big headache each time. Sorry I'm a Server guy not a network guy.

[@ServeTheHomeVideo]

Hi. Not sure what you mean by limiting to home? STH is 12 years old and we have been the place in the industry reviewing the largest servers from all major vendors for many years.

[@maxmustermann5612]

Intel died for me as they tried to downplay their security flaws ... pretty happy with with epic and mellanox

[@thatLion01]

I know cpus had lots of flaws. Never heard that their nics had the same. Thanks for sharing. Learned something new today

[@oleggritsev]

No. The best is one ConnectX®-6 200GbE Single/Dual-Port Adapters!!! We use it already.

[@ServeTheHomeVideo]

Totally true. We have the ConnectX-6 mentioned later in the video as a higher-end NIC.

[@oleggritsev]

@@ServeTheHomeVideo If Intel price will be affordable we will use it at home data servers even. ;-)

[@esra_erimez]

Hello wonderful person reading this comment

[@ИванБрагин]

pci-e x16 v3.0 15Gb/s? ;) or v4.0 ????? nic for amd ;))

[@HerrBlauzahn]

What do you even use this for? I think even my RAM has a lower bandwidth than this.

[@ServeTheHomeVideo]

NVMeoF is a big area, especially for scale-out infrastructure. In data center networking 25GbE is now very common and 100GbE is becoming widespread as an interconnect as well.

[@scalamasterelectros3204]

When your lan edaptor looks like a gpu

[@austinleung5744]

Just take my money…

[@janegerrard1073]

Nice but pretty much irrelevant for serving the average home, this is datacentre stuff

[@ewenchan1239]

People that say they're deploying 10 GbE at home: me: "that's cute!" me at home: *checks how my 100 Gbps Infiniband is doing*

[@BlownMacTruck]

If you use Infiniband at home for anything but a small lab, you're doing it wrong, not to mention EoIB is a joke.

[@ewenchan1239]

@@BlownMacTruck If you're NOT running 100 Gbps IB at home, instead of running 10 or 100 GbE, you're doing it wrong. Frankly, I don't know why anybody would bother with ethernet when you can just run IPoIB and be done with and NOT take the 1.5% hit with 100 GbE. Or put another way, 100 GbE is just coming to like commercial deployments now. 200 Gbps HDR Infiniband is already out. That means that if you want to deploy 100 GbE at home, you're buying "new" 100 GbE stuff, (like the aforementioned Intel NICs) whereas if you're running 100 Gbps IB, you can pick those up for half price or less, on like eBay. So if you're running 100 GbE, you're doing it wrong.

[@BlownMacTruck]

@@ewenchan1239 Spoken like someone who’s desperately clinging to IB and has no actual real world experience with it.

[@ewenchan1239]

@@BlownMacTruck Sure....I love it when people neglect and/or omit facts that doesn't fit their pre-determined worldview/mental model. I have 6 nodes in my 100 Gbps IB cluster that's sitting at home right now. All of them are running Mellanox ConnectX-4 dual port VPI cards (MCX456A-ECAT) cards and they're connected together via a Mellanox MSB-7890 36-port, externally managed switch. I've tested the cards where I set ports to ETH mode using the command: mstconfig -d 03:00.0 set LINK_TYPE_P1=2 Do it for two cards on two nodes, and I connected them up together using cooper DAC cables and ran the bandwidth and latency benchmarks. ETH is about 1.3% slower than native IB. (IB I was getting upto 97.73 Gbps with 512kiB message sizes, whereas 96.44 Gbps (the peak bandwidth was attained still with 512kiB message size). So...you're absolutely correct. I have no idea what I'm talking about. Afterall, I don't suppose that you have 100 GbE running in your basement either. And since you're talking about my not knowing anything, I'm CERTAIN that you've seen what the inside of such a switch will look like, and therefore; the picture below, shouldn't be anything new for you: Here's what the guts looks like for an unmanaged switch: i.postimg.cc/vBMq8tNL/IMG-1759.jpg And here's what the guys look like for a managed switch (Mellanox MSB-7800): i.postimg.cc/Zn5wpKZW/IMG-1754.jpg Just out of curiosity, what do you get back, on the serial console, when you type in: # cat /proc/cpuinfo on the managed switch? (And yes, there IS only ONE correct answer.) LOLLLL.... But you're absolutely correct. It isn't like I would know anything about any of this stuff, afterall, I'm only running 100 Gbps IB at home. And I surmise that the reason why you are talking about a technology that's at LEAST 5 years old (100 GbE) is because you've elected to pay 50% more per port to run 100 GbE in your house, right?

[@ewenchan1239]

@@BlownMacTruck "Spoken like someone who’s desperately clinging to IB" Spoken like someone who can't stand the fact that IB is already running AT the 200 Gbps mark and YOU are desperately trying to hang on to your 100 GbE crap whilst Mellanox launched their ConnectX-4 100 Gbps IB cards back on February 25th, 2015. LOL.... Catch up.

[@scottxiong5844]

Lol it uses 16 lanes!?! :O

[@Soloist1983]

12.5GB/s, no SSD can write that fast, should be a standard that lasts FOREVER in the consumer/prosumer space

[@karmanyaahm]

Pro segue

[@spewp]

Why is this on "ServeTheHome"? Who is installing 100Gbit cards at home, and if they are, surely they don't need this guy to tell them about the technology. Bizarre choices on this channel.

[@ServeTheHomeVideo]

Not sure what you mean? STH is named after the /home/ directory in Linux and the website has been around for almost 14 years. We are the largest server, storage, and networking website, just with a small YT channel. On the main site, we have had 400GbE switches and will have a 64x 400GbE later this month. We review all of this stuff and more. Today, we will have a sub $699 100GbE switch review, and 100GbE cards are becoming 1-2 generations old so they are used price ready for homelabs.

[@Fee.1]

Columbia-ville-lake-mountain-city

[@restrelax6282]

Hey loved the video, if you want any background music made hit me up!

[@jogurtnaturalny]

Before 301

[@magoostus]

psh, not even 100gbase-T. this is trash

[@rafars2246]

Pointless to the 99.99% of people

[@johnkelfy7256]

I don’t understand the hate about intel. Yes they made some shady stuff but they are make so many amazing products while RYZEN literally degrading

[@mixedup5858]

Degrading?

[@johnkelfy7256]

Yes I love that 7nm that literally degrades