Next-Level AI: Supermicro Liquid Cooled NVIDIA AI Racks

Join Jordan at Computex 2024 where he talked with Supermicro about their latest liquid cooling solutions for NVIDIA Grace Hopper and Grace Blackwell Superchips.
The liquid cooled design helps to maximize the GPUs per rack with amazing power savings as well. In fact, just one rack of H200s (64 GPUs) can replace 26 racks of air-cooled A100s. One other key point, Supermicro has made their own liquid cooling parts, ensuring rapid delivery - two weeks in most cases.
Supermicro also showed off their latest liquid-cooled 21" design with power shelves, busbar, NVLINK switch tray, and of course the NVIDIA GB200 NVL72 which includes 36 Grace CPUs and 72 Blackwell GPUs. For smaller deployments Supermicro also supports NVL36 with liquid cooling.
Lastly, management of these systems is critical, Supermicro is continuing to grow their single-pane of glass management system - SuperCloud Composer.
Thanks to Supermicro for bringing us over to their booth at Computex 2024!
Supermicro NVIDIA PDF: www.supermicro.com/manuals/br...
Liquid Cooling Article:
www.storagereview.com/news/su...
#ai #datacenter #nvidia

[@timandshutravel]

Any full sized photos of that GB200 rack? I zoomed in on a photo I saw on your site and it looks like that rack has 3 power shelves in the top and only 2 in the bottom. Trying to understand their power scheme.

[@StorageReview]

Email info@ and we can send you high res.

[@VictorOlenic-ve7gh]

NVlink connections at the back (between GPUs and NVlink switch trays) are copper NOT fiber

[@TayschrennSedai]

How many nuclear power plants does it come with to power it.

[@TayschrennSedai]

The info graph pdf in the description says up to 80kw per rack that's mind boggling. But they also have systems with like L4 cards, much more reasonable haha

[@iansmith3301]

If you trimmed your beard at a barber and upgraded your microphone, your overall quality would improve tenfold.