On-Prem

Systems

Supermicro's 'universal GPU' system welcomes all elements

Biz claims ultra-composable server platform is future-proof


Supermicro’s new "Universal GPU" servers, announced on Monday, is as equal-opportunity as silicon tech can get – it does not discriminate on CPUs, GPUs, storage, and networking technologies.

The boxen can be constructed in a number of ways to include processors from Intel and AMD, and graphics accelerators from AMD and Nvidia. It can be further customized to include proprietary technologies that include Nvidia's NVLink or AMD's Infinity Fabric interconnects to link up multiple GPUs.

The datacenter-class systems, which will come in 4U or 5U sizes, have a “modular” architecture based on standards established by the Open Compute Project, such as the OCP Accelerator Modules (OAM). The modular approach allows for more economical CPU and GPU upgrades without replacing entire systems, Supermicro said.

The server is clearly built for applications like artificial intelligence with a heavy reliance on GPUs, memory, and storage. For those who don’t want to use proprietary tech like Nvlink, the system supports PCIe 4.0, and will support PCIe 5.0, which Intel and AMD are now starting to embrace with their silicon.

The system will support GPUs including AMD's Instinct MI250 GPUs or the Nvidia’s A100 GPUs with a thermal capacity of 700 Watts.

The base configurations include dual-socket support for 3rd-Gen Intel Xeon scalable processors with up to 48 cores per package, or 3rd-Gen AMD Epyc parts with up to 64 cores per package.

Given the future-proof nature of this server, it is assumed that the server will support AMD’s new Milan-X chips, which were announced on Monday, and Intel’s upcoming Sapphire Rapids chips, which includes new packaging that could add more computing might to the GPU server.

The AMD and Intel-based configuration supports up to 8TB of DDR4 memory and has eight PCIe 4.0 slots. It is also assumed the system will support DDR5 memory, given the future-proof nature of this server.

Expansion modules support the addition of 1U expansion module to tack on more GPUs or PCIe attached devices.

The AMD configuration supports four AMD MI250 or Nvidia’s HGX A100 GPUs. The Intel system supports only Nvidia’s HGX A100 GPUs, and can take up to 12TB of Intel Optane Persistent Memory. ®

Send us news
1 Comment

Superclusters too big, but single servers too small? Oracle offers AI Goldilocks zone

Adds L40 bare metal option to the O-Cloud, plus A100 and H100 VMs. And teases a GH200 beast

AMD sold $1B of Instinct GPUs last quarter, driving triple-digit datacenter growth

Which is nice, but way behind Nvidia, while other segments are soft and supply-chain pain persists

Bring the hammer down on Nvidia, US progressive and antitrust orgs urge the Feds

Lobbyists would love for rumors of a monopoly probe into GPU goliath to become reality

Meta to boost training infra for Llama 4 tenfold, maybe deliver it next year

Sweet sweet GenAI money not yet flowing, Zuck reckons other ML efforts are paying off

China stops worrying about lack of GPUs and learns to love the supercomputer

The workaround is going to be inevitable in the future anyway, say Chinese boffins

Zuck dreams of personalized AI assistants for all – just like email

A model finetuned on your social media profile? What could possibly go wrong?

Nvidia said to be prepping Blackwell GPUs for Chinese market

But will they ship before the Biden administration tightens export controls?

Honey, I shrunk the LLM! A beginner's guide to quantization – and testing it

Just be careful not to shave off too many bits ... These things are known to hallucinate as it is

EU Competition Commissioner hints at Nvidia GPU probe, refers to 'huge bottleneck'

CUDA, woulda, shoulda be first port of call for AI slingers, but does it respect its own dominance?

CyrusOne scores another $7.9B in debt financing to expand AI datacenter empire

Lenders bet you're willing to rent GPUs

China's Moore Threads adds support for 10K GPU clusters

Chinese slinger's kit still no match for Nvidia's sanction-evading cards

Nvidia forecast to bounce back in China to make $12B selling GPUs

Company's sales in the region have dropped under US plan to curb country's AI hopes
  翻译: