AMD says its EPYC processors are up to twice as fast as Nvidia's Arm-powered Grace CPU Superchip across multiple benchmarks

When it comes to data center CPUs, Nvidia is a new kid on the block that has to prove that it can develop competitive processors for servers. AMD, an established player, apparently considers Nvidia's 72-core Arm-powered Grace Hopper Superchip a competitor, which is why it decided to publish a blog that compared the performance of its EPYC processor to Nvidia's Grace platform in a series of benchmarks, claiming up to a 2x performance advantage. AMD also points out x86's compatibility advantages over chips based on the Arm architecture. While, of course, such a comparison has to be taken with a grain of salt, it gives us some idea about the performance of Nvidia's Grace CPU.

Based on tests conducted by AMD, its EPYC 9754 (128-cores) and 9654 (96 cores) processors deliver over twice the performance of Nvidia's Grace CPU Superchip (72 cores) in various workloads, including general-purpose computing, server-side Java, transactional databases, decision support systems, web servers, in-memory analytics, video encoding, and high-performance computing (HPC). 

For instance, in the SPECpower_ssj2008 benchmark, single- and dual-socket AMD EPYC systems outperform Nvidia Grace systems by approximately 2.50x and 2.75x, respectively. A dual-socket AMD EPYC 9654 system outperforms a similar Nvidia system by about 2.27x on the same tests, highlighting their superior energy efficiency. 

AMD says its EPYC processors hold over 300 world records for performance and efficiency across various benchmarks, including business applications, technical computing, data management, data analytics, digital services, media and entertainment, and infrastructure solutions. Still, considering the fact that the main purpose of Nvidia's Grace Hopper project is to run AI training and inference workloads, not exactly general-purpose server workloads, the results aren't shocking. However, Nvidia's Hopper is renowned for its prowess in AI applications.

AMD's EPYC Zen 4 processors are built on the x86-64 architecture, ensuring compatibility with a wide array of software written for x86 architecture. By contrast, Nvidia's Grace is based on the Arm architecture, and while Arm is catching up with x86 in terms of data center software support, x86 is still ahead in terms of compatibility.

AMD also notes that due to their high performance, energy efficiency, and compatibility with existing software and infrastructure, AMD's EPYC processors offer a lower total cost of ownership (TCO) than Nvidia's Grace. 

AMD's own tests show that its EPYC processors outperform Nvidia's Grace CPU Superchip across various key workloads, provide extensive compatibility due to their x86-64 architecture, and offer a proven, future-proof solution for diverse data center needs, which is why the company claims they are a better choice for general data center workloads. However, when it comes to AI training and inference, Nvidia's Grace Hopper platform can offer significant advantages over AMD's Instinct. After all, AI is what Nvidia's Grace Hopper platform was developed to address from the start.