Nvidia's latest regulation-compliant H20 GPU for China has been delayed to early next year: Report

Nvidia Hopper H100 die shot
(Image credit: Nvidia)

Nvidia's H20 data center GPU is designed to comply with the latest U.S. export regulations from this month, but it's looking like it might be delayed, per a report from Reuters. Largely intended for use in China, the delay of H20 could pose a problem for Nvidia, as its product stack of Chinese-specific GPUs is somewhat thin without H20, and there are other companies in China that could fill the void.

The H20 datacenter GPU is currently Nvidia's fastest graphics card that the company can legally sell in China. Alongside two other compliant GPUs, it was announced earlier this month almost as soon as the newest American export regulations came into force. 

U.S. Department of Commerce

(Image credit: U.S. Department of Commerce)

The chart above shows the current U.S. regulations and details what is and isn't allowed. While performance density is largely not limited, performance (defined as TPP or Total Processing Performance) is severely restricted. Even with the lowest performance density, no GPUs shipped to China can have a TPP that's roughly on par with the A100. Below you can see how Nvidia's GPUs land on the chart (expand the tweet to see the full image).

See more

This second chart (click for more detail) illustrates what actual GPUs are and aren't allowed. The A100 and A800 are banned, as are lower-end chips like the A30 and A40. Even the RTX 4090 just barely didn't make the cut and is also banned now. H20 brushes up against the restricted zone of GPU specifications, hitting what might be the sweet spot. With a rating of roughly 2,500 TPP, it is Nvidia's fastest GPU that can legally be sold in China.

It was expected that H20 would launch late this year with L20 and L2, two other compliant GPUs. However, Reuters reports that Nvidia has delayed H20 as late as March. The apparent cause for the delay is issues that server manufacturers are seeing with H20, which isn't too surprising given the tight deadline for H20's launch.

Swipe to scroll horizontally
GPUHGX H20L20 PCleL2 PCle
Architecture | GPUHopper | GH100Ada Lovelace | AD102Ada Lovelace | AD104
Memory96 GB HBM348 GB GDDR6 w/ ECC24 GB GDDR6 w/ ECC
Total Processing Power (FP16/BF16)2,3681,9121,544
Performance Density2.93.135.2
Memory Bandwidth4.0 TB/s864 GB/s300 GB/s
INT8 I FP8 Tensor296 I 296 TFLOPS239 I 239 TFLOPS193 I 193 TFLOPS
BF16 I FP16 Tensor148 I 148 TFLOPS119.5 I 119.5 TFLOPS96.5 I 96.5 TFLOPS
TF32 Tensor74 TFLOPS59.8 TFLOPS48.3 TFLOPS
FP3244 TFLOPS59.8 TFLOPS24.1 TFLOPS
FP641 TFLOPSN/AN/A
RT CoreN/AYesYes
MIGUp to 7 MIGN/AN/A
L2 Cache60 MB96 MB36 MB
Media Engine7 NVDEC, 7 NVJPEG3 NVENC (+AV1), 3 NVDEC, 4 NVJPEG2 NVENC (AVI), 4 NVDEC, 4 NVJPEG
Power400 W275WTBD
Form Factor8-way HGX2-slot FHFL1-slot LP
InterfacePCIe Gen5 x16: 128 GB/sPCle Gen4 x16: 64 GB/sPCle Gen4 x16: 64 GB/s
NVLink900 GB/s--
SamplesNovember 2023November 2023November 2023
ProductionDecember 2023December 2023December 2023

On the surface, being unable to launch a product for four months might not be a backbreaker. If Chinese data centers need Nvidia GPUs now, they can just buy the L2 or the L20, which Reuters says are not delayed. However, Nvidia might not have all that much time to launch and sell H20 in China.

Last year, Nvidia's A800 and H800 were launched to comply with the first round of U.S. export bans. Those GPUs were then banned by regulations imposed in October of this year, meaning they were on the market for 11 months at most. If yet more regulations are written into law, then the H20 might also have a short lifespan in China, and that makes a four-month delay much more troublesome to Nvidia than it normally would.

Anxieties over Nvidia's ability to provide GPUs in the current environment are perhaps already leading to consequences. Just before Nvidia's latest made-for-China GPUs were announced, Baidu purchased Huawei ASICs instead. Baidu had previously bought thousands of Ampere and Hopper GPUs, and this about-face indicates it wasn't willing to wait for Nvidia's upcoming graphics chips.

In today's landscape of ever-changing U.S. regulations, flexibility and speed are required for American companies to compete in China. However, processors aren't the kind of product that have a quick turnaround time. In the case of H20, it seems Nvidia's attempts to get it out the door as soon as possible didn't pan out, and it could cost the American tech company both its performance edge as well as the confidence of Chinese customers.

Matthew Connatser

Matthew Connatser is a freelancing writer for Tom's Hardware US. He writes articles about CPUs, GPUs, SSDs, and computers in general.