AMD's fastest AI chips could get a memory boost as competition with Nvidia intensifies — Instinct MI300 will soon come with new memory configurations

AMD MI300X
(Image credit: AMD)

Recently, Nvidia launched its H200 with 141GB of HBM3E and stole quite a lot of thunder from AMD; Nvidia's latest came just after AMD had released its Instinct MI300A with 128GB of HBM3 memory and the Instinct MI300X AI accelerators with 192GB of HBM3 memory. However, AMD may be prepping new versions of Instinct MI300-series products with more memory. 

Mark Papermaster, chief technology officer of AMD, implied this possibility during his presentation at the Arete Investor Webinar Conference last week.

It should be noted that AMD's Instinct MI300A is equipped with 128GB of HBM3 memory using 8-Hi known good stack die (KGSD), whereas the Instinct MI300X comes with 192GB of memory and uses 12-Hi KGDSs. For now, none of AMD's products use HBM3E, but it looks like the company could use it for some of the future versions of AMD's Instinct MI300-series products.

"We have been very closely working with our customers, and what we can tell you this, I willl tell you right now: that race has begun, and it is going to be a competitive race," said Papermaster. "You are going to see that back and forth like you have always seen when you have competition. It is going to be great for the market. It is certainly spurring us at AMD to be at our very best of innovation. […] Stay tuned with us as we will share more details forthcoming on that roadmap because it is indeed a multiyear roadmap that we have laid out."

TOPICS
Anton Shilov
Contributing Writer

Anton Shilov is a contributing writer at Tom’s Hardware. Over the past couple of decades, he has covered everything from CPUs and GPUs to supercomputers and from modern process technologies and latest fab tools to high-tech industry trends.