Explosive HBM demand fueling an expected 20% increase in DDR5 memory pricing — demand for AI GPUs drives production cuts for standard PC memory

AMD
(Image credit: AMD)

Driven by overwhelming demand for AI servers, high bandwidth memory (HBM) is experiencing rapid growth. Micron and SK Hynix officially said that their HBM supply is sold out for 2024 and most of 2025. As a result, prices of HBM memory are expected to increase by 5% to 10% next year, according to analysts from TrendForce. Furthermore, prices of other types of DRAM will likely increase as well, with DDR5 predicted to increase by 15% to 20% due to memory manufacturers shifting priorities to HBM production. 

HBM is much more expensive than standard DRAM types, costing about five times more than DDR5. This higher cost is justified by the substantial performance and capacity advantages that HBM has compared to commodity DRAMs. It's also considerably harder to build HBM memory devices and stacks than traditional DDR ICs and modules. Memory makers have to devote more production capacity to HBM, reducing the capacity available for other types of memory, which naturally drives DRAM prices up. 

TrendForce recently adjusted its forecast for the second-quarter server DRAM contract prices. The market research firm initially expected DRAM prices to increase by 3% to 8%, but it now projects a rise of 15% to 20%. This update represents the third successive quarter of double-digit percentage growth of DRAM prices, starting from Q4 2023. In April alone, the prices of server DRAM in all categories rose by 9% to 19%.

(Image credit: TrendForce)

From a market share perspective, HBM's portion of total DRAM bit capacity is set for a rapid increase. It's anticipated to grow from a mere 2% in 2023 to 5% in 2024, eventually exceeding 10% by the end of 2025. This expansion reflects escalating demands placed on memory subsystems by cutting-edge AI applications. As a result, HBM’s contribution to the total DRAM market is predicted to grow considerably, potentially dominating more than 30% of the market's value by 2025. 

Discussions about HBM pricing for 2025 started in the second quarter of 2024, prompted by limited overall DRAM capacity. This limitation has led to an initial price hike of between 5% and 10%. These adjustments reflect the market's expectation of continued robust demand for AI despite the current production yields for HBM3e's TSVs, which only range between 40% and 60%.

(Image credit: TrendForce)

Looking ahead, major AI solution providers will focus on enhancing HBM performance and capacity, particularly the adoption of HBM3E and increased use of 12-Hi stack products. TrendForce forecasts suggest that demand for HBM will nearly reach a 200% growth rate in 2024 and is anticipated to double by 2025.

Anton Shilov
Contributing Writer

Anton Shilov is a contributing writer at Tom’s Hardware. Over the past couple of decades, he has covered everything from CPUs and GPUs to supercomputers and from modern process technologies and latest fab tools to high-tech industry trends.

  • mac_angel
    ditch almost all DDR manufacturing, work on more mass production of HMB, and incorporate it into more GPUs like they were supposed to. :D
    Reply
  • thisisaname
    I wonder how much of the increase in production is down to undoing the cuts in production they made in 2023.
    Reply
  • parkerthon
    It’s about bubblelicious as it gets right now. Little mini datacenter renaissance happening as everyone and anyone are trying to cobble together a HPC environment to train vertical sector specific AI models. Lots of data out there people want to throw at models and see what sticks. I think AI has great promise, but nobody is buying it yet and most of these upstarts are light years away from any kind of real product. Waiting for that loud pop any day now.
    Reply
  • Li Ken-un
    parkerthon said:
    Waiting for that loud pop any day now.
    Shower us, o tech overlords! With remains of your future corpses! Enterprise SSDs, RAM, and GPUs galore!
    Reply
  • subspruce
    mac_angel said:
    ditch almost all DDR manufacturing, work on more mass production of HMB, and incorporate it into more GPUs like they were supposed to. :D
    HBM is expensive.
    Reply
  • mac_angel
    subspruce said:
    HBM is expensive.
    it wouldn't be if they all mass produced it.
    Reply