Samsung HBM3E chips reportedly fail to meet Nvidia's heat and power requirements — Korean chipmaker continues to struggle for Nvidia HBM3E orders

News
By published

More business opportunities for Micron and SK Hynix?

Samsung
(Image credit: Shutterstock)

Reuters reports that Samsung is facing challenges with its latest HBM3 and HBM3E memory stacks. They have failed Nvidia's tests due to excessive heat and power consumption issues. This setback is significant for Samsung as Nvidia dominates the global processors market for AI applications. But this could be an issue for Nvidia, which needs all the HBM supplies it can get to meet the demand for its processors based on the Hopper and Blackwell architectures.

Formally, Samsung's HBM3E memory stacks are the fastest in the industry, rated for data transfer rates of up to 9.8 GT/s/. Samsung officially started production of its 24 GB and 36 GB HBM3E in late April. However, the report from Reuters says that without elaboration, some of Samsung's HBM3 and HBM3E devices cannot pass Nvidia's validation for specific products.

Anton Shilov
Anton Shilov
Contributing Writer

Anton Shilov is a contributing writer at Tom’s Hardware. Over the past couple of decades, he has covered everything from CPUs and GPUs to supercomputers and from modern process technologies and latest fab tools to high-tech industry trends.

3 Comments Comment from the forums
  • The original report might not be fully correct. It is a bit unclear whether this is a production issue at Samsung's Fab, a packaging related issue or something else entirely.

    Since a failing qualification tests certainly doesn't mean that Samsung's process is flawed; in reality, Samsung has supplied HBM3 memory to AMD for its Instinct MI300X accelerator.

    As per some insider industry reports, these failing tests were associated with how high the "bar" and expectation was established by NVIDIA's partners like SK hynix, and some related it to the fact that TSMC was also a bit reluctant to see the inclusion of Samsung into the supply chain, so the situation is uncertain as of now.

    But we can't verify the accuracy of these claims/rumors though.

    Any quality tests by clients taking months is not uncommon in the chip industry, where a new chip will start development usually two years in advance before it rolls out commercially. Back and forth with a client over varying test results is also not uncommon.

    Meanwhile, whether Samsung can supply its HBM3E devices to other companies, such as AMD, is unclear.

    Well, I suppose AMD might be in a better position if this news is to be believed. Though, this can't be directly correlated with the current power/heat issues Nvidia is facing.

    But anyway, Korean media recently reported that the Samsung has gained AMD's trust in its HBM3E memory. The Korean giant has decided to supply HBM3E 12-layer DRAM to AMD, which is expected to come into mass production sometime later this year. The contract is worth around 4 trillion won, or $3 billion.

    The report further states that Samsung has bought AMD's GPUs in exchange, but the quantities haven't been disclosed yet.

    https://www.viva100.com/main/view.php?key=20240423010007552
    Reply
  • thisisaname
    But we can't verify the accuracy of these claims/rumors though.

    That the great about rumours, you can write so many column about then and not have to produce any evidence, other than "someone said".

    Not saying the author of the article made it up but rumours do lead to a lot of interesting articles :)
    Reply
  • I knew this was coming:

    Samsung Electronics has firmly denied a Reuters report alleging that its high-bandwidth memory (HBM) products failed to meet Nvidia’s quality standards.

    https://www.businesskorea.co.kr/news/articleView.html?idxno=217731
    Reply