Ampere announces 256-core 3nm CPU, unveils partnership with Qualcomm

News
By
Published

Also looking at chiplets, integration of third-party IP.

Ampere
(Image credit: Ampere)
5

Ampere Computing today introduced its roadmap for the coming years, including new CPUs and collaborations with third parties. In particular, the company said it would launch its all-new 256-core AmpereOne processor next year, made on TSMC's N3 process technology. Also, Ampere is teaming up with Qualcomm to build AI inference servers with the company's accelerators. Apparently, Huawei is also looking at integrating third-party UCIe-compatible chiplets into its own platforms.

256-core CPUs incoming

Latest Videos FromTom's Hardware
Anton Shilov
Anton Shilov
Contributing Writer

Anton Shilov is a contributing writer at Tom’s Hardware. Over the past couple of decades, he has covered everything from CPUs and GPUs to supercomputers and from modern process technologies and latest fab tools to high-tech industry trends.

5 Comments Comment from the forums
  • bit_user
    That's indeed a lot of cores, but I'd point out that AMD Bergamo already has 256 threads (using 128 Zen 4C cores).

    So far, what little performance data I've seen on AmpereOne performance suggests they don't perform markedly better than the ARM Neoverse V-series cores used by Amazon, Nvidia, and others.

    The article said:
    So, it teamed up with Qualcomm, and the two companies plan to build platforms for LLM inferencing based on Ampere's CPUs and Qualcomm's Cloud AI 100 Ultra accelerators.
    Yeah, but you could just put those Qualcomm PCIe cards in a server with any other kind of CPU for similar AI performance and efficiency. When scaling AI inference, it's really the AI accelerators that primarily drive the efficiency. What CPU sits at the heart of the system doesn't matter as much.
    Reply
  • thestryker
    bit_user said:
    So far, what little performance data I've seen on AmpereOne performance suggests they don't perform markedly better than the ARM Neoverse V-series cores used by Amazon, Nvidia, and others.
    They've been seemingly less open about these than their prior Neoverse based SoCs I wonder if that's why. Of course they'd also said they were targeting specific workload performance increases over general IPC so I'd love to see that in action.
    bit_user said:
    That's indeed a lot of cores, but I'd point out that AMD Bergamo already has 256 threads (using 128 Zen 4C cores).
    Not to mention GNR/Zen 5 will both be likely bringing that core count to high performance this year and also SRF/Zen 5c so the competition in this space ought to be massive.
    Reply
  • Pierce2623
    bit_user said:
    That's indeed a lot of cores, but I'd point out that AMD Bergamo already has 256 threads (using 128 Zen 4C cores).

    So far, what little performance data I've seen on AmpereOne performance suggests they don't perform markedly better than the ARM Neoverse V-series cores used by Amazon, Nvidia, and others.


    Yeah, but you could just put those Qualcomm PCIe cards in a server with any other kind of CPU for similar AI performance and efficiency. When scaling AI inference, it's really the AI accelerators that primarily drive the efficiency. What CPU sits at the heart of the system doesn't matter as much.
    Isn’t AmpereOne just a neoverse core like Ampere Altra was, but just a newer version?
    Reply
  • thestryker
    Pierce2623 said:
    Isn’t AmpereOne just a neoverse core like Ampere Altra was, but just a newer version?
    Nope it's supposed to be semi/full custom, but they haven't released much of any information about it still.

    Ian Cutress lamented the lack of concrete information in his post about this announcement: https://morethanmoore.substack.com/p/ampere-2024-one-more-step-forward
    Reply
  • bit_user
    Pierce2623 said:
    Isn’t AmpereOne just a neoverse core like Ampere Altra was, but just a newer version?
    What @thestryker said, but it's really not surprising if we consider that Ampere Computing released CPUs with in-house designed cores before Altra. From what I heard, Altra was something of a stopgap measure, due to AmpereOne running behind schedule.

    Before Altra, there was eMAG. However, that was a derivative of X-Gene 3, which was designed by AppliedMicro and acquired by Ampere either at its founding or shortly thereafter. As the name implies, X-Gene 3 wasn't their first rodeo.
    https://www.anandtech.com/show/5098/applied-micros-xgene-the-first-armv8-soc
    Reply