Nvidia buys AI chip startup Groq's assets for $20 billion in the company's biggest deal ever — Transaction includes acquihires of key Groq employees, including CEO

Groq Spokesperson on a stage
(Image credit: Getty Images / Bloomberg)
Latest Videos FromTom's Hardware
TOPICS
Hassam Nasir
Contributing Writer

Hassam Nasir is a die-hard hardware enthusiast with years of experience as a tech editor and writer, focusing on detailed CPU comparisons and general hardware news. When he’s not working, you’ll find him bending tubes for his ever-evolving custom water-loop gaming rig or benchmarking the latest CPUs and GPUs just for fun.

  • jp7189
    I've never quite understood groq's magic sauce, but they use on-board sram measured in MB rather than using stacks of expensive HBM measured in GB and still knock it out of the park for LLM specific tasks. Im kinda sad to see Nvidia gobble them up because they seemed to have something truly different, and I'm actually fan of competition.
    Reply
  • bit_user
    jp7189 said:
    I've never quite understood groq's magic sauce, but they use on-board sram measured in MB rather than using stacks of expensive HBM measured in GB and still knock it out of the park for LLM specific tasks.
    It's basically what all the dataflow ASICs do. It was great with convolutional neural networks, but kinda broke with transformers. I think you have to scale up to a large number of chips, for it it to work with LLMs, which is another aspect they focused on. Unlike Tenstorrent, they went with a more tightly-coupled chip-to-chip interface.

    BTW, they don't say exactly how much SRAM they've got, but they say "hundreds of MBs", which is on the order of what Nvidia now has. I think Groq might still have at least an order of magnitude higher SRAM per TOPS, though.

    jp7189 said:
    Im kinda sad to see Nvidia gobble them up because they seemed to have something truly different, and I'm actually fan of competition.
    Nvidia had seemed to be moving in this direction, with NVDLA, but then they reversed course and excluded it from their latest SoCs.

    More info on their tech is here:
    https://groq.com/lpu-architecture
    See also:
    https://www.nextplatform.com/2022/03/01/groq-buys-maxeler-for-its-hpc-and-ai-dataflow-expertise/
    Reply
  • LordVile
    More money shovelled onto the pyre
    Reply
  • bit_user
    LordVile said:
    More money shovelled onto the pyre
    Not really, IMO. Because it's Nvidia, it's already "AI money". It would be different, if it were an outside funding source.
    Reply
  • LordVile
    bit_user said:
    Not really, IMO. Because it's Nvidia, it's already "AI money". It would be different, if it were an outside funding source.
    Depends how it’s funded
    Reply
  • bit_user
    LordVile said:
    Depends how it’s funded
    It's Nvidia, dude. Cash transaction, I'm sure. They have tons of it and shareholders wouldn't want any share price dilution from a stock transaction.
    Reply