Nvidia's $3,000 mini AI supercomputer draws scorn from Raja Koduri and Tiny Corp — AI server startup suggests users "just buy a gaming PC"
Enthusiasts spellbound by this ‘AI Supercomputer’ should "just buy a gaming PC," suggests Tiny Corp.
Nvidia caught the imaginations of many technology enthusiasts on Tuesday with its show-closing, 'just one more thing'- style reveal of the Project Digits AI supercomputer. But seasoned graphics chip designer Raja Koduri and disruptive AI server startup Tiny Corp were not enchanted by the small golden box or blinded by Jensen's shimmering jacket. Both have publicly scorned Nvidia's Grace Blackwell AI Supercomputer.
At first glance, the purported provision of 1 PFLOPS of performance in such a tiny device might seem like a vision of the future, even if it is priced at $3,000. As told by the Nvidia CEO, we might believe that Project Digits is akin to AI alchemy in a box. But all that glistens isn’t gold. The spec of the headlining GB10 Superchip, the “1 PFLOP FP4 AI Compute,” is a somewhat deceptive hint to Raja Koduri and Tiny Corp (founded by American security hacker George Hotz, AKA geohot).
Koduri’s Project Digits takedown is what you probably could describe as a gentle geeky joke with a sprinkling of cynicism. The graphics chip design icon posted, “Divide flops by 4 and multiply dollars by 2. A CES (20+25)² tip for staying grounded,” poking fun at the green team.
Divide flops by 4 and multiply dollars by 2A CES (20+25) ² tip for staying groundedJanuary 7, 2025
Koduri later elaborated that - in contrast to the big FP4 claims - by his calculations, the FP16 performance of the Project Digits AI supercomputer wasn’t that impressive. Koduri estimated that the FP16 performance of the upcoming GeForce RTX 5070 and even the $250 Intel Arc B580 “seems close” to what a Project Digits machine could muster.
You may remember last year's news coverage involving Tiny Corp and its TinyBox project. In brief, Tiny Corp and its founder were very publicly displeased with AMD’s drivers. However, its plan to democratize AI acceleration by using (AMD) gaming GPUs instead of even more costly pro/enterprise alternatives was perhaps too bold. The firm managed to grab the attention of AMD publicly, and even Dr. Lisa Su and the red team were quite gracious despite the startup’s abrasive posturing and demands.
An AI swindle?
Fast forward to CES 2025, and Tiny Corp hasn’t lost its abrasive edge. “People are begging to get swindled by a $3,000 box that says AI on the side. We always get asked if we'll launch something at that price point. We won't,” grumbled Tiny Corp before advising its casual followers to “Just buy a gaming PC.”
People are begging to get swindled by a $3,000 box that says AI on the side. We always get asked if we'll launch something at that price point. We won't.Just buy a gaming PC.January 7, 2025
Earlier in the day, Tiny Corp had become seemingly irritated by the Project Digits announcement. “This is marketing. FP4 is unusable, it's 500 TFLOPS of FP8. tinybox green has 4 PFLOPS of FP8, 8x more powerful.”
Stay On the Cutting Edge: Get the Tom's Hardware Newsletter
Get Tom's Hardware's best news and in-depth reviews, straight to your inbox.
Nvidia’s Project Digits won’t be available until May when it is expected to roll out for around $3,000. TinyBox computers, starting from $15,000, are available for the ‘red’ model with 738 FP16 TFLOPS and “mediocre” driver quality (another barb cast at AMD).
Mark Tyson is a news editor at Tom's Hardware. He enjoys covering the full breadth of PC tech; from business and semiconductor design to products approaching the edge of reason.
-
FR33L35T3R And this gentleman, certainly very intelligent, could he explain to us how to get a gaming PC for $3000 that has 128 GB of video memory?Reply -
bit_user
First of all, it's "glistens". I didn't know "glisters" was even a word!The article said:As told by the Nvidia CEO, we might believe that Project Digits is akin to AI alchemy in a box, but all that glisters isn’t gold.
: D
Second, that box is fugly! I hadn't seen such a clear pic of it, before. Yuck! I'd have to put it somewhere out of sight.
Even on fp4, the < $600 RTX 5070 still matches it!The article said:Koduri later elaborated that - in contrast to the big FP4 claims - by his calculations, the FP16 performance of the Project Digits AI supercomputer wasn’t that impressive. Koduri estimated that the FP16 performance of the upcoming GeForce RTX 5070
These guys are exactly right. The only thing that sets it apart is its memory capacity. -
bit_user
Funny thing is, Nvidia has a long history of selling its lowest-tier GPUs with normal DDR memory.FR33L35T3R said:And this gentleman, certainly very intelligent, could he explain to us how to get a gaming PC for $3000 that has 128 GB of video memory?
In that case, it's not inconceivable they could make such a thing as like a RTX 5070 with stacked LPDDR5x, if they wanted to. I'm guessing their Digits box doesn't have more than a 256-bit memory interface, so you'd get at least parity in a card that could be sold far less expensively and where you could use up to 4 of them in a workstation (in contrast to Digits' scaling of only x2). -
Eximo GPU with NVMe attached perhaps, AMD messed with that if I recall. But yeah, slapping some DIMM or CAMM modules onto the back of a GPU wouldn't be impossible if they added the memory controllers to the silicon.Reply -
bit_user
DIMMs wouldn't be a good option, due to needing 4 of them for adequate bandwidth and capacity. Also, regular DDR5 is rather power-hungry, when you slam it hard. Supporting a pair of LPCAMMs would be an option, but add bulk and cost for nominal benefits.Eximo said:GPU with NVMe attached perhaps, AMD messed with that if I recall. But yeah, slapping some DIMM or CAMM modules onto the back of a GPU wouldn't be impossible if they added the memory controllers to the silicon.
I'd really expect them just to solder down LPDDR5X chips, like they currently do in Digits and all their other GPUs. -
Spartanbld "begging to be swindled"...Reply
Don't hold back...tell us how you REALLY feel about it? :ROFLMAO:
The idea that you can have a supercomputer on your desk, hidden behind a tissue box is hard to ignore. BUT...I'm adverse to throwing away money... -
bit_user
It's not a supercomputer. It has the same AI horsepower as a < $600 dGPU!Spartanbld said:The idea that you can have a supercomputer on your desk, hidden behind a tissue box is hard to ignore. BUT...I'm adverse to throwing away money...
The only thing that sets it apart from a decent gaming PC is the amount of memory its GPU has local access to. Well, that and the ARM cores instead of x86. -
TesseractOrion
Well it definitely *is* a word, ever since Shakespeare's time (notably in "The Merchant of Venice") 😀bit_user said:First of all, it's "glistens". I didn't know "glisters" was even a word!
: D
So a bit archaic LOL -
bit_user
I just realized that I misremembered the quote. Their word was actually closer than mine. It should be "glitters". I was thinking it was a Tolkien quote, but his is yet different (still uses "glitters", though).TesseractOrion said:Well it definitely *is* a word, ever since Shakespeare's time (notably in "The Merchant of Venice") 😀
So a bit archaic LOL
...and more fitting, too. Looks like it started out black, and then someone went nuts with glue and a bunch of gold glitter! -
Spartanbld OBVIOUSLY the gold glitter is added so man can confuse it with their jewelry box. After all, we all keep our jewels in there...Reply
No need to kick me, I'll see myslef out...:p