Elon Musk’s Nvidia-powered Colossus supercomputer faces pollution allegations from under‐reported power generators

VoltaGrid Mobile Generators
(Image credit: VoltaGrid / YouTube)

The Colossus Supercomputer may be a colossal problem for the world's richest man.

Last July Elon Musk fired up the Colossus, a supercomputer that uses 100,000 Nvidia H100 GPUs on a single fabric. The site could draw only 7 MW at its launch, however, enough to power just 4% of its GPUs. To solve this, Musk deployed several massive mobile generators to deliver the site’s electrical demands.

Latest Videos FromTom's Hardware
Jowi Morales
Contributing Writer

Jowi Morales is a tech enthusiast with years of experience working in the industry. He’s been writing with several tech publications since 2021, where he’s been interested in tech hardware and consumer electronics.

  • jp7189
    I did a little poking around and (aside from not running the datacenter at all), the generators and batteries are actually them being nice to the neighbors in my opinion. The workload of AI training has huge power fluctuations as the scheduled tasks spin up various clusters. Sometimes massive compute is used and sometimes there is low power idle time. It would absolutely wreck the power grid to deal with that, so xai installed tons of tesla energy batteries and charges the off the generators. The setup smooths out the fluctuations demanded of the power grid.
    Reply
  • ezst036
    This seems like the kind of thing that an Ars Technica journalist could selectively report.

    Yes, Elon has made himself a big public enemy, that still doesn't excuse selective reporting, which is actually editorializing in disguise as news.

    The use of these generators is not unknown, but persons who tote the line will not be attacked under the guise of honest reporting. The Elon of 15 years ago got away with stuff like this and was held up by many of the same outlets now in outrage.
    Reply
  • SomeoneElse23
    ezst036 said:
    This seems like the kind of thing that an Ars Technica journalist could selectively report.

    Yes, Elon has made himself a big public enemy, that still doesn't excuse selective reporting, which is actually editorializing in disguise as news.

    The use of these generators is not unknown, but persons who tote the line will not be attacked under the guise of honest reporting. The Elon of 15 years ago got away with stuff like this and was held up by many of the same outlets now in outrage.
    Not a public enemy, but an enemy of a certain group of haters who are incapable of seeing good in those they are told are the enemy.
    Reply
  • Alvar "Miles" Udell
    Do tell, what are the emissions products and numbers from these natural gas generators vs, say, a natural gas power plant, like the 1100MW natural gas power plant in Memphis?
    Reply
  • YSCCC
    Somehow I've always been skeptical for the various companies burning away crazy amount of fuel for AI training only for the LLM to use chance calculations to look right in chat type use..
    Reply
  • jlake3
    Alvar Miles Udell said:
    Do tell, what are the emissions products and numbers from these natural gas generators vs, say, a natural gas power plant, like the 1100MW natural gas power plant in Memphis?
    Someone poked around, and according to GE the turbines used in the TVA's Allen Combined Cycle Plant about a mile down the road should achieve 63.6% efficiency. Portable units like the ones deployed by xAI typically operate around 35% efficient.

    Didn’t see numbers on specific emissions products, but portable generators are subject to more lax standards on a per-unit basis than large installations.
    Reply
  • waltc3
    So far, no laws are being violated, and this is of course just another thinly veiled attack on Musk by the sad people who thought he was wonderful until he revealed his personal political preferences. Used to be in the country that we all respected each other even though we may disagree politically--it was simply no big deal. That seems to have gone by the wayside, unfortunately.
    Reply
  • Notton
    Let's see... hyperloop broke, cybertruck recalls, spacex exploding, twitter losing users...
    If it walks like a duck and quacks like a duck, then it's probably a duck.
    Reply
  • SpicyLlama
    Alvar Miles Udell said:
    Do tell, what are the emissions products and numbers from these natural gas generators vs, say, a natural gas power plant, like the 1100MW natural gas power plant in Memphis?
    It’s a combined-cycle steam/gas generation plant with only 3 gas fired units, not 15-30 raw gas turbines of questionable origin. Most of that 1100 MW is coming from steam turbines, not to mention an additional 1 MW of solar. Google is your friend.
    Reply
  • SpicyLlama
    waltc3 said:
    So far, no laws are being violated, and this is of course just another thinly veiled attack on Musk by the sad people who thought he was wonderful until he revealed his personal political preferences. Used to be in the country that we all respected each other even though we may disagree politically--it was simply no big deal. That seems to have gone by the wayside, unfortunately.
    Those who want respect, should give respect.
    Reply