IBM CEO warns that ongoing trillion-dollar AI data center buildout is unsustainable — says there is 'no way' that infrastructure costs can turn a profit

Arvind Krishna
(Image credit: Getty / Bloomberg)

IBM CEO Arvind Krishna used an appearance on The Verge’s Decoder podcast to question whether the capital spending now underway in pursuit of AGI can ever pay for itself. Krishna said today’s figures for constructing and populating large AI data centers place the industry on a trajectory where roughly $8 trillion of cumulative commitments would require around $800 billion of annual profit simply to service the cost of capital.

The claim was tied directly to assumptions about current hardware, its depreciation, and energy, rather than any solid long-term forecasts, but it comes at a time when we’ve seen several companies one-upping one another with unprecedented, multi-year infrastructure projects.

Krishna estimated that filling a one-gigawatt AI facility with compute hardware requires around $80 billion. The issue is that deployments of this scale are moving from the drawing board and into practical planning stages, with leading AI companies proposing deployments with tens of gigawatts — and in some cases, beyond 100 gigawatts — each. Krishna said that, taken together, public and private announcements point to roughly one hundred gigawatts of currently planned capacity dedicated to AGI-class workloads.

Krishna pointed to depreciation as the part of the calculation most underappreciated by investors. AI accelerators are typically written down over five years, and he argued that the pace of architectural change means fleets must be replaced rather than extended. “You've got to use it all in five years because at that point, you've got to throw it away and refill it,” he said.

Google Preferred Source

Follow Tom's Hardware on Google News, or add us as a preferred source, to get our latest news, analysis, & reviews in your feeds.

Luke James
Contributor

Luke James is a freelance writer and journalist.  Although his background is in legal, he has a personal interest in all things tech, especially hardware and microelectronics, and anything regulatory. 

  • tennis2
    Where is all the investment money coming from? That's my question.

    Even if we're only talking about the datacenters' hardware/infrastructure, this is a massive amount of money. Where is it being divested from?
    Reply
  • Eximo
    It isn't, borrowed against stock price collateral. A giant house of cards with the only real winner being the large capital firms getting the interest while it is still growing.

    They all think that they can find a way to make profit eventually.
    Reply