xAI

Oracle revealed during its quarterly earnings call that it has secured permits to build a trio of small modular nuclear reactors that could deliver power for a 1-gigawatt AI data center.

Now that X's Colossus supercomputer with 100,000 H100 GPUs is online, Elon Musk hints at its further expansion with 50,000 more H200 GPUs.

In a 16,384 H100 GPU cluster, something breaks down every few hours or so. In most cases, H100 GPUs are to blame, according to Meta.

Elon Musk deployed 14 mobile generators at the xAI Memphis Supercluster to generate 35 MWe to power 32,000 H100 GPUs.

Elon Musk says that he'll have 90,000 Nvidia H100s, 40,000 AI4 chips, and the equivalent of 8,000 H100 GPUs in Dojo D1 processors by the end of 2024.

Memphis Supercluster training started at ~4:20am local time.

The massive data centers use liquid cooling for top performance.

Nvidia's B200 GPUs will be used to boost the X platform's AI capabilities

xAI plans to build another massive supercomputer by late 2025, surprisingly based on Nvidia's H100 GPU.

GPU shortages and power are the two main obstacles for AI development.