Holy Moly. Meta has now revealed new details about Prometheus, its gigawatt-scale AI supercluster in Ohio.
During synchronized training, Prometheus experiences 30–40% power swings, shifting tens of megawatts in seconds. Meta developed a system called Dynamo Dimmer to throttle GPU power, supported by batteries and capacitors.
The first phase has already trained Muse Wonder. Prometheus now connects hundreds of thousands of Nvidia GPUs across multiple buildings, with plans to scale to roughly 1 million and add Nvidia's Vera Rubin hardware.
At its peak in mid-2025, Prometheus suffered nearly 1,000 training interruptions per day per 8,000 GPUs. Meta says engineering fixes with Nvidia have since reduced interruptions by 99%.
To keep 32,768 GPUs actively training, Meta provisions 37,656 GPUs, including spare capacity for hardware failures.