The Compute Crisis and the SpaceX GPU Monopoly
Theo - t3.gggo watch the original →
the gist
The AI industry is severely supply-constrained by a multi-layered bottleneck involving TSMC manufacturing, high-bandwidth memory, storage, and power, leaving companies like Google and Anthropic forced to rent excess compute from Elon Musk's SpaceX.
The Multi-Layered Compute Bottleneck
The current AI compute crisis is not merely a shortage of GPUs but a systemic failure across a complex supply chain. The industry relies on TSMC for silicon fabrication, where lead times for new capacity are 8 to 10 years. Even if silicon production scales, the industry hits immediate secondary bottlenecks in high-bandwidth memory (HBM) production—dominated by only three manufacturers—and a critical shortage of high-capacity hard drives for data storage. Furthermore, power availability has become a primary constraint, as commercial electricity demand for data centers now outpaces residential usage, forcing companies to invest directly in power generation and nuclear energy to keep their clusters online.
The Strategic Failure of Compute Allocation
Major AI players are suffering from miscalculated bets on compute demand. OpenAI secured a dominant position by betting early on scaling laws and aggressively purchasing compute capacity. Conversely, Anthropic adopted a conservative approach to compute spending, which left them unable to scale their inference capacity as demand surged. Google attempted to bypass the hardware shortage by manufacturing their own TPUs, but they failed to meet internal demand and are now forced to pay SpaceX approximately $920 million per month to rent excess compute. Elon Musk's early, aggressive over-investment in compute for XAI and SpaceX—initially viewed as a risky over-extension—has turned into a massive revenue stream, effectively making SpaceX a critical infrastructure provider for its own competitors.