Elon Musk’s xAI continues to grow, with the startup reportedly planning a major expansion in the Memphis area, one that will apply at least one million GPUs to its supercomputer.

Musk’s xAI has been expanding rapidly, forging its own path in the AI world. The company initially relied on Oracle for its Nvidia H100 systems before building out its own cluster of 100,000 H100s. According to the Memphis Chamber of Commerce, the company is preparing a major expansion of its supercomputer, with plans to grow it to at least one million GPUs.

The expansion, already underway, will incorporate a minimum of one million Graphics Processing Units (GPUs), marking the largest capital investment in the region’s history. Additionally, Fortune 500 tech giants Nvidia, Dell, and Supermicro Computer (SMC) will be establishing operations in Memphis, further solidifying the city’s position as the “Digital Delta” – a moniker coined by FedEx founder Fred Smith and his son, FedEx Executive Richard Smith.

xAI’s Brent Mayo touted the investment as “an unprecedented pace” in AI development.

“In Memphis, we’re pioneering development in the heartland of America,” Mayo declared. “We’re not just leading from the front; we’re accelerating progress at an unprecedented pace while ensuring the stability of the grid utilizing megapack technology.”

For his part, Musk retweeted a headline, while jokingly saying the company planned to implement a billion GPUs.