Project Stargate

The project Stargate wouldn't directly bring innovation to large language models. It will be the World’s Largest AI Supercomputer with a cost of $100 Billion.

It seems that Microsoft would finance the "AI powerhouse" called the Stargate ,that could cost 100 times more than some of the biggest data and would only come around by the year 2028.

Stargate is designed for general-purpose AI research, not specifically for training large language models. It would be used to tackle complex problems across various AI fields.

However, Stargate's advancements in AI research could indirectly benefit large language models. The faster AI research progresses, the sooner techniques and knowledge might be adapted to improve large language models in areas like:

More nuanced understanding of language

Enhanced reasoning and problem-solving abilities

Ability to generate more creative and informative text formats

With that, Microsoft and OpenAI plan on deploying the system over the next six years, which means that Stargate can potentially be operational by 2028. The project will be divided into phases, with Stargate being a phase 5 system.

The supercomputer plan is currently in the middle of the third phase with Stargate being part of the fifth and final phase. A significant part of the cost for the upcoming phases will come from acquiring AI chips.

A report says, OpenAI's CEO Sam Altman plans to raise $7 trillion for his AI ambitions, which might turn out to be viable, considering the fact we are just at the beginning of the AI era, and advancing into the future would require a robust infrastructure, which would need vast financial resources.

The idea is currently in its planning stages; it is rumored that the data center could also be nuclear-powered, given that such a large-scale project with several gigawatts of power consumption can't be powered through conventional methods.

It is a metaphorical way to think of it: Imagine a vast library of knowledge about AI. Project Stargate is like building a giant new wing on the library, filled with advanced research materials. All it seems, the overall expansion of knowledge in the library could eventually lead to the discovery of new information that benefits in the future.