The tech giant won’t be putting its new chips on the market but will instead use them to power the AI capabilities of its subscription software services and Azure cloud computing.
ADVERTISEMENTMicrosoft announced on Wednesday a duo of custom-designed computing chips, joining other big tech firms that are bringing core technologies in house to offset the high cost of delivering artificial intelligence (AI) services.
Microsoft indicated that it does not plan to sell the chips but will instead use them to power its own subscription software offerings and as part of its Azure cloud computing service.
During its Ignite developer conference in Seattle, Microsoft introduced a new chip, called Maia, to speed up AI computing tasks and provide a foundation for its $30-a-month (€28) "Copilot" service for business software users, as well as for developers who want to make custom AI services
The Maia chip was designed to run large language models, a type of AI software that underpins Microsoft's Azure OpenAI service and is a product of Microsoft's collaboration with ChatGPT creator, OpenAI.
Microsoft and other tech giants like Alphabet are grappling with the high costs of delivering AI services, which can be 10 times greater than traditional services such as search engines.
Microsoft executives have said they plan to tackle those costs by routing nearly all of the company's sprawling efforts to include AI in its products through a common set of foundational AI models. The Maia chip, they said, is optimised for that work.
"We think this gives us a way that we can provide better solutions to our customers that are faster and lower cost and higher quality," said Scott Guthrie, the executive vice president of Microsoft's cloud and AI group.
Microsoft also said that next year it will offer its Azure customers cloud services that run on the newest flagship chips from Nvidia and Advanced Micro Devices.
"This is not something that's displacing Nvidia," said Ben Bajarin, chief executive of analyst firm Creative Strategies.
He said the Maia chip would allow Microsoft to sell AI services in the cloud until personal computers and phones are powerful enough to handle them.
"Microsoft has a very different kind of core opportunity here because they're making a lot of money per user for the services," Bajarin said.
Microsoft's second chip is designed to be both an internal cost saver and an answer to Microsoft's chief cloud rival, Amazon Web Services.
Named Cobalt, the new chip is a central processing unit (CPU) made with technology from Arm Holdings. Microsoft disclosed on Wednesday that it has already been testing Cobalt to power Teams, its business messaging tool.
But Microsoft's Guthrie said his company also wants to sell direct access to Cobalt to compete with the "Graviton" series of in-house chips offered by Amazon.
"We are designing our Cobalt solution to ensure that we are very competitive both in terms of performance as well as price-to-performance (compared with Amazon's chips)," Guthrie said.
Microsoft gave few technical details that would enable comparisons on the chips' competitiveness versus those of traditional chipmakers. Rani Borkar, corporate vice president for Azure hardware systems and infrastructure, said both are made with 5-nanometre manufacturing technology from Taiwan Semiconductor Manufacturing Co..
He added that the Maia chip would be strung together with standard Ethernet network cabling, rather than a more expensive custom Nvidia networking technology that Microsoft used in the supercomputers it built for OpenAI.
"You will see us going a lot more the standardisation route," Borkar said.
