Skip to content

Microsoft's Next-Gen AI Accelerator Maia to Challenge Nvidia and AMD

Microsoft's new Maia AI accelerator promises better performance. The tech giant is also developing its own CPU, joining Google and Amazon in the trend towards in-house silicon solutions.

In the image there are few people, the first two men were wearing Microsoft id cards.
In the image there are few people, the first two men were wearing Microsoft id cards.

Microsoft's Next-Gen AI Accelerator Maia to Challenge Nvidia and AMD

Microsoft has been exploring in-house silicon solutions to reduce its reliance on external suppliers for AI workloads in its Azure data centers. The tech giant revealed its first AI accelerator, Maia, in late 2023, aiming to shift the majority of its AI tasks from traditional GPUs to its own chips.

Microsoft's journey into homegrown AI accelerators began in 2023 with the introduction of Maia. However, the initial Maia 100 model did not match the performance of competing GPUs from Nvidia and AMD. Undeterred, Microsoft is working on a second-generation Maia accelerator, set to be released next year.

Microsoft's CTO, Kevin Scott, has stated that the company's focus is on achieving the best performance per dollar for AI workloads. In addition to Maia, Microsoft is also developing its own CPU, codenamed Cobalt, and platform security silicon for cryptography and key exchanges. Google and Amazon have already deployed tens of thousands of their own AI accelerators for in-house workloads, demonstrating the trend towards in-house silicon solutions in the tech industry.

Microsoft's pursuit of homegrown AI accelerators and CPUs signals a strategic shift in the tech giant's approach to datacenter workloads. While the first Maia model fell short of competing GPUs, Microsoft remains committed to its goal of using mainly its own chips in Azure data centers, with the next-generation Maia accelerator expected to improve upon its predecessor's performance.

Read also:

Latest