Microsoft took the wraps off the third-generation of its in-house AI chip, as part of a plan to reduce its reliance on buying processors from Nvidia.

The Maia 300 chip will be used for the tech giant’s multi-gigawatt deployments in 2027, making it the primary inference system for Microsoft products and services. Reuters reported it plans to potentially deploy more than 1 million of the chips next year.

According to a blog post from EVP Scott Guthrie, the company expects Maia 300 to deliver 40% more tokens per megawatt compared to leading GPU-based systems without naming Nvidia.

The Maia 300 is built as a single system, with software, silicon, physical rack infrastructure, networking, and data centres co-designed to operate as a single platform.

Guthrie noted a 96-chip rack offers seven times the rack-scale token throughput of Microsoft’s Maia 200. He said the new chip is “designed with an inference-first architecture optimized for long-context, memory-intensive and decode-heavy AI workloads”.

The Maia 200 chip powers the company’s production workloads, including Microsoft 365 Copilot, as well as OpenAI models running on Microsoft’s Azure cloud computing service.

The post Microsoft unveils Maia 300 custom AI chip appeared first on Mobile World Live.

Sie macht nicht so viele Schlagzeilen, wie der Krieg selbst, aber die Hightech-Front ist nicht weniger wichtig als die Front. Beim Quincy Institute for Responsible Statecraft ist darüber ein interessanter Artikel erschienen, den ich übersetzt habe, weil er mich nachdenklich gemacht hat. Beginn der Übersetzung: Sie tragen keine Uniform, aber diese US-Unternehmen kämpfen für die […]

As the controversy over AI safety grows, another debate is emerging. Bill Gates, the founder of Microsoft, has said that artificial intelligence should pay taxes to compensate for the jobs that will be destroyed by the deployment of this technology.

Seguir leyendo

© EvgeniyShkolenko (Getty Images)