Nvidia can no longer keep up: Microsoft's AI strategy devours GPUs

Nvidia can no longer keep up: Microsoft’s AI strategy devours GPUs

Although Microsoft has now made access to the AI-supported Bing bot available without a waiting list, the company apparently has problems servicing the resulting sharp increase in demand for the hardware behind it.

Like the US magazine the information reported, Microsoft is now internally restricting access to the server systems used for the new developments based on artificial intelligence in order to keep the capacities free for other types of use. It is said that anyone who works internally on AI technologies at Microsoft must now be put on a waiting list.

Waiting list due to server capacity shortage

Apparently there is a bottleneck in the server hardware behind this, since Microsoft cannot expand the capacities quickly enough. According to other reports, the most important supplier is Nvidia, because the manufacturer supplies graphics cards in bulk, which are installed in Microsoft servers to process the data for the AI ​​systems.

More than 30,000 Nvidia GPUs are currently said to be in use to enable the currently available AI applications from Microsoft. The Redmond company relies on enterprise-grade models such as the Nvidia A100 and H100, which are installed in large numbers. Nevertheless, the capacities should not yet be sufficient to enable perfect availability of the services in the medium term. According to the report, because Microsoft also wants to present new AI functions for Office and its other productivity applications today, the group is trying to prioritize the use of the limited hardware available. One obviously wants to ensure that the announcements about new AI services, which have received a lot of attention, do not suffer from failures or short availability.

Behind all this is the group’s attempt to gain a competitive advantage over the competition with its AI-focused strategy. The launch of the Bing bot as part of a multi-billion dollar cooperation with the start-up company OpenAI, which is developing the underlying technology in the form of GPT-4, caused a “red alert” at Google. So Google is desperately trying to keep up so as not to lose touch.


  • Microsoft has problems with hardware demand.
  • Microsoft restricts internal access to server systems.
  • Bottleneck in server hardware, Nvidia supplies graphics cards in bulk.
  • Microsoft is prioritizing so new AI services don’t suffer from outages.
  • Microsoft tries to gain competitive advantage over competitors.
  • Google is trying to keep up so as not to fall behind.

See also:

Logo, Ki, Artificial Intelligence, Bing, AI, Artificial Intelligence, ChatGPT, OpenAI, Microsoft Bing, Bing Search Engine, GPT, GPT 4.0, GPT-3.5

Leave a Comment

Your email address will not be published. Required fields are marked *