24 C

Microsoft unveils its latest NVIDIA H100 powered Virtual Machines to support AI workloads

Microsoft has released information about its latest virtual machine (VM) designed for artificial intelligence workloads, as the company continues to develop and release AI products following a significant investment in OpenAI, the company behind ChatGPT.

In a blog post, Microsoft emphasised the critical role its GPU-accelerated VMs play in laying the groundwork for many generative AI advancements, both in-house and from other companies, including its own Azure OpenAI Service, which puts AI writers such as GPT-3.5, Codex, and DALL-E 2 in the hands of its customers.

Microsoft promises “significantly faster performance” with its new ND H100 v5 virtual machine when compared to previous-generation ND A100 v4 virtual machines.

Microsoft has deployed GPUs for inferencing throughout the company’s global Azure datacenter footprint, including this one in Washington state. Photo courtesy of Microsoft.

The updated VM makes use of eight NVIDIA H100 Tensor Core GPUs, with the ability to scale up to thousands. It also houses 4th Generation Intel Xeon Scalable processors and 16 channels of DDR5 DIMMs at 4800 MHz.

With this move, Microsoft hopes to bring some of the most cutting-edge, high-performance technology to AI startups, many of which will be comparing their own success stories to OpenAI’s recent success.

- Advertisement -TechnoSports-Ad

As the world strives to make artificial intelligence as reliable and accurate as possible, the ND H100 v5 VMs will need to be able to handle large amounts of training for extended periods of time. The new H100-powered VMs are now available for testing as the tech giant prepares to make them a standard offering in the Azure portfolio.

Also Read:

NVIDIA GeForce RTX 4070 to be launched on 13th April

- Advertisement -TechnoSports-Ad

Apple A17 Bionic Prototype performance numbers leaks out



Please enter your comment!
Please enter your name here

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Nivedita Bangari
Nivedita Bangari
I am a software engineer by profession and technology is my love, learning and playing with new technologies is my passion.



Related Stories

More from author

Best RTX 4070 Gaming Laptops in India as of 2024

The top-performing RTX 4070 Gaming Laptops available in India in 2024 are equipped with highly capable CPUs, graphics cards, and memory. These laptops not...

HBO Max in India: Here’s how you can watch the service using VPN (February 26)

HBO Max in India might launch soon but still, we cannot deny that we want to enjoy our favourite HBO shows as soon as...

Top 10 IT Companies in World: Leading IT companies in the World (February 26)

Top 10 IT company in world: Over the last two years, there has been an increase in IT expenditure, which has resulted in the...

How To Enable Flags on Google Chrome in 2024?

How To Enable Flags on Google Chrome: The Ultimate Guide Google Chrome flags are experimental features and tools in Chrome and other software that...