NVIDIA and AMD AI Workstation: NVIDIA and AMD are launching a new line of workstations equipped with NVIDIA RTX Ada Generation GPUs and AMD Ryzen Threadripper PRO 7000 WX-Series CPUs to enable professionals worldwide to design and operate AI applications directly from their desktops.
These new platforms, which combine the most advanced AI computation, rendering, and simulation capabilities, enable experts to tackle the most resource-intensive, large-scale AI operations locally.
Advanced AI tasks often necessitate data center-level processing power. Training a big language model with a trillion parameters, for example, requires hundreds of GPUs to run for weeks, while research is being conducted to minimize model size and enable model training on smaller systems while retaining high levels of AI model accuracy.
The new NVIDIA RTX GPU and AMD CPU-powered AI workstations deliver the power and speed needed for training such smaller models, as well as local fine-tuning and offloading data center and cloud resources for AI development workloads. Users can choose between single- and multi-GPU systems based on their workloads.
NVIDIA and AMD AI Workstation
Smaller trained AI models also allow for the usage of workstations for local inference. Workstations powered by RTX GPUs and AMD CPUs can be set to run these smaller AI models for inference supporting small workgroups or departments.
These workstations offer a cost-effective method to lessen the computing strain on data centers, with up to 48GB of RAM in a single NVIDIA RTX GPU. When professionals need to scale training and deployment from these workstations to data centers or the cloud, the NVIDIA AI Enterprise software platform allows workflow and toolchain portability.
The RTX 4000 SFF, RTX 4000, RTX 4500, RTX 5000, and RTX 6000 are Ada Generation GPU alternatives. They’re based on NVIDIA’s Ada Lovelace architecture and can support up to 142 third-generation RT Cores, 568 fourth-generation Tensor Cores, and 18,176 latest-generation CUDA cores. New workstations powered by NVIDIA RTX Ada Generation GPUs and the latest AMD Threadripper Pro CPUs will be available from BOXX and HP beginning next month, with additional system integrators following suit soon after.
Also Read:
