AMD (NASDAQ: AMD) announced today that Oracle Cloud Infrastructure (OCI) has selected AMD Instinct™ MI300X accelerators, paired with ROCm™ open software, to drive its newest OCI Compute Supercluster instance, the BM.GPU.MI300X.8.
AMD Instinct MI300X Accelerators Available on Oracle Cloud Infrastructure for Demanding AI Applications
Designed for demanding AI tasks like large language model (LLM) training and inference, the supercluster supports up to 16,384 GPUs in a single cluster, using OCI’s ultrafast network fabric technology. This powerful infrastructure is already enabling companies like Fireworks AI to scale their AI operations.
“AMD Instinct MI300X and ROCm open software continue to prove themselves as leading solutions for AI workloads,” said Andrew Dieckmann, corporate VP and general manager of AMD’s Data Center GPU Business. As AI adoption grows, this combination provides OCI customers with unmatched performance and flexibility.
Donald Lu, senior VP of software development at Oracle Cloud Infrastructure, emphasized that the MI300X accelerators eliminate the overhead of virtualized computing, offering a cost-effective solution for companies looking to accelerate AI workloads.
Optimized for AI Training and Inference
The AMD Instinct MI300X has been extensively tested, proving its capability to handle latency-sensitive AI inference and large-batch training workloads. Companies like Fireworks AI, which deploys generative AI systems, are already leveraging the MI300X’s memory capacity and performance to scale their models and serve diverse industries.
