Oracle and AMD have teamed up to make AMD Instinct MI355X GPUs available on Oracle Cloud Infrastructure (OCI) to give customers more choice and better price performance for large-scale AI training and inference workloads compared to the previous generation.
Oracle will offer zettascale AI clusters accelerated by the latest AMD Instinct processors with up to 131,072 MI355X GPUs to enable customers to build, train, and inference AI at scale.
“To support customers that are running the most demanding AI workloads in the cloud, we are dedicated to providing the broadest AI infrastructure offerings,” said Oracle Cloud Infrastructure VP Mahesh Thiagarajan. “AMD Instinct GPUs, paired with OCI’s performance, advanced networking, flexibility, security, and scale, will help our customers meet their inference and training needs for AI workloads and new agentic applications.”
To support new AI applications that require larger and more complex datasets, customers need AI computing solutions that are specifically designed for large-scale AI training. The zettascale OCI Supercluster with AMD Instinct MI355X GPUs meets this need by providing a high-throughput, ultra-low latency RDMA cluster network architecture for up to 131,072 MI355X GPUs. AMD Instinct MI355X delivers nearly triple the computing power and a 50% increase in high-bandwidth memory than the previous generation.
“AMD and Oracle have a shared history of providing customers with open solutions to accommodate high performance, efficiency, and greater system design flexibility,” said AMD’s Forrest Norrod. “The latest generation of AMD Instinct GPUs and Pollara NICs on OCI will help support new use cases in inference, fine-tuning, and training, offering more choice to customers as AI adoption grows.”
AMD Instinct MI355X-powered shapes are designed with superior value, cloud flexibility, and open-source compatibility, making them suitable for customers running large language models and AI workloads. With AMD Instinct MI355X on OCI, customers will be able to benefit from:
