AMD Unveils MI325X GPU and Roadmap for AI Dominance

AMD Unveils MI325X GPU, challenges NVIDIA's Dominance

June 3, 2024 – At Computex 2024, AMD CEO Dr. Lisa Su took the stage to unveil the company's latest AI hardware and an ambitious roadmap aimed at dethroning NVIDIA's dominance in the accelerator market. The star of the show was the new AMD Instinct MI325X GPU, boasting an unprecedented 288GB of cutting-edge HBM3e memory and a staggering 6TB/s of memory bandwidth.

The MI325X is a mid-generation upgrade to AMD's current MI300 series accelerators, designed to extend the company's performance leadership in generative AI workloads. While retaining the same CDNA 3 architecture as its predecessor, the MI300X, the MI325X swaps out the HBM3 memory for the latest and greatest HBM3e.  

This memory upgrade enables the MI325X to double the memory capacity of NVIDIA's recently announced H200 GPU, packing a whopping 288GB of ultra-fast HBM3e memory. AMD claims this massive memory pool, combined with the 6TB/s of memory bandwidth, will allow a single 8-way MI325X system to handle trillion-parameter large language models (LLMs) with ease.

“The insatiable demand for more memory and bandwidth in AI workloads is driving our roadmap,” said Dr. Su. “With the MI325X, we're delivering industry-leading memory capacity and bandwidth to stay ahead of the competition.”                                                            

While AMD hasn't disclosed the MI325X's power consumption, the company confirmed it will use the same 8-way OAM universal baseboard design as the MI300 series, suggesting a similar 750W TDP per GPU. The MI325X is slated for availability in Q4 2024.

Alongside the MI325X, AMD laid out its multi-generational accelerator roadmap, showcasing the company's plans to deliver performance and memory leadership on an annual cadence for generative AI workloads. 

The next major milestone is the CDNA 4 architecture, expected to power the AMD Instinct MI350 series in 2025. Built on an advanced 3nm process node, likely TSMC's N3, CDNA 4 will bring native support for lower-precision FP4 and FP6 data formats, providing a significant boost to compute throughput and reduced memory pressure. 

AMD projects that a theoretical 8-way MI350 cluster will deliver up to 35x better AI inference performance compared to an 8-way MI300X configuration when running a 1.8 trillion parameter GPT model. This performance leap is attributed to the architectural improvements in CDNA 4, as well as the expanded use of chiplets overall. 

AMD CEO Dr. Lisa Su Unveils MI325X GPU
AMD CEO Dr. Lisa Su

Beyond CDNA 4, AMD revealed plans for a further CDNA architecture, dubbed “CDNA Next,” which will power the MI400 series accelerators slated for 2026. While details on CDNA Next are scarce, AMD promises it will bring “the latest features and capabilities that will help unlock additional performance and efficiency for inference and large-scale AI training.”

AMD's aggressive AI roadmap is backed by strong ecosystem support and growing customer adoption. During the keynote, Microsoft CEO Satya Nadella highlighted the company's deep partnership with AMD, using Instinct MI300X accelerators to power Azure OpenAI services and the new Azure ND MI300X V5 virtual machines.               

 Other major AMD partners showcasing Instinct-powered solutions included Dell Technologies with the PowerEdge XE9680, Supermicro, Lenovo with the ThinkSystem SR685a V3, and HPE's Cray XD675.

“We are in the midst of a massive AI platform shift, with the promise to transform how we live and work,” said Nadella. “That's why our deep partnership with AMD is so important to us.”

AMD's ambitious AI roadmap and the MI325X unveiling are clear shots across the bow at NVIDIA, the current leader in the accelerator market. With both companies now committed to annual product refreshes, the race for AI supremacy is heating up rapidly.

While NVIDIA still holds a commanding lead, AMD's focus on memory capacity and bandwidth could give it a crucial edge in the rapidly growing field of large language model inference. As Dr. Su stated, “The insatiable demand for more memory and bandwidth in AI workloads is driving our roadmap.”                                                 

As the AI revolution continues to gather steam, all eyes will be on AMD and NVIDIA as they battle for supremacy in this critical market segment. The winner could shape the future of artificial intelligence for years to come.

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Trending AI Tools

Your Ultimate AI Document Assistant From Ideas to Slides in Seconds Explore search engine integration, PDF reading, Powerpoint generation & more!

Illusion Diffusion AI

Free to Use AI - Illusion Diffusion Web AI-Powered Optical Illusions at Your Fingertips Elevate Your Visual Content with AI Magic



Your Intelligent Chat Companion Unleash the Power of Language using ChatUp AI Transforming Communication with Advanced AI


Streamline Your Sales with AI-Powered Automation Boost Sales Productivity with BlinkGPT Technology Turn Prospects into Clients with Ease

Swapper AI

Try Before You Buy with AI Magic Elevate Your E-Commerce Fashion Game Experience the Future of Online Fashion

Tingo AI
4172 - EU AI Act Webinar - 2.jpg banner
© Copyright 2023 - 2024 | Become an AI Pro | Made with ♥