AMD has introduced the Instinct MI350P, a new PCIe AI accelerator card featuring 144GB of HBM3E memory. This card is designed as a direct upgrade for air-cooled servers and claims to offer a significant performance advantage over Nvidia's H200 NVL, particularly in FP16 and FP8 computations. Built on AMD's CDNA4 architecture, the MI350P supports lower-precision formats to accelerate large language models and is positioned for inference and RAG workloads. AI
IMPACT AMD's new MI350P card intensifies competition in the AI accelerator market, potentially offering enterprises a faster alternative for inference and RAG tasks.
RANK_REASON Launch of a new AI accelerator card by a major hardware vendor, directly competing with established offerings.
AI-generated summary · Google Gemini · from 4 sources. How we write summaries →