PulseAugur
EN
LIVE 13:15:31

Meta to use custom AMD AI accelerators for recommendation systems

Meta is reportedly planning to utilize custom AMD Instinct MI400 accelerators, based on the MI450 design, for specific workloads, primarily recommendation systems. These custom chips will feature 144GB of HBM4 memory, significantly less than the full MI455X model's 432GB, and will offer reduced compute performance. This specialization aims to drastically lower costs and power consumption for Meta's social media platforms, though it may limit versatility for frontier AI model training and inference, potentially leading Meta to continue relying on NVIDIA hardware for those tasks. AI

IMPACT Specialized hardware for recommendation systems could lower costs for large-scale AI deployments, but may necessitate continued reliance on general-purpose hardware for frontier model training.

RANK_REASON This is a report about a hardware customization for specific workloads by a major tech company, not a direct release from a frontier AI lab.

Read on Tom's Hardware →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Meta to use custom AMD AI accelerators for recommendation systems

COVERAGE [1]

  1. Tom's Hardware TIER_1 English(EN) · Anton Shilov ·

    Meta to use custom AMD Instinct MI400 accelerators with 144GB of HBM4 for select workloads, report claims — could dramatically reduce cost at the expense of versatility

    Meta will reportedly use a custom version of AMD's Instinct MI400-series accelerators with a memory system cut to 144GB of HBM4, allegedly for select workloads only.