PulseAugur
EN
LIVE 21:55:03

Nvidia AI systems hit $7.8M cost as memory prices surge

Nvidia's next-generation AI systems, particularly those utilizing the Vera Rubin VR200 NVL72 configuration, are projected to cost hyperscalers approximately $7.8 million each. A significant driver of this cost increase is the memory components, which now constitute about 25% of the total system price, amounting to roughly $2 million per unit. This surge in memory expense is attributed to a threefold increase in LPDDR5X memory capacity and the addition of substantial 3D NAND storage, alongside onboard HBM4 memory on the Rubin GPUs. AI

IMPACT Confirms escalating hardware costs as a major constraint for AI infrastructure scaling.

RANK_REASON Reporting on the significant cost increase of AI hardware due to component prices, specifically memory.

Read on Tom's Hardware →

AI-generated summary · Google Gemini · from 2 sources. How we write summaries →

Nvidia AI systems hit $7.8M cost as memory prices surge

COVERAGE [2]

  1. Tom's Hardware TIER_1 English(EN) · Anton Shilov ·

    Nvidia's memory costs soar 485%, latest AI systems now cost $7.8 million to build — memory now comprises 25% of the total cost, Rubin GPUs a mere $50,000 apiece

    As memory content per rack increases in Vera Rubin platform, it now accounts for nearly 25% of its cost.

  2. Mastodon — fosstodon.org TIER_1 English(EN) · [email protected] ·

    Nvidia's memory costs soar 485%, latest AI systems now cost $7.8 million to build — memory now comprises 25% of the total cost, Rubin GPUs a mere $50,000 apiece

    Nvidia's memory costs soar 485%, latest AI systems now cost $7.8 million to build — memory now comprises 25% of the total cost, Rubin GPUs a mere $50,000 apiece As memory content per rack increases in Vera Rubin platform, it now accounts for nearly 25% of its cost. https://www. t…