Nvidia's memory costs soar 485%, latest AI systems now cost $7.8 million to build — memory now comprises 25% of the total cost, Rubin GPUs a mere $50,000 apiece
Nvidia's next-generation AI systems, particularly those utilizing the Vera Rubin VR200 NVL72 configuration, are projected to cost hyperscalers approximately $7.8 million each. A significant driver of this cost increase is the memory components, which now constitute about 25% of the total system price, amounting to roughly $2 million per unit. This surge in memory expense is attributed to a threefold increase in LPDDR5X memory capacity and the addition of substantial 3D NAND storage, alongside onboard HBM4 memory on the Rubin GPUs. AI
IMPACT Confirms escalating hardware costs as a major constraint for AI infrastructure scaling.