How Much Progress Has There Been in NVIDIA Datacenter GPUs?
A recent paper analyzes the progress of NVIDIA datacenter GPUs from the mid-2000s to 2025, focusing on their impact on AI research and global competition. The study found that while compute performance for dense operations doubles roughly every 1.5 years, memory and bandwidth grow slower, and price and power consumption increase at a much more gradual pace. The research also indicates that NVIDIA's performance lead over competitors is shrinking, and quantifies the potential impact of US export control regulations on AI chip accessibility. AI
IMPACT Quantifies compute progress and export control impacts, informing hardware strategy for AI development.