A (Slightly) Mechanistic Theory for Exponentially Increasing AI Time Horizons?
A recent analysis on LessWrong proposes a mechanistic theory for the observed exponential increase in AI time horizons, as depicted in the METR graph. The author argues that the 'time horizon' metric primarily reflects the number of challenging subtasks within a given task, rather than the AI's operational speed. This perspective suggests that longer tasks, which require more distinct requirements, are more likely to expose an AI's limitations, thus influencing the measured 'time horizon'. AI
IMPACT This analysis reframes understanding of AI progress metrics, suggesting task complexity, not just speed, is key to predicting future capabilities.