PulseAugur
实时 04:51:19

Reasoning LLMs show distinct internal trajectories beyond generation length

Researchers have developed a method to analyze the internal trajectories of reasoning-trained language models, distinguishing between simply taking more steps and following different computational paths. By adjusting for generation length, they found that model difficulty correlates with corrected trajectory geometry, particularly in coding tasks where harder problems show more direct paths in reasoning models compared to standard instruction-tuned models. This distinction was also observed, though less pronounced, in mathematics and Boolean satisfiability problems, suggesting reasoning training can indeed alter a model's internal processing distinct from mere length. AI

影响 Provides a new method to analyze LLM reasoning, potentially leading to better model interpretability and targeted training improvements.

排序理由 The cluster contains an academic paper detailing a new research methodology for analyzing LLM behavior.

在 arXiv cs.CL 阅读 →

AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →

Reasoning LLMs show distinct internal trajectories beyond generation length

报道来源 [2]

  1. arXiv cs.CL TIER_1 English(EN) · Sanmi Koyejo ·

    Reasoning Models Don't Just Think Longer, They Move Differently

    Reasoning-trained language models often spend more tokens on harder problems, but longer chains of thought do not show whether a model is merely computing for more steps or following a different internal trajectory. We study this distinction through hidden-state trajectories duri…

  2. arXiv stat.ML TIER_1 English(EN) · Anders Gj{\o}lbye, Lars Kai Hansen, Sanmi Koyejo ·

    Reasoning Models Don't Just Think Longer, They Move Differently

    arXiv:2605.15454v1 Announce Type: cross Abstract: Reasoning-trained language models often spend more tokens on harder problems, but longer chains of thought do not show whether a model is merely computing for more steps or following a different internal trajectory. We study this …