研究人员开发了一种方法来探测用于预测的大型语言模型（LLM）的内部表征，以提高其校准和忠实性。通过在中间激活上训练探测器，他们发现这些探测器比模型自身的思维链推理具有更好的校准效果。探测器还可以充当测谎仪，识别推理痕迹何时未能准确反映证据，并且即使在推理隐藏扰动的情况下也能预测预测变化。该技术将探测内部表征确立为审计和校准LLM预测器的实用工具。 AI
影响 增强了对LLM预测器的审计和校准，有可能提高在关键应用中的可靠性。
排序理由 该集群包含一篇研究论文，详细介绍了一种分析LLM内部表征的新方法。
AI 生成摘要 · Google Gemini · 来自 3 个来源。 我们如何撰写摘要 →
arXiv:2607.08046v1 Announce Type: cross Abstract: Large language models fine-tuned for forecasting can be accurate yet poorly calibrated, and their chain-of-thought (CoT) reasoning may not faithfully reflect the evidence behind a forecast. We ask whether internal representations …
Large language models fine-tuned for forecasting can be accurate yet poorly calibrated, and their chain-of-thought (CoT) reasoning may not faithfully reflect the evidence behind a forecast. We ask whether internal representations offer a more direct window into both. Working with…
Large language models fine-tuned for forecasting can be accurate yet poorly calibrated, and their chain-of-thought (CoT) reasoning may not faithfully reflect the evidence behind a forecast. We ask whether internal representations offer a more direct window into both. Working with…