PulseAugur
实时 03:38:37
English(EN) Aligning Language Models with Selective Prediction

新研究通过嘈杂数据和选择性预测解决大语言模型对齐问题

研究人员开发了新的方法来改进大语言模型(LLMs)与人类偏好的对齐,即使在处理嘈杂或不完整的数据集时也是如此。一种方法,无偏直接偏好优化(UDPO),在数学上纠正偏好数据中的失真,以实现无偏训练。另一个框架,选择奖励强化学习(RLSR),专注于选择性预测,通过平衡风险和覆盖范围来提高大语言模型的可靠性。此外,一个基于置信区间的校准框架CIC将不确定性分数转换为风险可控的选择性回答规则,为问答系统中的大语言模型响应提供统计保证。 AI

影响 这些进展旨在通过提高大语言模型处理不完美数据和提供置信度估计的能力,使它们在问答等高风险应用中更加可靠和值得信赖。

排序理由 该集群包含多篇关于大语言模型对齐技术的学术论文。

在 arXiv cs.AI 阅读 →

AI 生成摘要 · Google Gemini · 来自 4 个来源。 我们如何撰写摘要 →

新研究通过嘈杂数据和选择性预测解决大语言模型对齐问题

报道来源 [4]

  1. arXiv cs.AI TIER_1 English(EN) · Jialiang Wang, Xianming Liu, Xiong Zhou, Hui Liu, Haoliang Li ·

    面向含噪声偏好的大型语言模型的无偏对齐

    arXiv:2607.03248v1 Announce Type: cross Abstract: The alignment of large language models with human preferences is commonly achieved through Reinforcement Learning from Human Feedback or Direct Preference Optimization. However, these methods are vulnerable to the significant nois…

  2. arXiv cs.AI TIER_1 English(EN) · Gaoxiang Luo, Yifan Wu, Sinian Zhang, Aryan Deshwal, Ju Sun ·

    语言模型与选择性预测的对齐

    arXiv:2607.03528v1 Announce Type: cross Abstract: Large language models (LLMs) are increasingly deployed as critical decision-making components in high-stakes real-world AI systems, rendering LLM reliability a foremost practical concern. In this paper, we focus on enhancing LLM r…

  3. arXiv cs.CL TIER_1 English(EN) · Sijin Dong, Hiroyuki Shinnou ·

    具有可证明对齐保证的大型语言模型中的不确定性感知弃权

    arXiv:2607.04430v1 Announce Type: new Abstract: Large language models (LLMs) are increasingly deployed in question answering (QA) systems, yet they may generate hallucinated or misaligned responses without reliable confidence estimates. Uncertainty quantification (UQ) offers a na…

  4. arXiv cs.CL TIER_1 English(EN) · Hiroyuki Shinnou ·

    具有可证明对齐保证的大型语言模型中的不确定性感知弃权

    Large language models (LLMs) are increasingly deployed in question answering (QA) systems, yet they may generate hallucinated or misaligned responses without reliable confidence estimates. Uncertainty quantification (UQ) offers a natural basis for selective answering, where a sys…