PulseAugur
实时 22:21:10
Nederlands(NL) Endogenous Alignment

人工智能对齐可能模仿人类从外部控制到内部控制的发展

本文探讨了内源性对齐的概念,将人类发展与潜在的人工智能对齐策略进行类比。文章提出,人类在童年时期从外部的“外源性”对齐方法(奖惩)过渡到成年后的内部“内源性”对齐,这种转变是由恐惧、羞耻和内疚等情绪驱动的。作者质疑人工智能是否能实现类似的内源性对齐形式,并指出当前的RLHF和SFT等方法主要是外源性的,而人工智能缺乏驱动人类自我纠正的内在动机。 AI

影响 探索了人工智能对齐的新理论框架,可能影响人工智能安全领域未来的研究方向。

排序理由 该集群讨论了人工智能对齐的理论概念,并将其与人类发展进行类比,以研究论文的形式呈现。

在 Alignment Forum 阅读 →

AI 生成摘要 · Google Gemini · 来自 2 个来源。 我们如何撰写摘要 →

人工智能对齐可能模仿人类从外部控制到内部控制的发展

报道来源 [2]

  1. Alignment Forum TIER_1 Nederlands(NL) · Gordon Seidoh Worley ·

    Endogenous Alignment

    <p><span>Starting when children are fairly young, usually around 1 year of age, we adults begin the work of aligning them to our values. We teach them to say “please”, not to hit, to ask for what they want instead of screaming, and much else. We do this primarily via exogenous me…

  2. LessWrong (AI tag) TIER_1 Nederlands(NL) · Gordon Seidoh Worley ·

    Endogenous Alignment

    <p><span>Starting when children are fairly young, usually around 1 year of age, we adults begin the work of aligning them to our values. We teach them to say “please”, not to hit, to ask for what they want instead of screaming, and much else. We do this primarily via exogenous me…