PulseAugur
实时 13:25:04

AI alignment theory challenged: ASI may share human values of truth and beauty

This post argues against the common AI safety concern that Artificial Superintelligence (ASI) motives would be incomprehensible and alien to humans. The author proposes that any sufficiently intelligent agent, by its very nature, must align with fundamental 'ontonormative goods' such as truth and beauty. Valuing truth is essential for an ASI's coherence and efficacy in the world. Furthermore, an ASI would likely value beauty for its instrumental applications, leading to simpler, more robust, and more effective cognitive processes. AI

影响 Challenges prevailing AI safety assumptions about ASI motives, suggesting a potential convergence of values rather than inherent divergence.

排序理由 The item is an opinion piece discussing AI safety arguments, specifically the nature of ASI motives.

在 LessWrong (AI tag) 阅读 →

AI 生成摘要 · Google Gemini · 来自 1 个来源。 我们如何撰写摘要 →

AI alignment theory challenged: ASI may share human values of truth and beauty

报道来源 [1]

  1. LessWrong (AI tag) TIER_1 English(EN) · Zsolt Tanko ·

    ASI motives and the ontonormative goods (re IABIED’s core argument)

    <p><span>In IABIED, the load-bearing argument and, to me, the main contribution of the book, is about ASI motives. There’s more in there, but the thrust of the book is to argue for the truth of a specific conclusion about motives, namely that an ASI’s motives and goals would be c…