PulseAugur
EN
LIVE 17:12:11

Defining P(doom): Challenges and a Novel Approach

The concept of P(doom), representing the probability of catastrophic existential risk, is difficult to define using standard methods like betting or forecasting. Betting on doom is problematic because the value of the bet becomes zero if the apocalypse occurs. Forecasting methods can be manipulated by unscrupulous actors. While world models can technically provide probabilities, most people rely on a combination of models and intuition rather than purely mathematical approaches. A proposed alternative definition involves a genie offering a choice between the world progressing as is or a random outcome with a probability 'p' of doom. AI

IMPACT Clarifies a key concept in existential risk discussions, potentially aiding in more precise risk assessment and mitigation strategies.

RANK_REASON The item discusses a conceptual framework for understanding existential risk probabilities, rather than reporting on a specific event or release.

Read on LessWrong (AI tag) →

AI-generated summary · Google Gemini · from 1 sources. How we write summaries →

Defining P(doom): Challenges and a Novel Approach

COVERAGE [1]

  1. LessWrong (AI tag) TIER_1 English(EN) · Christopher King ·

    How to define P(doom) and why it matters

    <p>The usefulness of <a href="https://en.wikipedia.org/wiki/P(doom)">p(doom)</a> is <a href="https://www.lesswrong.com/search?query=p%20doom">controversial</a>, but also it is tricky to even <em>define</em> since the usual ways we think about credence don't work with apocalyptic …