Optimal timing for superintelligence – Marginal REVOLUTION


There is a new paper by Nick Bostrom with that title:

Developing superintelligence is not like playing Russian roulette; it is more like undergoing risky surgery for a condition that will otherwise prove fatal. We examine optimal timing from a person-affecting stance (and set aside simulation hypotheses and other arcane considerations). Models incorporating safety progress, temporal discounting, quality-of-life differentials, and concave QALY utilities suggest that even high catastrophe probabilities are often worth accepting. Prioritarian weighting further shortens timelines. For many parameter settings, the optimal strategy would involve moving quickly to AGI capability, then pausing briefly before full deployment: swift to harbor, slow to berth. But poorly implemented pauses could do more harm than good.

Via Nabeel.




Source link

  • Related Posts

    Chloe Kim takes silver, falls short of history

    Hello from Milan and Cortina, where all eyes were on Chloe Kim and her pursuit of a third consecutive gold medal in the women’s halfpipe final. She might’ve won, if…

    Alkane Resources Announces Record Operating & Record Financial Results for Q2 and H1 FY2026

    First Half 2026 Financial Highlights Read More Source link

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    State of Play February 2026: all announcements, trailers 

    State of Play February 2026: all announcements, trailers 

    Wes Streeting: the UK’s next prime minister? – podcast | Wes Streeting

    Wes Streeting: the UK’s next prime minister? – podcast | Wes Streeting

    Manenti: Hopefully the game grows big enough in Italy that we can play full-time

    Chloe Kim takes silver, falls short of history

    Chloe Kim takes silver, falls short of history

    God of War Original Trilogy Remakes Are Coming, and a New 2D Platformer Is Out Today

    God of War Original Trilogy Remakes Are Coming, and a New 2D Platformer Is Out Today

    17 Minimalist Nail Designs Ideas I’d Wear Again and Again

    17 Minimalist Nail Designs Ideas I’d Wear Again and Again