Optimal timing for superintelligence – Marginal REVOLUTION


There is a new paper by Nick Bostrom with that title:

Developing superintelligence is not like playing Russian roulette; it is more like undergoing risky surgery for a condition that will otherwise prove fatal. We examine optimal timing from a person-affecting stance (and set aside simulation hypotheses and other arcane considerations). Models incorporating safety progress, temporal discounting, quality-of-life differentials, and concave QALY utilities suggest that even high catastrophe probabilities are often worth accepting. Prioritarian weighting further shortens timelines. For many parameter settings, the optimal strategy would involve moving quickly to AGI capability, then pausing briefly before full deployment: swift to harbor, slow to berth. But poorly implemented pauses could do more harm than good.

Via Nabeel.




Source link

  • Related Posts

    México convence con goleada, Brasil avanza como líder y quedan definidos los grupos

    IE 11 no es compatible. Para una experiencia óptima, visite nuestro sitio en otro navegador. SIGUIENTE Las primeras palabras de Memo Ochoa tras su homenaje con México en el Mundial…

    Yukon mine receiver sues Vancouver firm for negligence linked to 2024 collapse

    VANCOUVER — The receiver of a defunct Yukon gold mine that suffered a catastrophic storage site failure in 2024 is suing a Vancouver mining engineering company for its alleged role…

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    Identical triplets we met in 2008 graduate high school

    Identical triplets we met in 2008 graduate high school

    México convence con goleada, Brasil avanza como líder y quedan definidos los grupos

    México convence con goleada, Brasil avanza como líder y quedan definidos los grupos

    Google is finally opening the Play Store to outside payments

    Google is finally opening the Play Store to outside payments

    9 Star Fox beginner tips to keep you flying high

    9 Star Fox beginner tips to keep you flying high

    The Engineers’ Debate: Why The Boeing 787-10 & Airbus A350-900 Have 5 Key Landing Gear Differences

    The Engineers’ Debate: Why The Boeing 787-10 & Airbus A350-900 Have 5 Key Landing Gear Differences

    An It Girl Just Wore the Prettiest It Shoes of Summer 2026

    An It Girl Just Wore the Prettiest It Shoes of Summer 2026