Optimal timing for superintelligence – Marginal REVOLUTION


There is a new paper by Nick Bostrom with that title:

Developing superintelligence is not like playing Russian roulette; it is more like undergoing risky surgery for a condition that will otherwise prove fatal. We examine optimal timing from a person-affecting stance (and set aside simulation hypotheses and other arcane considerations). Models incorporating safety progress, temporal discounting, quality-of-life differentials, and concave QALY utilities suggest that even high catastrophe probabilities are often worth accepting. Prioritarian weighting further shortens timelines. For many parameter settings, the optimal strategy would involve moving quickly to AGI capability, then pausing briefly before full deployment: swift to harbor, slow to berth. But poorly implemented pauses could do more harm than good.

Via Nabeel.




Source link

  • Related Posts

    Las primeras palabras de Memo Ochoa tras su homenaje con México en el Mundial

    IE 11 no es compatible. Para una experiencia óptima, visite nuestro sitio en otro navegador. SIGUIENTE Brasil golea a Escocia y México firma una fase de grupos histórica 07:57 Gilberto…

    BOJ Sees AI Export Boom Cushioning Economy From Oil Price Shock

    (Bloomberg) — The Bank of Japan is increasingly highlighting the economic benefits of the global artificial intelligence boom, viewing strong demand for AI-related products as a buffer against the drag…

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    Las primeras palabras de Memo Ochoa tras su homenaje con México en el Mundial

    Las primeras palabras de Memo Ochoa tras su homenaje con México en el Mundial

    Messi vs. Ronaldo: The Football Rivalry Written in the Stars

    Messi vs. Ronaldo: The Football Rivalry Written in the Stars

    The Takeoff Secret Most Passengers Never Notice

    The Takeoff Secret Most Passengers Never Notice

    7 Bamboo Pajamas For Women (2026)

    7 Bamboo Pajamas For Women (2026)

    Thursday briefing: Why EU​-Taliban talks have sparked outrage among Afghan women ​ | Taliban

    Thursday briefing: Why EU​-Taliban talks have sparked outrage among Afghan women ​ | Taliban

    BOJ Sees AI Export Boom Cushioning Economy From Oil Price Shock