Optimal timing for superintelligence – Marginal REVOLUTION


There is a new paper by Nick Bostrom with that title:

Developing superintelligence is not like playing Russian roulette; it is more like undergoing risky surgery for a condition that will otherwise prove fatal. We examine optimal timing from a person-affecting stance (and set aside simulation hypotheses and other arcane considerations). Models incorporating safety progress, temporal discounting, quality-of-life differentials, and concave QALY utilities suggest that even high catastrophe probabilities are often worth accepting. Prioritarian weighting further shortens timelines. For many parameter settings, the optimal strategy would involve moving quickly to AGI capability, then pausing briefly before full deployment: swift to harbor, slow to berth. But poorly implemented pauses could do more harm than good.

Via Nabeel.




Source link

  • Related Posts

    El Mundial une culturas con una fiesta de colores y pasión

    IE 11 no es compatible. Para una experiencia óptima, visite nuestro sitio en otro navegador. SIGUIENTE México perfecto, Brasil lidera y Marruecos remonta en la tercera fecha del Mundial 04:07…

    dynaCERT Announces Closing of $5M Non-Brokered Private Placement

    TORONTO — dynaCERT Inc. (TSX: DYA) (OTCQB: DYFSF) (FRA: DMJ) (“dynaCERT” or the “Company”) is pleased to announce the closing of its previously announced non-brokered offering of convertible unsecured units…

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    2026 NBA Draft snubs: Milos Uzan, Kylan Boswell and Nick Boyd among notable college players not selected

    2026 NBA Draft snubs: Milos Uzan, Kylan Boswell and Nick Boyd among notable college players not selected

    NATO’s Leader Makes His Case to Trump for Preserving the Alliance

    NATO’s Leader Makes His Case to Trump for Preserving the Alliance

    El Mundial une culturas con una fiesta de colores y pasión

    El Mundial une culturas con una fiesta de colores y pasión

    97 Prime Day Deals on Gear We Stand By, Up To 50% Off (2026)

    97 Prime Day Deals on Gear We Stand By, Up To 50% Off (2026)

    Chuck Tingle’s latest butt-centric work of erotic fiction is about Warhammer 40,000 of all things

    Chuck Tingle’s latest butt-centric work of erotic fiction is about Warhammer 40,000 of all things

    Venezuela rocked by 7.5, 7.2 earthquakes: What happened and what we know | Earthquakes News

    Venezuela rocked by 7.5, 7.2 earthquakes: What happened and what we know | Earthquakes News