Google DeepMind launches institute to widen the AGI debate


Google and Google DeepMind researchers launched the DeepMind Institute on Wednesday to advance the conversation around artificial general intelligence (AGI). The institute lists DeepMind co-founder Shane Legg, Google executive James Manyika, and Google DeepMind chair Demis Hassabis as directors, with Legg serving as managing editor. 

The new institute aims to surface differing views between Google, Google DeepMind, and the broader global research community around AGI. “They will not always agree, and they will likely change their minds, as more data and information comes to light at the fast-moving frontier,” the announcement read.

The inaugural collection of four essays covers a range of topics: economic policies for managing potential AGI disruption, preserving human-readable model reasoning, principles for human flourishing, and a framework for evaluating frontier AI models. 

One essay, by DeepMind safety researchers Rohin Shah and Anca Dragan, argues that AI’s shrinking window of transparency — the ability to see and check a model’s step-by-step reasoning — is not inevitable. As new architectures make the most powerful models harder to monitor, the authors say developers and regulators should confront the safety trade-offs directly. That could mean limiting “opaque serial depth”— the amount of sequential computation a model can perform without producing a readable reasoning trace — or requiring developers to demonstrate that less transparent systems remain just as monitorable.

In another essay, Hassabis proposes a U.S.-led frontier AI standards body to evaluate the most advanced AI models. Under his framework, developers would initially submit models voluntarily for review up to 30 days before release. Once the evaluation system has proved effective, passing its tests could become a requirement for deploying frontier models in the United States.

The body would at first design assessments in consultation with AI companies but would eventually develop independent, undisclosed evaluations — what the essay calls “held-out” tests — to prevent labs from tailoring their models to known evaluations. Hassabis said the framework could be “ratcheted up if the seriousness of the situation demands,” potentially including a coordinated slowdown among frontier AI developers. 

The essays arrive as the industry’s safety debate shifts from broad statements of concern toward concrete proposals for disclosure, outside scrutiny, and, if safeguards fall behind, coordinated slowdowns. That shift accelerated this week as industry leaders endorsed elements of Anthropic CEO Dario Amodei’s call to “pace” frontier AI development.

When you purchase through links in our articles, we may earn a small commission. This doesn’t affect our editorial independence.



Source link

  • Related Posts

    The EU Wants to Break Up Kids and Their Chatbots

    The EU plans to ban chatbots from simulating emotions or interpersonal relationships in interactions with anyone under the age of 18 as the bloc tries to stop children from developing…

    Continue reading
    Amazon-owned Zoox’s 100-robotaxi limit in Nevada is about to disappear

    A regulatory cap limiting Zoox to 100 robotaxis in Nevada is set to expire this month, clearing the way for the Amazon-owned company to expand its commercial fleet of custom-built…

    Continue reading

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    Russia’s wartime economy faces long-term erosion from debt and military spending

    Russia’s wartime economy faces long-term erosion from debt and military spending

    Farmer who voted for Trump talks about impact of high costs of Iran war, tariffs: “We’re all just in survival mode”

    Farmer who voted for Trump talks about impact of high costs of Iran war, tariffs: “We’re all just in survival mode”

    The EU Wants to Break Up Kids and Their Chatbots

    The EU Wants to Break Up Kids and Their Chatbots

    Mets’ Jared Young carted off field after colliding with Nolan McLean during play at first base

    Mets’ Jared Young carted off field after colliding with Nolan McLean during play at first base

    Qantas Ends This 16-Hour Nonstop Airbus A380 Route In 1 Month: See Affected Flights Now

    Qantas Ends This 16-Hour Nonstop Airbus A380 Route In 1 Month: See Affected Flights Now

    B.C. mayors, councillors push for ‘contract’ with provincial government to address public safety

    B.C. mayors, councillors push for ‘contract’ with provincial government to address public safety