Does AI assistance enhance or erode expertise?


From a new NBER working paper:

Whether AI assistance builds or erodes professional expertise is unsettled. In a pre-registered three-month randomized controlled trial, we gave 133 practicing patent lawyers at eleven U.S. intellectual property law firms access to a custom AI drafting assistant and measured both their performance while using AI and their professional judgment afterward without it. All work was scored by blinded expert patent attorneys. Paralleling findings from other white-collar domains, AI access raised the quality of work delivered on benchmark patent drafting tasks at 10 days (0.34 SD, p = 0.03) and 90 days (0.38 SD, p = 0.01), with larger gains among junior lawyers. After three months, all subjects redlined an existing patent application without AI, a core task of patent practice requiring expert judgment. Treated lawyers outperformed controls by 0.32 SD (p = 0.04), but this advantage was concentrated entirely among senior lawyers (0.45 SD, p = 0.02). Junior lawyers showed no average gain; their scores instead bifurcated, with sharply fewer mediocre scores offset by more poor and more good ones. The largest gains from AI thus accrued to the lawyers who retained the least. Foundational expertise may be a prerequisite for extracting durable skill from AI-assisted practice.

That is by David Autor, et.al.  Do note that over time the allocation of humans to tasks will evolve so that more of the humans become more productive, not less.  RCTs somehow have the odd disadvantage of requiring too many things to be held constant, and so they can miss the benefits of longer-term adjustments.




Source link

  • Related Posts

    Asian shares are mixed and OpenAI investor SoftBank shares plunge after calls to slow AI industry

    HONG KONG (AP) — Asian shares were mixed Monday, as shares of Japanese investment conglomerate SoftBank Group, a key investor in OpenAI, fell more than 10% following calls from Anthropic…

    Continue reading
    Focused Support Launches Cavok STRIKE to Expand Link-16 Participation Across the Joint Force

    Modern battlefields have increasing numbers of unmanned systems, sensors, and supporting platforms operating throughout the joint battlespace. The rapid proliferation of Group 1, 2, and 3 UAS, including both expendable…

    Continue reading

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    The weird, wonderful world of Miles Buckle, Instagram’s parallel universe of video games

    The weird, wonderful world of Miles Buckle, Instagram’s parallel universe of video games

    9 Expensive-Looking Autumn H&M Buys Selling Out Fast

    9 Expensive-Looking Autumn H&M Buys Selling Out Fast

    Asian shares are mixed and OpenAI investor SoftBank shares plunge after calls to slow AI industry

    Asian shares are mixed and OpenAI investor SoftBank shares plunge after calls to slow AI industry

    New warnings about the risks of AI to humanity revive a long-running debate

    New warnings about the risks of AI to humanity revive a long-running debate

    Jalen Hurts proves he can adapt while Eagles OC Sean Mannion establishes proof of concept in win over Commanders

    Jalen Hurts proves he can adapt while Eagles OC Sean Mannion establishes proof of concept in win over Commanders

    Focused Support Launches Cavok STRIKE to Expand Link-16 Participation Across the Joint Force