GPT as a Measurement Tool


We present the GABRIEL software package, which uses GPT to quantify attributes in qualitative data (e.g. how “pro innovation” a speech is). GPT is evaluated on classification and attribute rating performance against 1000+ human annotated tasks across a range of topics and data. We find that GPT as a measurement tool is accurate across domains and generally indistinguishable from human evaluators. Our evidence indicates that labeling results do not depend on the exact prompting strategy used, and that GPT is not relying on training data contamination or inferring attributes from other attributes. We showcase the possibilities of GABRIEL by quantifying novel and granular trends in Congressional remarks, social media toxicity, and county-level school curricula. We then apply GABRIEL to study the history of tech adoption, using it to assemble a novel dataset of 37,000 technologies. Our analysis documents a tenfold decline of time lags from invention to adoption over the industrial age, from ~50 years to ~5 years today. We quantify the increasing dominance of companies and the U.S. in innovation, alongside characteristics that explain whether a technology will be adopted slowly or speedily.

That is from a new NBER working paper by .




Source link

  • Related Posts

    Canadian dollar to reclaim the U.S. 75-cent mark by year-end, analysts say

    The Canadian dollar is set to march higher against America’s currency in 2026, reaching 75 cents U.S. by year-end. That’s the latest take from economists and foreign exchange (FX) strategists…

    These Olympic athletes want to win. They’re also outfitting their competition.

    MILAN — The video that Madison Chock posted to social media in 2023 didn’t only show herself and Evan Bates, her husband and ice-dancing partner, in costume. It also included…

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    Conrad's SA hope to 'expose India under pressure'

    The Supreme Court has delivered an overdue rebuke to Donald Trump on tariffs

    The Supreme Court has delivered an overdue rebuke to Donald Trump on tariffs

    Trump has other tariff options after Supreme Court strikes down his worldwide import taxes

    Trump has other tariff options after Supreme Court strikes down his worldwide import taxes

    What the Rise of AI Scientists May Mean for Human Research

    What the Rise of AI Scientists May Mean for Human Research

    Police to question Andrew’s former protection officers over his Epstein links | UK news

    Police to question Andrew’s former protection officers over his Epstein links | UK news

    Next Week on Xbox: New Games for February 23 to 27

    Next Week on Xbox: New Games for February 23 to 27