The Download: gig workers training humanoids, and better AI benchmarks


Zeus is a data recorder for Micro1, which sells the data he collects to robotics firms. As these companies race to build humanoids, videos from workers like Zeus have become the hottest new way to train them.  

Micro1 has hired thousands of them in more than 50 countries, including India, Nigeria, and Argentina. The jobs pay well locally, but raise thorny questions around privacy and informed consent. The work can be challenging—and weird. Read the full story. 

—Michelle Kim 

Our readers recently voted humanoid robots the “11th breakthrough” to add to our 2026 list of 10 Breakthrough Technologies. Check out what else officially made the cut. 

AI benchmarks are broken. Here’s what we need instead. 

For decades, AI has been evaluated based on whether it can outperform humans on isolated problems. But it’s seldom used this way in the real world. 

While AI is assessed in a vacuum, it operates in messy, complex, multi-person environments over time. This misalignment leads us to misunderstand its capabilities, risks, and impacts. 

We need new benchmarks that assess AI’s performance over longer horizons within human teams, workflows, and organizations. Here’s a proposal for one such approach: Human–AI, Context-Specific Evaluation.  

—Angela Aristidou, professor at University College London and faculty fellow at the Stanford Digital Economy Lab and the Stanford Human-Centered AI Institute. 



Source link

  • Related Posts

    Today’s NYT Connections Hints, Answers for June 22 #1107

    Looking for the most recent Connections answers? Click here for today’s Connections hints, as well as our daily answers and hints for The New York Times Mini Crossword, Wordle, Connections:…

    Today’s NYT Wordle Hints, Answer and Help for June 22 #1829

    Looking for the most recent Wordle answer? Click here for today’s Wordle hints, as well as our daily answers and hints for The New York Times Mini Crossword, Connections, Connections: Sports…

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    The interstellar dice-driven RPG Citizen Sleeper is free for the next week, so now you’ve got no excuse to not play it

    The interstellar dice-driven RPG Citizen Sleeper is free for the next week, so now you’ve got no excuse to not play it

    Feds’ AI bill good ‘first step’ but safety advocates say more work needed – National

    Feds’ AI bill good ‘first step’ but safety advocates say more work needed – National

    Mbappé: “Lionel Messi es el mejor del mundo junto a Cristiano Ronaldo”

    Mbappé: “Lionel Messi es el mejor del mundo junto a Cristiano Ronaldo”

    Pilot reports passenger bit a fellow flyer on plane approaching Philadelphia: “He’s trying to fight everybody”

    Pilot reports passenger bit a fellow flyer on plane approaching Philadelphia: “He’s trying to fight everybody”

    Fuel sales halted in occupied Crimea as Ukraine targets oil facilities

    Fuel sales halted in occupied Crimea as Ukraine targets oil facilities

    Nathan Saliba obvious next man up to replace Ismaël Koné in decisive Group B match against Switzerland

    Nathan Saliba obvious next man up to replace Ismaël Koné in decisive Group B match against Switzerland