The Download: gig workers training humanoids, and better AI benchmarks


Zeus is a data recorder for Micro1, which sells the data he collects to robotics firms. As these companies race to build humanoids, videos from workers like Zeus have become the hottest new way to train them.  

Micro1 has hired thousands of them in more than 50 countries, including India, Nigeria, and Argentina. The jobs pay well locally, but raise thorny questions around privacy and informed consent. The work can be challenging—and weird. Read the full story. 

—Michelle Kim 

Our readers recently voted humanoid robots the “11th breakthrough” to add to our 2026 list of 10 Breakthrough Technologies. Check out what else officially made the cut. 

AI benchmarks are broken. Here’s what we need instead. 

For decades, AI has been evaluated based on whether it can outperform humans on isolated problems. But it’s seldom used this way in the real world. 

While AI is assessed in a vacuum, it operates in messy, complex, multi-person environments over time. This misalignment leads us to misunderstand its capabilities, risks, and impacts. 

We need new benchmarks that assess AI’s performance over longer horizons within human teams, workflows, and organizations. Here’s a proposal for one such approach: Human–AI, Context-Specific Evaluation.  

—Angela Aristidou, professor at University College London and faculty fellow at the Stanford Digital Economy Lab and the Stanford Human-Centered AI Institute. 



Source link

  • Related Posts

    The New Era of Militia Influencers

    Just over a week into the US and Israel’s war with Iran, Eric Roscher, an Air Force veteran, published a YouTube video on what he describes as the “very real…

    Hasbro says it was hacked, and may take ‘several weeks’ to recover

    American toy-making giant Hasbro has confirmed a cyberattack, and the company says it may take “several weeks” before the incident is resolved. The owner of properties including Transformers, Peppe Pig,…

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    Here’s the latest.

    Why Iran’s hackers keep overselling their cyberattacks

    Why Iran’s hackers keep overselling their cyberattacks

    The New Era of Militia Influencers

    The New Era of Militia Influencers

    Heavy bombings across Tehran jolt its war-weary residents.

    How dads are bonding over learning to braid hair

    How dads are bonding over learning to braid hair

    Nova Scotia Speaker working to identify, ban some protesters who disrupted vote

    Nova Scotia Speaker working to identify, ban some protesters who disrupted vote