The Download: gig workers training humanoids, and better AI benchmarks


Zeus is a data recorder for Micro1, which sells the data he collects to robotics firms. As these companies race to build humanoids, videos from workers like Zeus have become the hottest new way to train them.  

Micro1 has hired thousands of them in more than 50 countries, including India, Nigeria, and Argentina. The jobs pay well locally, but raise thorny questions around privacy and informed consent. The work can be challenging—and weird. Read the full story. 

—Michelle Kim 

Our readers recently voted humanoid robots the “11th breakthrough” to add to our 2026 list of 10 Breakthrough Technologies. Check out what else officially made the cut. 

AI benchmarks are broken. Here’s what we need instead. 

For decades, AI has been evaluated based on whether it can outperform humans on isolated problems. But it’s seldom used this way in the real world. 

While AI is assessed in a vacuum, it operates in messy, complex, multi-person environments over time. This misalignment leads us to misunderstand its capabilities, risks, and impacts. 

We need new benchmarks that assess AI’s performance over longer horizons within human teams, workflows, and organizations. Here’s a proposal for one such approach: Human–AI, Context-Specific Evaluation.  

—Angela Aristidou, professor at University College London and faculty fellow at the Stanford Digital Economy Lab and the Stanford Human-Centered AI Institute. 



Source link

  • Related Posts

    Cameo partners with TikTok to boost popularity

    In an effort to regain its popularity, celebrity greeting app Cameo launched a new TikTok integration that allows U.S. creators to offer personalized Cameo videos directly to their fans through…

    Why is gaming becoming so expensive? The answer is found in AI | Games

    When the PlayStation 5 launched almost five and a half years ago, it was listed at £449 in the UK. If you were to buy one at the recommended retail…

    Leave a Reply

    Your email address will not be published. Required fields are marked *

    You Missed

    Cameo partners with TikTok to boost popularity

    Cameo partners with TikTok to boost popularity

    Red Lobster to bring back endless shrimp deal that drove it to bankruptcy

    SpaceX confidentially files to go public on stock market, reports say | Technology

    SpaceX confidentially files to go public on stock market, reports say | Technology

    Launch fever hits Florida as visitors flock to NASA’s Artemis II moon launch

    Launch fever hits Florida as visitors flock to NASA’s Artemis II moon launch

    Mario Galaxy Movie Retail Pre-Orders Go Live, Including Steelbook & ‘Tin Egg’ Edition

    Mario Galaxy Movie Retail Pre-Orders Go Live, Including Steelbook & ‘Tin Egg’ Edition

    Trump Says Europe Is On Its Own in Securing the Strait of Hormuz