AI’s Limits Exposed: New Study Finds Machines Struggle With Real Remote Work
Research shows AI agents fail most remote tasks, with top performer automating just 2.5% of freelance work.
The study, called the Remote Labor Index (RLI), represents one of the most detailed attempts so far to measure AI’s performance on practical digital work.
It focuses on tasks that mirror real online freelancing jobs rather than theoretical tests or benchmark problems.
- Researchers collected 240 completed projects from professional freelancers working through platforms such as Upwork.
- Each project included the original brief, all input materials, and the final deliverable that a client had accepted.
- These projects came from 23 categories of work, including product design, animation, architecture, game development, and data analysis.
- Together they covered more than 6,000 hours of paid labor valued at about $140,000.
Six advanced AI agents were then tested on the same projects, including Manus, Grok 4, Sonnet 4.5, GPT-5, ChatGPT agent, and Gemini 2.5 Pro.
Author summary: AI fails most remote tasks with top performer automating just 2.5%.
More News
- Can the World Health Organization still be the World’s health conscience? - 2 | A house built on donor sand
- Who Is Cillian Murphy's Wife Yvonne? They Are Parents To 2 Sons And One Of Them Is Cast In HBO's War
- techUK’s Autumn 2025 Budget submission
- The wildest fight in UFC history: Cortés-Acosta goes from being finished to finishing Ante Delija
- Can the World Health Organization still be the World’s health conscience? -1 | The cracks in global trust