[AI]■ STORY TIMELINE
UK STUDY: AI BENCHMARKS DRASTICALLY UNDERESTIMATE AGENT ABILITIES
The UK's AI Security Institute has found that standard AI benchmarks systematically underestimate what AI agents can actually accomplish by imposing artificial computational constraints. When token budgets are increased tenfold, success rates on software engineering tasks jump roughly 25 percent.
The Decoder+0m
In a study covering seven benchmarks, the UK's AI Security Institute shows that standard AI evaluations systematically u…