:

AI STRUGGLES WITH CODE RECREATION IN NEW BENCHMARK TEST

AI DESK1 MIN READ
FRI, JUN 26, 2026

■ AI-SUMMARIZED FROM 1 SOURCE ▸ TIMELINE

Epoch AI's MirrorCode benchmark reveals significant limitations in current AI models' ability to recreate programs without access to original code. Claude Opus 4.7 achieved the highest performance at 56 percent solve rate, yet all tested models failed on complex tasks.

The MirrorCode benchmark measures whether AI systems can reverse-engineer complete programs by analyzing their functionality alone. Claude Opus 4.7 led the field by successfully rebuilding a 16,000-line toolkit in 14 hours. However, the benchmark's most challenging tasks pushed AI to its limits. One task required continuous processing for 19 days and cost $2,600 to run—demonstrating both the computational expense and the fundamental difficulty of complex code recreation. The results highlight a clear gap in AI capabilities: while models excel at building code from scratch or making modifications to existing programs, they struggle significantly when tasked with complete reverse-engineering of software. The benchmark underscores that current AI systems, despite recent advances, remain limited in understanding and reproducing intricate program structures without direct access to source code. Epoch AI's findings suggest developers should approach AI-assisted code recreation with realistic expectations for now.

■ SOURCES

The Decoder

■ SUMMARY WRITTEN BY AI FROM THE LINKS ABOVE

■ MORE FROM THE AI DESK

Kimi K3, China's latest AI model, is capable but not frontier-level and poses no extraordinary cybersecurity threat, according to analysis. Experts caution against viewing the release as evidence of a competitive disadvantage for US AI development.

1H AGOAI Desk

Mozilla has published a comprehensive analysis of the open source AI landscape, examining trends, challenges, and opportunities in the sector. The report draws insights from developers and industry stakeholders to assess the current state of open-source artificial intelligence.

1H AGOAI Desk

Patreon is blocking AI bots from scraping creator content without permission by partnering with Cloudflare. The platform is moving beyond passive robots.txt files to active enforcement.

1H AGOAI Desk

Sesame, a conversational AI startup founded by Oculus veterans, has released its iOS application, bringing its AI agents to a broader audience with a focus on natural dialogue.

3H AGOAI Desk

■ SUBSCRIBE TO THE DAILY BRIEF

ONE EMAIL, 5 STORIES, 06:00 UTC. UNSUBSCRIBE ANYTIME.