Introducing FrontierCode

kept by eddie jun 09

Cognition's FrontierCode benchmark measures code mergeability, finding even top models like Claude Opus 4.8 score only 13.4% on its hardest 50 tasks.

Surpassing Frontier Performance with Fusion — OpenRouter Blog
OpenRouter's Fusion, which synthesizes outputs from multiple language models via a judge model, outperformed individual frontier models including GPT-5.5 and Claude Opus 4.8 on deep research tasks, with a budget panel achieving near-frontier performance at half the cost.
also on Claude Opus 4.8, GPT-5.5, #benchmarks, #ai-coding, #developer-tools
What Jobs Are Made Of - by Thomas Wolf - Thomwolf
AI benchmarks show rapid progress but economic impact remains limited because jobs require judgment and agency, not just task execution — explaining why entry-level hiring is falling while senior roles grow.
also on SWE-bench, #benchmarks
Building more with GPT-5.1-Codex-Max
OpenAI releases GPT-5.1-Codex-Max, a faster coding model using compaction for long-horizon tasks across multiple context windows.
also on SWE-bench, #ai-coding, #software-engineering, #developer-tools
Claude Opus 4.8
Anthropic released Claude Opus 4.8, a modest upgrade with benchmark improvements, new collaboration features like effort control, and a cheaper fast mode.
also on Claude Opus 4.8, #ai-coding, #developer-tools
Async Coding Agents "From Scratch"
A developer demonstrates how to build a custom async coding agent by combining Slack, Modal, GitHub, and Claude Code/Codex headless mode, arguing this makes cloud coding agents like Devin undifferentiated.
also on Cognition, Devin, #open-source, #ai-coding, #software-engineering, #developer-tools