We are Changing our Developer Productivity Experiment Design - METR

kept by eddie feb 25

METR’s late 2025 experiment on AI developer productivity suffers from selection bias because many developers refuse to work without AI, yielding unreliable speedup estimates.

Long horizon tasks with Codex
OpenAI's Codex successfully built a design tool from scratch over 25 hours, demonstrating long-horizon agentic coding with milestone-based planning and continuous verification.
also on METR, Codex, #ai-agents, #ai-coding, #software-engineering, #productivity, #developer-tools
The Shape of the Thing - by Ethan Mollick
AI has entered a new agentic era where models can autonomously complete hours of human work, and exponential capability improvements are now driving radical organizational experiments like StrongDM's "Software Factory" that ships code without human touching it.
also on METR, Claude Code, #ai-agents, #software-engineering, #productivity