A research study on using AI coding assistants has shown that while developers believed they got a 20% productivity gain from using the tools, measurement showed a 19% decrease in productivity.
METR recruited 16 open-source devs to complete 246 real coding tasks, randomly assigning each to “AI Allowed” or “AI Disallowed.”
Devs estimated time saved with AI before & after each task, while screen recording to measured real-world AI productivity gains.



