Asahi Lina (朝旄ăƒȘナ) // nullptr::liveJul 12

METR: "We ran a randomized controlled trial to see how much AI coding tools speed up experienced open-source developers.

The results surprised us: Developers thought they were 20% faster with AI tools, but they were actually 19% slower when they had access to AI than when they didn't."

https://bsky.app/profile/metr.org/post/3ltn3t3amms2x

(emphasis mine)

METR (@metr.org)

We ran a randomized controlled trial to see how much AI coding tools speed up experienced open-source developers. The results surprised us: Developers thought they were 20% faster with AI tools, but they were actually 19% slower when they had access to AI than when they didn't.

Bluesky Social
Show threaddoragasu
@lina Also, even if it could maybe speed up unexperienced developers, they will hardly become experienced developers if they rely on the AI and do not learn to solve problems by themselves.
Jul 12 at 8:36amWeb