Asahi Lina (ζζ₯γͺγ) // nullptr::liveMETR: "We ran a randomized controlled trial to see how much AI coding tools speed up experienced open-source developers.
The results surprised us: Developers thought they were 20% faster with AI tools, but they were actually 19% slower when they had access to AI than when they didn't."
https://bsky.app/profile/metr.org/post/3ltn3t3amms2x
(emphasis mine)
METR (@metr.org)
We ran a randomized controlled trial to see how much AI coding tools speed up experienced open-source developers. The results surprised us: Developers thought they were 20% faster with AI tools, but they were actually 19% slower when they had access to AI than when they didn't.
β