Measuring the Impact of Early-2025 AI on Experienced Open-Source Developer Productivity: https://metr.org/blog/2025-07-10-early-2025-ai-experienced-os-dev-study/
METR ran a controlled experiment with 16 experienced open-source developers on 246 programming tasks. The developers predicted that the use of AI would speed up their work by 25%, and after the experiment judged that it had sped it up by 20%. But when actually measured, the use of AI slowed down their work by 19%.
@11011110 I gave it a good rest recently. Mainly to Gemini, both flash and pro. I find it ok to generate tests based on specs. Write documentation drafs and so on. It does increase productivity there. But when it comes to code, I found I'm usually faster doing it myself than having to review the generated code and correct the AI at every turn. Reviews take a lot of time. More than writing the code itself. It also leads you down a rabbit hole that is usually not the right solution in the first place. So I feel like it's probably true that it slows you down overall on its current form.
Also, using it with Rust I found it struggles with stuff like lifetimes.
0xDE
Istar Eldritch