bert hubert 🇺🇦🇪🇺🇺🇦3d ago
After receiving the first LLM-generated pull requests, I have decided to blanket no longer look at those. When studying a PR, I take into account who made it, and if they've previously been careful developers. LLM-generated code I have no idea about, and the amount of scrutiny required is just too much. Because I have to assume you have no idea what you are doing.
Show threadgabriele renzi

@bert_hubert I think mastodon's LLM policy is a good one, iiuc: when you submit a PR you are responsible for it.

If you produce good code with an LLM and review it, that's fine. If you submit LLM generated slop you get ignored.

A good LLM-generated PR should be indistinguishable from a good human one.

Mar 28 at 7:13amMastodon for Android
Show threadbert hubert 🇺🇦🇪🇺🇺🇦3d ago
@riffraff I think you missed the point of my post. “Looks good” does not tell me everything.
Show threadgabriele renzi3d ago

@bert_hubert perhaps I did :)

My response goes from: how do you evaluate "this PR is LLM generated so I will reject it a priori"?

What I'm saying is that if it appears LLM generated than it does not "look good" and so it's fine to reject it.

Otherwise, I think if a dev took time to edit it, it's just like another one.

Show threadlhp3d ago
@riffraff @bert_hubert the only good LLM policy is to outright ban anyone dumb enough to use them 🤷‍♀️