OK, I think I hit Claude's "garbage can full of rabid raccoons" side yesterday...
I have an old honeypot with just a couple of output plugins. I pointed Claude at it and also at a modern honeypot project with a large set of plugins and asked it to create a similar set for the older honeypot. The results were... "mixed", as the financial commentators say when the markets crater.
I don't know what exactly caused the problem. Maybe it was the need to examine and rewrite a multitude of files. I don't know.
At the start, it simply forgot to create half of the plugins. When I pointed this to it, it created the missing ones, but the results were, well...
The task was easy but not trivial. In some cases, only the honeypot name needed to be changed. In some (rare) cases, nothing had to be done, because the plugin just relays the JSON data sent to it by the honeypot. Yet in some cases the plugin needed a significant rewrite, because it outputs to a database with a different schema.
What Claude did:
1) Correctly changed the honeypot name in some plugins that needed that.
2) Didn't bother even changing the honeypot name in some plugins that needed only that.
3) Didn't rewrite the plugins that needed rewriting because they were outputting to a database with a different schema.
4) Completely rewrote 2 plugins that barely needed touching. And I mean completely. The result wasn't more efficient, it wasn't just full of bugs - it was "WTF is this shit?!" kind of result. I had to scrap it completely and replace it with the original source.