Hey we solved software development, no need to learn programming anymore (Claude's source code leak)

https://lemmy.world/post/45282644

So I don’t know if all the other replies are pretending to be stupid, but the shown prompt is not stupid.

If you include stuff like that section in your prompt, then it has been shown that the AI will be more likely to output secure code. Hence of course the section should be included in the prompt.

If it looks stupid but it works, then it is not stupid.

Firstly, it can work and still be stupid.
Secondly, since the chat bot is more likely but not certain to write secure, bug-free code, it does not in fact work and is therefore, by your own reasoning, stupid.
But so is asking a chat bot for code to begin with, so there wasn’t ever really a way around that.

since the chat bot is more likely but not certain to write secure, bug-free code, it does not in fact work

Humans are not certain to write secure, bug-free code. So human code is useless, by the very same metric?

What kind of “logic” is that?

Humans understand the concepts of “writing code” and “bug fixing”. Chat bots do not understand, period.