Jack RusherMar 8

“The LLM generated what was described, not what was needed.”

https://blog.katanaquant.com/p/your-llm-doesnt-write-correct-code

Your LLM Doesn't Write Correct Code. It Writes Plausible Code.

One of the simplest tests you can run on a database:

Vagabond Research
Show threadGLC

@jack

There's one line there that would be valuable in a broader discussion (beyond coding):
"This is not a syntax error. It is a semantic bug:"

Given that LLMs don't even have a semantic component, this seems foreseeable. But outside the specific context of coding I see people struggling to formulate the point cogently.

This would be relevant to contexts like technical writing, etc., but I don't think the vocabulary exists for expressing it neatly in such cases.

Mar 9 at 2:38amWeb
Show threadtuban_muzuruMar 9

@glc @jack

When people start out with LLMs, they ask for code.

But after a while, the users ask for spec.