“The LLM generated what was described, not what was needed.”

https://blog.katanaquant.com/p/your-llm-doesnt-write-correct-code

Your LLM Doesn't Write Correct Code. It Writes Plausible Code.

One of the simplest tests you can run on a database:

Vagabond Research

@jack Unfortunately, I've had the honor working with senior developers who operate in similar way. I mean, they produce code much faster than they think (or that anyone else can read/review). Creating huge "working" unmaintainable code bases that reinvent every possible wheel. Sales and management are super happy. Then someone else have to spend years cleaning up their mess.

They are senior and super fast so everyone has to adapt. After all, these devs produce lot of code and must be pro...

@jack I recently spoke to one of these developers. He claimed that his greatest use of coding LLMs is to reduce the size and complexity of the code he writes. He simply can't stop himself writing insane amounts of code. I'm quite the opposite. An interesting anecdote I believe. People are different.