Mastodawn

Computer science experiment:

Put your LLM or agent through the same technical interview that you would require for prospective job applicants, and think about whether you would hire an applicant who gave the same responses as your LLM or agent.

If the answer is no, then why would you trust your LLM or agent to write code for you when you wouldn't trust a comparable human?

Show thread

Drew McCormack 2d ago

@lapcatsoftware Devil’s Advocate: Do you use a compiler, even though a compiler also wouldn’t pass the test? It’s a tool. It doesn’t replace, it enhances.

Show thread

Taylor Hadden

@drewmccormack @lapcatsoftware What even is this response? People _do_ use coding agents as replacements. Blindly trusting the output is, and continues to prove to be, fraught.

The comparison to compilers is apples to oranges. They might both be fruit, but the similarities end there.