I'm fundamentally a tool builder, and LLM coding agents work one million times better if you give them good tools, and I wrote a thing about this
I'm fundamentally a tool builder, and LLM coding agents work one million times better if you give them good tools, and I wrote a thing about this
@regehr ok. after fabian explained the origins i now think your use of the word is accurate, and it hints that zero degrees of freedom are impossible to achieve.
it is an extension of the original least squares problem: every optimizer games the error metric.
here, the game has more brownian motion and the quantifier isn't fuzzy, but you also struggle to find a complete, ungameable metric.
essentially you can not prove oracle completeness.
@regehr all this, and your post, inspired this thread:
1. Goodhart's Law: "When a measure becomes a target, it ceases to be a good measure." 2. every optimizer targets the error metric. 3. therefore, every error metric is a bad measure. #s0up