It's astonishing that it's easier to get code from Opus or Sonnet than getting documentation for code.

It seems getting correct, verified and non-hallucinated documentation is an unsolved problem.

- invented functions
- mis-represented use cases
- useless information

With code you can reinforce train the model. With documentation you cannot easily do this. Text compression doesn't solve the knowledge compression issue, and compressed text isn't necessarily correct.

#ai #documentation #limitations