Christopher Owenomg
stilescrisis@oysta @Viss This reminds me of a feature in Google code review where an LLM could write suggested fixes for CL notes. Sometimes it would put in references like "TODO(b/183648473):" with a link to a nonsense bug ID, or "TODO(bobsmith@):" with a plausible email address. It learns patterns and reproduces them, whether or not those patterns are useful or meaningful.
jonathankoren™@stilescrisis @oysta @Viss I one tried using an LLM to translate some code from Java to C++, and it literally created an empty function with the comment
// TODO: Implement in C++
10/10 No notes.
@jonathankoren @oysta @Viss Yup, seen it. Also frequently seen LLMs delete big blocks of code when asked to fix it. "Look, it compiles--that's what you wanted, right?"
ikari@jonathankoren @stilescrisis @oysta @Viss
me: this code is a mess... let's make the LLM describe what's going on here in a comment
me: `// this section`...
LLM: ...`is some incomprehensible mess`
welp.
Resuna@ikari @jonathankoren @stilescrisis @oysta @Viss
"You are not expected to understand this."