Christopher Owenomg
stilescrisis@oysta @Viss This reminds me of a feature in Google code review where an LLM could write suggested fixes for CL notes. Sometimes it would put in references like "TODO(b/183648473):" with a link to a nonsense bug ID, or "TODO(bobsmith@):" with a plausible email address. It learns patterns and reproduces them, whether or not those patterns are useful or meaningful.
jonathankoren™@stilescrisis @oysta @Viss I one tried using an LLM to translate some code from Java to C++, and it literally created an empty function with the comment
// TODO: Implement in C++
10/10 No notes.
@jonathankoren @oysta @Viss Yup, seen it. Also frequently seen LLMs delete big blocks of code when asked to fix it. "Look, it compiles--that's what you wanted, right?"
@jonathankoren @oysta @Viss I'm sure the LLM has ingested hundreds of CLs described as "port XYZ to C++" where half the functions contained "TODO: Implement in C++". Pattern successfully acquired!
Human: This doesn’t even compile.
LLM: Works on my machine.
Human: It does not.
LLM: Bite my shinny metal ass.
Human: You don’t even have an ass.
LLM: *sobbing* I know.
Lars Brinkhoff
Futurama - Kill all humans, must kill all humans
*Sleep talking* Kill all humans, must kill all humansBender, wake up!I was having the most wonderful dream... I think you were in it.S1E3 Episode: I, Roommate
The cat who walks thru walls
Timjan@jonathankoren
The turing test revealing much more about humans, than about computers.
@stilescrisis @oysta @Viss
The turing test revealing much more about humans, than about computers.
@stilescrisis @oysta @Viss
ikari@jonathankoren @stilescrisis @oysta @Viss
me: this code is a mess... let's make the LLM describe what's going on here in a comment
me: `// this section`...
LLM: ...`is some incomprehensible mess`
welp.
Resuna@ikari @jonathankoren @stilescrisis @oysta @Viss
"You are not expected to understand this."
🇺🇦 haxadecimal 🚫👑
64kb@jonathankoren @stilescrisis @oysta @Viss I like how with those you can keep asking it to "now show me the code" and get something rough to start from.