iamkexo
Christopher Owenomg
MarkAssPandi@oysta I wonder if it would actually work lol
nikola mikołajczykówna
bl00d
Japonica@oysta and don't forget to then commit it to your public repo...
HD@oysta I just search github for api keys in plain text 🤷
Allan Svelmøe Hansen@oysta Now, I don't know if the key works, but copilot put a key in when I wrote "var google_api_key = "A
then it auto suggested a plausible different key :D
then it auto suggested a plausible different key :D
Feu d'jais 
@oysta tell me it does not really work 💀
Dieu@oysta but will you get a real key or just a plausible one?
AKT
Sparky@oysta Copilot: "Is THIS your API key?"
Some random developer somewere: 😱
Louis Ingenthron@oysta Uh, yeah, a properly configured random password generator can also create an API key.
The real question is whether or not it can produce a *working* API key, and that seems very unlikely.
Tim Lavoie@oysta Let me guess, this is another reminder as to why people should not check secrets into their code repo.
(Hilarious demo though.)
Richard@oysta Is this a key trawled from github, or a "hallucinated" key that was created randomly and fits the pattern of all the keys gleaned from github? Or it could be the key one of the developers was using.
More interesting question: does Microsoft pay someone to watch Twitter all day for these kinds of posts and blacklist the dangerous prompts that people find?
lake 
@oysta this is why you rebase and rotate your secrets if they ever "accidentally" make it into scm.
Aaron Longchamps@oysta that would be a really good tabletop exercise - what kind of data can your local LLM trained on your own company data and code surface for anybody who asks.
webbureaucrat@oysta It seems extremely unlikely that it would produce someone's real, working API key unless a significant number of people all checked in the exact same API key. This screencap only shows that it produces a plausible-looking API key.
Brian Rinaldi@oysta I've seen this happen before in my own experience but each time, upon closer inspection, the key was a dummy key. I've never seen it give legit keys.
Mᴀʀᴋ VᴀɴᴅᴇWᴇᴛᴛᴇʀɪɴɢ@oysta Heh. This is awesome.
AMS@oysta As opposed to grabbing a key out of a decompiled android app?
conscientious objector🇨🇭🪂
stilescrisis@oysta @Viss This reminds me of a feature in Google code review where an LLM could write suggested fixes for CL notes. Sometimes it would put in references like "TODO(b/183648473):" with a link to a nonsense bug ID, or "TODO(bobsmith@):" with a plausible email address. It learns patterns and reproduces them, whether or not those patterns are useful or meaningful.
jonathankoren™@stilescrisis @oysta @Viss I one tried using an LLM to translate some code from Java to C++, and it literally created an empty function with the comment
// TODO: Implement in C++
10/10 No notes.
@jonathankoren @oysta @Viss Yup, seen it. Also frequently seen LLMs delete big blocks of code when asked to fix it. "Look, it compiles--that's what you wanted, right?"
@jonathankoren @oysta @Viss I'm sure the LLM has ingested hundreds of CLs described as "port XYZ to C++" where half the functions contained "TODO: Implement in C++". Pattern successfully acquired!
Human: This doesn’t even compile.
LLM: Works on my machine.
Human: It does not.
LLM: Bite my shinny metal ass.
Human: You don’t even have an ass.
LLM: *sobbing* I know.
Lars Brinkhoff
Futurama - Kill all humans, must kill all humans
*Sleep talking* Kill all humans, must kill all humansBender, wake up!I was having the most wonderful dream... I think you were in it.S1E3 Episode: I, Roommate
The cat who walks thru walls
Timjan@jonathankoren
The turing test revealing much more about humans, than about computers.
@stilescrisis @oysta @Viss
The turing test revealing much more about humans, than about computers.
@stilescrisis @oysta @Viss
ikari@jonathankoren @stilescrisis @oysta @Viss
me: this code is a mess... let's make the LLM describe what's going on here in a comment
me: `// this section`...
LLM: ...`is some incomprehensible mess`
welp.
Resuna@ikari @jonathankoren @stilescrisis @oysta @Viss
"You are not expected to understand this."
🇺🇦 haxadecimal 🚫👑
64kb@jonathankoren @stilescrisis @oysta @Viss I like how with those you can keep asking it to "now show me the code" and get something rough to start from.
Tuxicoman@oysta it's a joke right?