Terence EdenOct 2, 2024

🆕 blog! “GitHub's Copilot lies about its own documentation. So why would I trust it with my code?”

In the early part of the 20th Century, there was a fad for "Radium". The magical, radioactive substance that glowed in the dark. The market had decided that Radium was The Next Big Thing and tried to shove it into every product. There …

👀 Read more: https://shkspr.mobi/blog/2024/10/githubs-copilot-lies-about-its-own-documentation-so-why-would-i-trust-it-with-my-code/
⸻
#AI #github #LLM

GitHub's Copilot lies about its own documentation. So why would I trust it with my code?

In the early part of the 20th Century, there was a fad for "Radium". The magical, radioactive substance that glowed in the dark. The market had decided that Radium was The Next Big Thing and tried to shove it into every product. There were radioactive toys, radioactive medicines, radioactive chocolate bars, and a hundred other […]

Terence Eden’s Blog
Show threadLouis IngenthronOct 2, 2024
@Edent "My hammer has trouble driving this screw! So why would I trust it with this nail?"
Show threadTerence EdenOct 2, 2024
@louis I'm curious, did you read the blog post, or just the headline?
Show threadLouis Ingenthron

@Edent I was replying to the mastodon post, not the blog post.

However, I just read the blog post, and I stand by my comment. You claim that trying to extract accurate information from an LLM is a basic functionality test, but LLMs aren't fact/truth machines and never have been and never will be (the screw in my analogy). But they are pattern matchers and that is immensely useful as a coding tool (the nail).

Oct 2, 2024 at 12:42pmWeb
Show threadTerence EdenOct 2, 2024

@louis next time, please read the article before replying.

I'll mute you for a bit. But feel free to unfollow me.