Kevin BeaumontThe power of ChatGPT
Sean Reifschneider
Lou Cyx@jafo @GossiTheDog even then, a reliable source of information should be consistent, meaning both Kevin and you should have gotten the same result, but we all know LLMs aren't consistent (even when the same user asks the same question) so if anything, you added more evidence proving we should avoid LLMs 🤷🏻♀️
ben@loucyx @jafo @GossiTheDog it's also not even correct, so what you've managed to get there is a different wrong answer.
If you think 'confidentaly incorrect' is an improvement over 'obvious gibberish', then yeah, I suppose this is preferable, but it doesn't get you any closer to the truth.
(personally I think 'obviously wrong' is preferable, because then at least you know to ignore it.)
@benjamineskola @loucyx @GossiTheDog What do you consider a correct answer? According to the respective Wikipedia entries for them, the answer I got seems to be correct. The answer ChatGPT gave me linked to citations which also seemed to back up the answer. https://www.theguardian.com/tv-and-radio/2022/aug/25/farewell-scott-mills-bbc-radio-1?utm_source=chatgpt.com https://en.wikipedia.org/wiki/Kevin_Greening?utm_source=chatgpt.com https://en.wikipedia.org/wiki/Scott_Mills?utm_source=chatgpt.com
@jafo @loucyx @GossiTheDog Elsewhere in this thread, Kenny Everett was claimed to be the first — but the timeline might be wrong for that, depending when he actually came out.
@benjamineskola That math doesn't check out, he came out in 1984, and left Radio 1 in 1970, he was doing TV in '84, so I don't think he qualifies as an openly gay Radio 1 host; he was married to a woman when he was a Radio 1 host IFAICT. Similarly, Chris Denning has said retrospectively that he was openly gay during his time at Radio 1, but I can't find anything that confirms that he was publicly out at the time.
@loucyx @GossiTheDog I don't know about you, but I've long ago learned to not just blindly trust tools I use, on the Internet and elsewhere. I use tools understanding the limitations, and check the work. In this case, it seemed like outside sources corroborated the assertions ChatGPT made. I can't speak to Kevin's answer, because no information on WHAT ChatGPT was given; as I said, I used "Thinking-Standard" to get my answer, YMMV if you use other models.
@jafo @loucyx @GossiTheDog but your mileage should not vary. that's the point.
getting a different answer each time is what makes these tools not fit for purpose. if they return the right answer some of the time but you never know which times, what's the point in them?
@benjamineskola @jafo @GossiTheDog 100% this! If they were always right or always wrong it would be one thing, but the only constant is that they are always confident about their answer (either if it’s right or wrong) which is what makes them dangerously unreliable.
And this isn’t even getting into the whole detrimental effect they have on cognitive analysis and reasoning for LLM consumers.
Kate@benjamineskola @GossiTheDog @loucyx @jafo It’s the difference between lying and bullshitting. Lying at least has a regard for what is true. Bullshitting doesn’t care if it is correct or not.