Kees van der Leun14h ago
Google's AI overviews give wrong answers 9% of the time (1.25 billion times a day), and in over half of the cases point to websites that don't actually support the answer given.
https://futurism.com/artificial-intelligence/google-ai-overviews-misinformation
Analysis Finds That Google’s AI Overviews Are Providing Misinformation at a Scale Possibly Unprecedented in the History of Human Civilization

A new analysis commissioned by The New York Times suggests that Google's AI Overviews are wrong an astonishing percentage of the time.

Futurism
Show threadStarkRG14h ago
@Sustainable2050 Having that high a wrong answer rate makes using them for answers absolutely useless. To know whether your answer is one of the barely more than 9-in-10 right answers, you have to either already know the answer, which you don't because you're looking for the answer, or you'll need to go read actual sources to find out, which is what you should have done in the first place. LLMs are terrible at just about everything.
Show threadalsvha14h ago
@StarkRG @Sustainable2050 exactly - it's one of my main arguments at work when ever they "encourage" us to use LLMs to gain the massive "performance benefits" in solving/development.
Show threadStarkRG14h ago
@alsvha @Sustainable2050 There's really only one halfway decent use for LLMs and that's as an accessibility aid for when developers and designers don't do their damned jobs properly and just *include* accessibility features instead of relying on an energy-inefficient, ethically-questionable technology to bridge the gap.
Show threadalsvha

@StarkRG @Sustainable2050 I can find use cases and I can see benefits in some areas - but whether it's worth the cost (environmental, ethical appropriation, vendor lock-in, skill deterioration etc) ; I'm very much not sure off.

I become even more of an anti-person, because it's also being forced upon everything/everybody with dubious claims in a multitude of non-working scenarios.
And when managers then claim "85% performance gain" and I hear my colleagues talk about 'Claude' as a person and more about how to prompt than how to solve, I get so very frustrated.

5:51amWeb
Show threadStarkRG13h ago
@alsvha I'm not saying there aren't any other use cases, I'm saying that I can't really think of one use case that isn't already handled at least as well by a more environmentally-friendly and ethically-sound technology. The only reason accessibility kind of qualifies as a good use case is because, although accessibility *should* be a standard feature for everything, it's usually a second thought, if that.
Show threadMartin Vermeer FCD13h ago
@StarkRG @alsvha One valid use case I have found is machine translation between two languages that you are fluent in. You still have to do the manual check, but it may save you time and effort, and may even prevent the typical mistakes that writers non-native in the target language make.