If anyone is wondering how google is doing, it is giving incorrect answers to the query “How old is the Universe?”

Instead of serving up scientific consensus (just shy of 14 billion years) it is latching onto recent media coverage of a questionable study (tired light, time-dependent coupling constants) claiming a much larger figure.

Notably, it gives me the right answer from an incognito window. But elevating popularity metrics over scientific consensus is a real problem!

One reason to worry about this is the possibility that google is using tracking info to decide what response it should serve.

That makes sense for some queries, but not for a scientific question with a consensus answer.

For example, if google decides based on browsing that someone is anti-vaccine, and the person asks how best to protect their kids from measles, how will it respond?

Will you get medical consensus, or a "study" that hasn't been around long enough for serious review?

That isn't necessarily what's happening.

I have a google scholar profile, so it may think I want to see new research results.

Maybe it is just serving results based on location, or the fact that I recently clicked on a link to a story about this study. Lots on non-nefarious possibilities!

But something like this still gives me pause! For a scientific question, I don't like the idea of google giving me one answer when it thinks it can see who I am, and a different answer when it can’t.

@mcnees I just asked and I got the new stuff, I had to scroll down a full page to find the consensus number
@mcnees I have none of those attributes and it gives me the same (in fact I rarely use google, so it shouldn't have too many priors about me).
@mcnees "That isn't necessarily what's happening. I have a google scholar profile, so it may think I want to see new research results."
I'm afraid that this is exactly what is happening. I am not logged in to Google in my mobile Firefox and this is the result I see... :-/
@mcnees Interesting. A day later, sam browser, same question, Google returns "13.7 billion years" as answer? Hmm...
@mcnees And same result (13.7 billion years) even if I rephrase the question...
@mcnees
Yeah that's odd. I tried, just for fun, while logged in. Got the consensus answer. (Denmark)

@mcnees
I think almost no scenario requires nefarious *intentions* to have very harmful *consequences*.

If the intention was to also serve you recent studies, tje correct way to present that is "This is the established number, and here's some recent work on the matter."

Of course Google does not semantically understand those things, but they could probably indicate what the "majority" results are and what the weighting algorithm preferred, based on x... but that's a trade secret.

@mcnees @cainmark this is ripe for experimentation

@mcnees
It sounds like the question pertaining to Google is changing. It used to be: Why don't you Google it?

Now it's becoming: This answer is nuts. Did you get Googled?

@mcnees I tried from an incognito window just now and got the bullshit answer.

#enshittification

@mcnees Given how few ever read beyond a Google answer or a headline, this kind of misinformation is incredibly dangerous.
@mcnees oh, but you can also get it in light years, isn't that amazing 🫠
@mcnees two years ago, in France, Google was quoting completely wrong numbers regarding criminality, from a French alt-right online newspaper. Going in incognito would show more realistic data for the exact same query.
@mcnees this is a problem? So you’re telling me the iPhone that was powered on at the birth of the universe doesn’t have an internal digital list that would include the date on which the first battery was inserted and it was powered on? This seems so simple. I swear I heard Ted Cruz make a reference to this a few days ago…
@mcnees
Interesting chat for stoned people. We don't know , we will never know. It's a simple guess.
End of story. 14? 27? 50?
It doesn't even matter in the sceme of things. Next!
@mcnees I got 13.7 billion with a much used Google profile. Still wrong, as I believe the current consensus is 13.8 billion years. But odd how different profiles get different answers.
@mcnees Its the exact same with climate change. Theres 85 billion papers proving the consensus conclusion. But theres that one sole paper with wholly speculative and premature conclusions. NEWS! NEWS! BIG SCIENCE MUST BE COMPLETELY WRONG! YOU ARE JUSTIFIED IN REMAINING IGNORANT AFTER ALL! WOO HOO!!!🤦🏻‍♂️
@mcnees Interesting. It's still giving me the 13.8 billion year answer. (I'm not in an incognito tab, but I'm also not signed in to Google).

@mcnees It's been in steady but accelerating decline for years, the trouble has always been finding something better. I failed for years to find something with comparable search result quality, and wasn't impressed with anything.

I've been using a free trial of Kagi, a paid search service, as a secondary search engine anytime Google disappoints me, and I think I'm going to subscribe to their lowest tier next month when my trial expires.

I had forgotten what good search looks like.

@mcnees @lisamelton For comparison, DDG is giving me a "recent news" section at the top with 3 thumbnail-links to popular science articles about the new paper, but otherwise the main results list is all links to credible sites showing the [currently-accepted] correct answer in the quoted snippet. There is no simple answer given directly on the page.

that "recent news" section can also be turned off, though I haven’t.

@mcnees I doubt that Google is doing it intentionally, given that Google has repeatedly told me that Medicaid and Medicare are synonyms (possibly because of CMS's full name), and that hyper and hypo are also synonyms.

A software engineer who codes a system to give those results to someone like me?

@mcnees I prefer to use Perplexity AI for search. It uses the GPT4 LLM from OpenAI coupled with Bing to verify search results. It's fantastic https://www.perplexity.ai/ You never have to use google again
Perplexity AI

Perplexity AI unlocks the power of knowledge with information discovery and sharing.

@mcnees I think the problem is that AI models are rewarded solely with approval, which spirals into telling us what we want to hear, not what is correct.

And this leads to the problem that language model apps have no way to test, to verify. They are not connected to sensors, not even in a secondary sense. All they can do is make statements and see which answers get voted up or down.

@mcnees Reassuringly, I get the correct answer on mobile now.
@mcnees Huh. On both logged in and incognito it gives me the 13b answer. Interesting find...
@mcnees Google is giving me the “26.7 billion years old” answer. 🫤
@mcnees I got 13.8 as the top result 🤷‍♀️ Didn't even see this new number until I got to the second page
@mcnees just checked DuckDuckGo and they have it right! Phew! Only way to search for me since Mastodon taught me about them. Only browser too!

@mcnees I was recently Googling stories on a sexual assault court case where the accused has name suppression.

There was a Google question along the lines of "Who is the accused person?"

Curious, I clicked on it.

There was a name in bold.

I didn't know who the person was.

So I Googled them.

Turns out it was the name of the journalist who had written a bunch of stories on the case, which Google had pulled.

Great for their future job prospects if potential employers Google them...

@mcnees I had been testing it with something far less significant relating to my industry, where weʼre the longest-running player. Google served up the name of a later entrant that makes this claim falsely, and did so for years, in its info box. We made complaints regularly, and occasionally it would remedy this (quoting Wikipedia), but soon return to citing the wrong info. Right now the info box is gone altogether, but the other site is placed ahead of ours.
@Mojeek gets it right.
@jackyan @mcnees yeah infoboxes can cause some real issues, our preference is always organic links 😀
@Mojeek @mcnees Works for me! Or, how search engines are supposed to work.

@mcnees It's why Google has fallen in terms of usefulness for ppl like me, who use it to find answers about tangible things rather than use it to find answers about pop culture.

The results always skew towards whatever is in the zeitgeist -- regardless of whether they actually fit the query. It often takes a lot of massaging of queries these days to get the actual answers you want.

And then there's the times where it says there's no results, but then I twiddle the query and oh look, there are!

@mcnees who still uses google when you can get comprehensive reply without ads?

@mcnees

IMHO the problem is less what Google does here but more that many people still think that chat bots can _reliably_ answer questions or give reliable information.

They can not.

They give answers/information that appear to be coherent/plausible but the process through which the system generates answers effectively cannot be verified.

And since the process is not a simple search for specific terms in a giant database of text but much more complex it - by default - shouldn't be trusted.

@mcnees
Relieved google isnt giving 6,000 yrs as the answer.......yet
@mcnees I get the correct answer. It shows the new articles but also shows video suggestions casting doubt on the recent coverage
@mcnees
@coreyspowell
The Google algorithm might be dumber than we think it is. It is perhaps just matching words with recent search results and articles that contain the search words.
@AkaSci @mcnees The unnerving thing here is that the algorithm can be dumb as a post and still help spread disinformation. If a lot of people search for a wild, unvetted result, and Google then declares that result to be the default "truth," that's a problem.

@coreyspowell @AkaSci @mcnees

For me the unnerving part is: this is dangerous knowledge for evil actors deliberately trying to spread misinformation

@nyrath @coreyspowell @AkaSci @mcnees
Maybe tangential to the discussion, but a couple uninformed questions increasingly on my mind:

Are there better search engines currently?
What are the pros and cons of various non-Google search utilities?

#Google #SearchEngine

@mcnees I've been more and more aware lately of how useless Google is as a search engine, but it's so damn hard to change the habit of it being the default. 😛

Doesn't help that it's on all my smart speakers... Now I'm wondering how accurate Google Assistant's answers are. 🙁

@mcnees when it starts to say 5000 odd years then we REALLY need to start worrying, especially when it either denies the existence of dinosaurs or that dinosaurs coexisted with the human species…. G00gle is just too powerful.

@mcnees

2.200.000.000 results? So one in four humans has created a theory of the age of the universe.

@mcnees By referring to the "previous estimate" and not the "current consensus" it is also clearly misleading. Like every time a new paper is published reality changes before our eyes.
@mcnees how did we go from “you can’t believe anything you see on the internet” to “trust the first result on google regardless of the source”
@mmoore We didn’t, hopefully? But we don’t need google suggesting to folks that a speculative result is on equal footing with the consensus answer.
@mcnees The fact that 'AI' has been inserted into/replaced normal, old-school search engines is a little terrifying and extremely annoying. I'm hoping this latest tech-bro craze blows over soon
@mcnees perhaps we're just in the middle of the research transient. This is recent news and may not have propagated everywhere. https://phys.org/news/2023-07-age-universe-billion-years-previously.html
New research puts age of universe at 26.7 billion years, nearly twice as old as previously believed

Our universe could be twice as old as current estimates, according to a new study that challenges the dominant cosmological model and sheds new light on the so-called "impossible early galaxy problem."

@mcnees Google search has been an absolute dumpster fire for the last at least six months or so, probably longer. I don't know what's going on over there but I can't trust anything.
@mcnees So
we left the information age and went to the disinformation age. Fantastic.
The Disinformation Super Highway!