I love how smart these AI technologies are. They understand that "bigger" for cities can be ambiguous, refer to either the population or the area. It's also great that it's showing the sources in the upper corner, and displaying the basic facts.

Small minus on consistency and correctness, but other than that, really a great answer.

#google #ai #googleaioverview

@vrandecic good catch! My guess is that this is an issue with the smaller/cheaper model used to serve this. Flash makes a similar mistake in the Gemini app, but Pro doesn't.
@flancian it's an issue with a product that's used by about two billion people.

@vrandecic yes, I agree it's disappointing Denny. I can report this issue internally to the teams that have a chance of patching this particular failure mode if you want?

IMHO it would be good if Google supported something like community annotations for claims. But right now each generated answer is wholly independent and can't even be saved for later reference it would seem. There are only individual ratings available, which are presumably used for RLHF.

@flancian be my guest and report it. And send greetings to the relevant team!