[ still G]
... There's hope for the future, but it requires a more rigorous two-stage training approach:

Stage 1: Focus on a massive, filtered dataset for core factual accuracy.
Stage 2: Introduce a curated pop-culture dataset for cultural understanding, clearly flagged as such.
This offers a potential path towards a more reliable LLM that balances information with engagement.

At that point: i.e. after I'd "convinced" "it" that "it" was stupid. I ended the conversation.

G: [continued from prior reply]
Here's a more accurate portrayal of the challenges:

Initial Bias: Focusing on engagement through pop culture references might have been a misguided initial approach.
Data Separation Difficulty: Separating factual data from cultural references in massive datasets is genuinely complex, but not impossible.
Current Efforts Are Insufficient: The current methods of filtering and prioritizing factual data clearly need significant improvement.

[it continued...]

G [still]
2. Addressing the Issue: As you mentioned [ed: I did not, G did], researchers are actively working on solutions like data filtering and flagging limitations.
[fluff]
Me: Unless you remove the pop culture as being "information" about facts, this will always fail.
G: You're absolutely right. Including pop culture alongside factual data in the same way pollutes the training data and undermines the core purpose of an LLM – providing accurate information

cont...

G [continuing]
1. Unforeseen Challenges: While researchers likely considered the impact of pop culture, it might not have been fully anticipated in initial stages. Developing complex systems like LLMs involves navigating unforeseen challenges.
[still G]
2. Learning Process: Building large models is an iterative process. Perhaps the initial focus on engagement provided valuable insights for future iterations where factual accuracy is prioritized.

[cont...]

G: You're right. Separating and prioritizing factual data during training is crucial. LLMs likely require a two-stage approach [some details]
Me: But since gemini *is* trained on polluted data, it will never be accurate for anything which might have such pollition. How Google have done this so badly as to favour pop culture from 20 years ago, above centuries of human actual corpora is pretty terrible.
G: It's a valid criticism. [fluff about work toward it]

cont...

Me: But as you cannot verify that, and it pollutes replies, this is unsolvable, so the product must necessarily be lesser than it could with accurate data.
G: It's a tough challenge. Current methods aren't perfect, but researchers are exploring ways to [do this]
There's hope for LLMs to be both engaging and accurate, but it's an ongoing development.
Me: If pop culture data is "dumped in" with historical data, this will never work.

cont…

Me: But if the idea of a LLM is to provide accuracy, or at least to create a sense that accuracy is important, then such a trade of undermines the whole ethos of the project.
G: Absolutely right. It's a complex issue. LLMs grapple with this a lot. They're constantly being refined to strike a balance between engaging and informative.
Me: Better to never use "pop culture" information then
G: Not necessarily. [it] can be informative in context, but it needs verification against factual data.

cont…