you know how llms will overgeneralise their training data and start hallucinating/extrapolating stuff?

this happens to me all the time with emoji. the original set in ios 4(?) was tiny. i could remember what was and wasn't an emoji. but there's too many now, so i “hallucinate”