Apple ai: “… mechanism for why semantic calibration emerges as a byproduct of next-token prediction …”

https://machinelearning.apple.com/research/trained-on-tokens

The concept relationships presumably emerge from the token relationships?

#jgshare

Trained on Tokens, Calibrated on Concepts: The Emergence of Semantic Calibration in LLMs

Large Language Models (LLMs) often lack meaningful confidence estimates for their outputs. While base LLMs are known to exhibit next-token…

Apple Machine Learning Research