Why Can AI Write Essays but Fail at Counting Letters?

AI models like GPT-4o and Claude write fluent essays because they predict token sequences statistically, a task they are trained on billions of examples to do. They fail at counting letters and words because they never see letters or words directly. They see tokens, which are arbitrary subword fragments with no numeric or alphabetic structure the model can reliably reason over.