@richardnosworthy hot ear, mainly, I think. But also arm ache; there are more ways of holding a phone on speaker than there are holding it to your ear.
Personally I wouldn't do it in the street but I do use a speaker phone when in my garden and in the countryside. It's a lot easier.
Preferably though, I use headphones.