I think the only reason people keep being impressed by LLMs is because of their scope, which is larger than most people's knowledge. For most people what seems to be impressive is that LLMs show them -their own- Out-of-Distribution issues and limitations. While for a domain specialist LLMs, within their domain, will hit Out-of-Distribution problems quickly.
