"LLMs are here to stay," is like saying that the modem-based internet of the 90s was forever. It was a largely unusable piece-of-shit tech that was manifestly incapable of delivering beyond a fraction of what the dot-com bubble promised, but it prompted investment in fixing the one thing that prevented that promise: bandwidth.