Alphane MoonMicrosoft CTO Kevin Scott thinks LLM “scaling laws” will hold despite criticism
Microsoft CTO Kevin Scott is of course not a reliable source due to conflict of interest and his position in the US corporate world.
If anything, the fact that he is doing damage control PR around “LLM scaling laws” suggests something is amiss. Let’s see how things develop.
MajorHavocYeah. There’s a very narrow corner that demands huge models, and that’s use cases where there’s no room for mistakes. That space is exciting, but also deeply bogged down in uncertainty, due both to laws and as-yet-undelivered, but 100% certainly coming-soon, law-creating-disasters.
Everywhere else, I suspect we’ve seen as good as we’re going to get, from current generation AI.
They know this too, but there’s not much interesting on the table to “bet the farm” on to court “swing for the fences” investors (gullible suckers) right now.