This really drives home something about LLM systems. They’re very expensive to run, both to train and per-query, and hard to make cheaper. I expect them to get more expensive to run. They’re currently sold at a big loss to establish monopoly power and then raise prices dramatically. That’s the *stated* business plan.

If you’re building your business to rely on LLM, you need to factor in what you‘ll do when they pivot to making money, or they pull back because they can’t.
https://geeknews.chat/@theregister/112116266764229145

The Register (@[email protected])

Microsoft promises Copilot will be a 'moneymaker' in the long term Exec tells investors to 'temper' expectations as mission to convince customers of price tag continues Microsoft is asking investors to "temper" expectations for quick financial returns from Copilot amid efforts to convince customers that paying "substantial" sums each month is actually worth it.… #theregister #IT https://go.theregister.com/feed/www.theregister.com/2024/03/18/microsoft_copilot_moneymaker/

Geek News Central Mastodon Chat
@cocoaphony thank you, I have felt weird that nobody else seemed to be noticing this particular aspect yet. there are applications (i.e.: fintech, bioscience) where customers will happily pay through the nose because the model is doing something truly useful and difficult to automate with other means, but _so_ many uses are going to be instantly vaporized when users look at the "sign up to get more prompts!" speedbump and go "eh,, it was a neat demo, but I don't know if it's worth money"