mccThere *has* been a lot of talk about the problems with so-called "AI" but one I don't feel gets enough attention is that "AI" products are surveillance products. "AI" is inevitably run in a cloud service, and in order for the AI to know what to generate some amount of the context within your application— usually it's not clear to the user what context, or how much— has to get sent to the cloud. The more of my local app state that gets transmitted over the Internet, the less comfortable I am.
abadidea@mcc for the record I do have ollama installed locally on my m3, which I would characterize as one step above “consumer grade”, and it works fine, and it’s possible to use visual studio code plugins or whatever that talk to it directly locally. so it’s not fully inevitable imo, just clearly in capitalism’s interest to take the surveillance route
my husband is a lawyer and his firm only uses software that it’s possible to install in a private server on-prem, often paying quite a lot for such a license, including an llm-based translator. so there is a market developing for private local AI nerve centers
Jo Shields