sofiaJul 22, 2025
A shitpost that's been brewing in my head for a while now
Show threadPiko Starsider Jul 22, 2025

@sop I paused on every single message because it's golden. That's what we get when we let corporations spoon-feed us whatever shit they want.

Out of curiosity I've loaded an open source LLM I have around, to see how it autocompletes from "fuck" onward, and even without "fuck" it's negative every single time.

What is crazy to me is that people is letting their data be constantly sent over the internet to who knows where, all to get a useless prediction.

Show threadsofiaJul 22, 2025
@starsider yeah, I obviously didn't use an actual LLM in the making of this post. I tried a little! The results were, uh, let's call them uninspired, and also not representative of my experience dealing with this feature in code editors
Show threadPiko Starsider Jul 22, 2025
@sop I didn't ask the LLM to do anything, instead I tapped into the raw underlying text completion of it. No "user" and no "assistant", just literal autocomplete.
Show threadsofia
@starsider cool. if I may ask, what tooling did you use for this?
Jul 22, 2025 at 9:25pmWeb
Show threadPiko Starsider Jul 22, 2025
@sop llama.cpp server, mikupad and OLMo-2-1124-13B-Instruct (Q4_K_M gguf), but for text completion I would suggest koboldcpp instead which is easier to use and includes a text completion in its web UI (called "story mode" if I remember correctly).