@eevee
> I feel like I get a little dumber every time I accidentally start reading it [LLM output]
so much this!!
@eevee
> [The attitude about LLMs] feels like the same attitude that happened with Bitcoin, the same smug nose-wrinkling contempt. Bitcoin is the future. It’ll replace the dollar by 2020. You’re gonna be left behind.
> What do programmers get out of this?
I think you've struck something deeper, not tied to vested interest.
Isn't this similar to the smug "I use Arch btw" ?
I think I've seen this much earlier, in non-IT context, but I can't recall an example...
religion? 🤔
@eevee
Also you wrote that the LLM hype is rooted in the idea that "doing things is worthless".
To me that sounds awfully like burnout / depression / learned helplessness.
So maybe that's where this comes from? Maybe people have been doing tedious work without seeing any purpose or meaning in it, they got burned out, and now they want a machine to do that job for them...
> What are you all even writing that so much of it consists of generic slop?
IMO many jobs are like that :(
Also, pressure to get the thing to work no matter what is such a killjoy.
It can be external, but it can also be internal - when you know a lot of people rely on you, they don't need to tell you, you just know it.
It makes it seem like the result is all that matters, and then the process itself is no longer enjoyable.
@eevee Your post is 🔥!!!
I'm still holding out hope that the bubble will burst sooo hard before my kids get into school. My head is close to falling off from all the head shaking whenever I read about the shit that's going on schools and universities with LLMs.
I hate the "whatever machine" with the passion of a thousand burning suns. 😬
@eevee I had the strangest experience entering a comment on your post, using firefox for android on a pixel 2, using a really old version of (now Microsoft) Swiftkey (I'm afraid to update anything b/c of business-driven regressions like llm feature tumors)
entering text at the front reversed it character by character & reset the cursor to before the text, unless I typed too fast (I did the first line very slowly w/ much do over). entering text elsewhere or newline caused strange duplications.
@eevee "I mean, I get it. I was trying to do something that had never been done before. LLMs are fine at things that appear a zillion times in their training data — in fact, this is probably a big part of the trick, because the things that appear more often in their training data are the things people are more likely to ask about in general and thus the things people are more likely to ask an LLM."
I've tried to explain this sometimes and people don't seem to get why this makes it useless 😑
@eevee the devaluing of creation really is the crux of it, because that also stops adoption of these things for whatever stuff there actually is they could be useful for by saying "they can do everything for you". we'll likely not see actual uses for these things until the entire current cycle dies down, and at that point they will likely be so constrained that they're not recognisable as 'ai' tools.
like, i sometimes do single-pass image-to-image runs on digital paste-up artworks i try to do, so i have something to paint over without having to repeatedly hunt for the right colour combinations for shadows and such, which i'm really bad at. in that case it acts like a photoshop filter. that's where i see this entire thing going once the hype dies.
@eevee more like one-and-a-half; since the process basically "de-blurs" an image from noise, i can add random noise to my own image and tell the model "okay we're on step 15 of 20, deblur the rest".
the fact that it's basically impossible to avoid plagiarism is why i only do these for myself, as experiments. i don't want to put more slop on the web.
@eevee but yes, it does still go through clip and the feature database, and still requires a prompt. it just skips most of the actual generation.
sometimes it can be fun to just give the model shapes and get it to find things in them, cloud gazing style, like the google thing that saw dogs everywhere.
@eevee it's Guided Whatever. so it's basically the same thing as all the chatbots everyone is getting, but for images.
tangent:
other than doing art experiments just for me, i'm currently studying llms at work so i can stay employable, and going through the code of these systems is depressing. like, i don't have the math brain to actually decipher the vector calculus at the base of the system, but i can churn through all the structure of the system, and... there is none. no organisation, no security consideration, no nothing. it's all research code that escaped.
in no other production ready system have i encountered a function named essentially "load_local_file" which, when called with a string argument representing the path of a local file, does a http call to a proprietary service with an api key embedded in the library, that basically only _looks at the file name_ and says "ok here is 5 GB of extra files for that one file".
deploying these systems in secure contexts (which i know people do) mus be a nightmare.
Bullshit makes
the flowers grow
& that's beautiful.
AI slop can't do that.
(v0160 (EXT (ST
"(for context, watch the old SICP lectures where they spend way too much time closing brackets)" )))
@eevee Bitcoin will never be good at being a real currency. The value of it is too unstable. Transactions take too long. Whoever controls the most/biggest mining operations controls the ledger. These are all things caused by it's design which prevent it from being useful currency.
Unfortunately, I think the problems with payment processors is a political problem not a technological one.
> This is why I absolutely cannot fucking stand creative work being referred to as "content". "Content" is how you refer to the stuff on a website when you're designing the layout and don't know what actually goes on the page yet. "Content" is how you refer to the collection of odds and ends in your car's trunk. "Content" is what marketers call the stuff that goes around the ads.
Yes! Argh! I sooo feel this!