In a conversation with a colleague yesterday I finally figured out how to explain something:

so I've talked before about how LLMs can be thought of as a linguistic reflection of what Husserl called the natural attitude: the patterns of how language is used, things are described, all the shorthands in meaning we use

that's why they work as "cliche" generators, able to produce text that fulfills the patterns of various kinds of text: you can produce language that has the form of a research paper, a YA dystopia, a book for kindergartners

and this isn't even a negative judgment, I do think the tech has uses, but this is just literally what it does

so again I've written about all of that in more detail elsewhere

so what's the new insight?

that it's the opposite of poetry

it specifically hit me that poetry is all about getting around the natural attitude, it's non-literal use of language in unexpected ways to convey phenomenal experience as directly as possible

@left_adjoint I'm obsessed with this; I think this is such a spot on insight, and like...yes!? YES!
@left_adjoint Ashbery can sound like an LLM at times
@left_adjoint That's really interesting, thanks! I've been toying with the idea of LLMs as a sort of angel of history (ala Benjamin), staring back at the chaos and piecing together 'meaning'. Not sure if that makes sense though.
@left_adjoint This is an interesting point - you can ask it for poetry, and some people might even like the result, but ultimately it just uses a lot of "this is a poem" signifier cliches in order to do so. To me, this applies more widely to writing, since cliched writing is bad writing: LLMs can write a coherent, 'functional' explanation of something but the writing is never good.

@tomw yeah what I've been trying to detangle in this in-progress monstrosity is the fact that it seems effective for certain kinds of explanations and tasks but not others

https://tildegit.org/left_adjoint/class-notes/src/branch/main/llm-introduction/intro.org

one thing I haven't included yet is that we should think of it as being more like CLIP than not despite them being very different technical mechanisms

class-notes

primarily .org files for classes I'm writing

tildegit