Mastodawn

@Riedl CLIP did too though.

@moultano I'm getting probably close to using 1 million images with my brain, personally. Is that better or worse?

@Adverb I don't know. I'm mostly staying out of the ethics of all this because I don't want to be subpoenaed in some future litigation against my employer, and because I find it all genuinely confusing.

@Adverb Every analogy people make requires AI art to be "like" something else, and we're just arguing about which thing it's "like." But I don't think it's like anything else.

@moultano it's fair to say that analogy is not exact here (Dryhurst talks about this too), though I think the principle is the same on many fronts.

The scale could never be ofc.

@Adverb I would be happier if the models trained with differential privacy. I think that would be closer to the norms of inspiration that artists expect from each other.

@moultano
To the end of preventing memorization?

I feel like it's already past human artists in some ways by having a similarity-queryable dataset if people are worried.

And that post by OpenAI on deduplication and (ironically) that one on Stable Diffusion's regurgitation that notes the imagenet LDE sees no significant memorization make me very not-worried about memorization.

Ted Underwood Dec 22, 2022

@Adverb @moultano I should already know those, but if you wanted to toss in a couple of links I would bookmark them.

@TedUnderwood @moultano definitely: https://openai.com/blog/dall-e-2-pre-training-mitigations/
This one is a big deal!!!

https://arxiv.org/abs/2212.03860
And this one is frustrating but ironically reassuring given that they see dataset seems to be the primary problem/mitigator.

DALL·E 2 Pre-Training Mitigations

In order to share the magic of DALL·E 2 with a broad audience, we needed to reduce the risks associated with powerful image generation models. To this end, we put various guardrails in place to prevent generated images from violating our content policy. This post focuses on pre-training mitigations,

OpenAI

@TedUnderwood @moultano They LITERALLY CANNOT DETECT REPLICATION WITH IMAGENET!!! (Pardon my screaming.)

But nobody bothers reading the paper 🙃

Ted Underwood Dec 22, 2022

@Adverb @moultano Yes, actually I do remember reading that paper and thinking "hmm — if I'm reading this rightly it's only a problem for small models." But no one talked about it that way so I thought I was crazy.

Advadnoun

@TedUnderwood @moultano at this point it's a tidal wave of "For real?" wherever I go :(

Ted Underwood Dec 22, 2022

@Adverb @moultano And then in the last section they introduce a concept of "style copying" which seems to muddy the waters rather a lot.