Mark RiedlAs many suspected:
“Midjourney Founder Admits to Using a ‘Hundred Million’ Images Without Consent”
Ryan Moulton@Riedl CLIP did too though.
Advadnoun@moultano I'm getting probably close to using 1 million images with my brain, personally. Is that better or worse?
@Adverb I don't know. I'm mostly staying out of the ethics of all this because I don't want to be subpoenaed in some future litigation against my employer, and because I find it all genuinely confusing.
@Adverb Every analogy people make requires AI art to be "like" something else, and we're just arguing about which thing it's "like." But I don't think it's like anything else.
@moultano it's fair to say that analogy is not exact here (Dryhurst talks about this too), though I think the principle is the same on many fronts.
The scale could never be ofc.
@Adverb I would be happier if the models trained with differential privacy. I think that would be closer to the norms of inspiration that artists expect from each other.
@moultano
To the end of preventing memorization?
I feel like it's already past human artists in some ways by having a similarity-queryable dataset if people are worried.
And that post by OpenAI on deduplication and (ironically) that one on Stable Diffusion's regurgitation that notes the imagenet LDE sees no significant memorization make me very not-worried about memorization.
Ted Underwood@TedUnderwood @moultano definitely: https://openai.com/blog/dall-e-2-pre-training-mitigations/
This one is a big deal!!!
https://arxiv.org/abs/2212.03860
And this one is frustrating but ironically reassuring given that they see dataset seems to be the primary problem/mitigator.
DALL·E 2 Pre-Training Mitigations
In order to share the magic of DALL·E 2 with a broad audience, we needed to reduce the risks associated with powerful image generation models. To this end, we put various guardrails in place to prevent generated images from violating our content policy. This post focuses on pre-training mitigations,
@TedUnderwood @moultano They LITERALLY CANNOT DETECT REPLICATION WITH IMAGENET!!! (Pardon my screaming.)
But nobody bothers reading the paper 🙃
Daniel Lowd@Adverb @moultano @TedUnderwood Yes, the framing in the abstract and intro doesn’t really match the results.
@lowd @moultano @TedUnderwood Yeah! Not to mention the model card for stable diffusion explicitly states this issue!
But due to this paper even some many many people think this was some hidden secret. Was having to argue over this with an ML industry person just yesterday.