AI or DEI? - Lemmy

This is fucking ridiculous. This AI is the worst of them all. I don’t mind it when they subtly try to insert some diversity where it makes sense but this is just nonsense.
They are experimenting and tuning. Apparently without any correction there is significant racist bias. Basically the AI reflects the long term racial bias in the training data. According to this BBC article it was an attempt to correct this bias but went a bit overboard.
Google to fix AI picture bot after 'woke' criticism

Users fault Gemini for generating diverse images in inappropriate historical contexts.

BBC News

Significant racist bias is an understatement.

I asked a generator to make me a “queen monkey in a purple gown sitting on a throne” and I got maybe two pictures of actual monkeys. I even tried rewording it several times to be a real monkey, described the hair and everything.

The rest were all women of color.

Very disturbing. Pretty ladies, but very racist.

I just tried it with Copilot and all four results matched the prompt. No humans. Which one did you use?

Stable diffusion online version, several weeks ago. Might not be the same situation anymore, idk how often that stuff gets updated.

It’s also possible that some sort of “sticky idea” got into its head and made it start generating it that way after it did one like that. I’ve heard that sort of thing isn’t uncommon.

Stable diffusion is a generative technology, not a model

To be clear, stable diffusion isn’t one model, it’s the generation platform. From there, you have models that sit on top of it. Online generators can use any model, depending on how they’re set up. Each model includes different training data, meaning different results from the same prompts, sometimes vastly.

It’s a bit like driving somewhere, having someone ask how you found the place, and saying your phone. Technically a correct answer, but they’re probably looking for more specific answers, like GPS, or a map. Not trying to nit-pick, just giving a bit of information.