Ben AdidaFeb 1, 2023

So OpenAI just released a detector of AI-generated text, I assume because of concerns in education / homework.

https://openai.com/blog/new-ai-classifier-for-indicating-ai-written-text/

Maybe this is good?

No, it's very bad.

They claim 26% true positives, 9% false positives. Assume 10% of submitted homework is chatgpt generated, you get the classic counterintuitive outcome of poor predictive power: if a homework is flagged, there's a 3:1 chance it's *human* generated.

This is going to cause a lot of harm. It should be immediately recalled.

New AI classifier for indicating AI-written text

We’re launching a classifier trained to distinguish between AI-written and human-written text.

Show threadKingsley Uyi Idehen

@ben,

It goes on, and on, and on...

Extreme reactions on both ends of the spectrum that always leaves unsuspecting innocents paying the price.

What happens to false positive victims?

SeeAlso, regarding the fundamental human problem:
https://people.well.com/user/doctorow/metacrap.htm#2.1

#Technology #Society

Metacrap

Feb 1, 2023 at 1:27pmSemaphore