fne8w2ahOpenAI discontinues its AI writing detector due to “low rate of accuracy”
FantasticFoxUsually you check this sort of thing before releasing it…
And once you release the LLM detector it becomes a training tool for LLMs and those creating them to fool the detector.
It is like the battle between google search and SEO tactics, except at hyperspeed.
Lol well that’s moderately terrifying
Raisin8659Yeah, you should have checked it before you ruined all those poor students’ lives.
lasagnaRicher people have been paying for their bonuses all along in terms of premium tutoring and essay writing. But now that poor people can do it too we suddenly find ourselves in a problematic situation.
Also disproportionately inflicting false positives on neurodivergent students.
If I was a student who wrote a text that was rejected due to this tool, do I have a case against either my institution, the professor who threw it out or OpenAI?
experbiado I have a case against either my institution, the professor who threw it out or OpenAI?
This all seems like such recent technology, I can not imagine this question being very answerable except via the long way: a courtroom. I suspect it would take someone trying in order to set precedent.
Turnitin isn’t AI technology but I assume it has similar legal ramifications and a lot of schools require teachers to have everything go through turnitin (usually by having students submit online). It just spits out a percentage so that the prof can take a closer look. Real quotes count towards the percentage displayed. Maybe with AI you’d have a bit more of a case against the company because you might claim you trusted it to be accurate or something?
There’s a similar issue in chess with cheating detection. They use statistical analysis to see if someone’s moves are too good. Computers play at a much higher level than humans and you can measure how “accurate” a move is.
It doesn’t mean much for a few moves or even 1 or 2 games but with more data you get more confidence that someone is cheating or not cheating.
Chess.com released a rather infamous report last year about a high profile chess player that was cheating on their site. They never directly said “he is cheating” but simply stated “his games triggered our anti-cheating algorithms”
One is debatable, the other is a simple fact. The truth is an absolute defense to defamation.
I’d imagine these AI detectors for schools have similar wordings to avoid legal risk. “High probability for AI” instead of saying “AI written”. In that case, you may have very little case for defamation.
However, I’m not a lawyer. I’m just guessing these companies that offer this analysis to colleges have lawyers and have spend time shielding the company from legal liability.
I have only heard about this tools, but never used one for myself… Are there any other tools like this?
None that work from my understanding at least.
Some work ok-ish on long texts, but none are reliable enough to not produce false positives. Might be worth using it as one bit of evidence amongst others for stuff where it really matters, like some master/PhD thesis, but definitely not for Jimmies 8th grade essay about Lincoln.
ArotriosAnd an entire generation of students breathed a sigh of relief...
FaceDeerThey shouldn't, their profs are now going to use whatever random crappy website comes up first when they google "AI detector."
Because all LLM outputs read like middle school homework essays regardless of context
AI writing detectors are so shit. One of my written assignments was flagged as being written by AI even though at the time of writting it, programs like ChatGPT was not even popular or mainstream.
Yep, I think there should be a revolution in regarding how teachers structure their assignment for their students. AI is here to stay, and the education system needs to find a way to coexist with AI. In order to survive, education system need to find a way to make AI usage like calculator usage when working with math problems.
outrageousmatterExpect when you got teachers “Memorize all the formulas as it’ll be on the test.” and they don’t provide the formulas even though in the real world, they just fucking look it up.
If I started an AI chat bot that was capable of sounding human, why wouldn’t I make a crappy AI writing detection tool and then shut it down shortly afterward saying “my AI chat bot is too good! You can’t detect it!”
Don’t forget wanting to introduce regulations for AI because it’s “dangerous”, but no not mine, mine is the good one.