Dan Conway (@magisterconway.bsky.social)

So, um... this is bad. Really bad. I looked at the letters that were translated by the AI, and the very first one I found was almost entirely hallucination. Thread: [contains quote post or other embedded content]

Blacksky

"AI" users are like, "I know this is imprecise but as a convenience these transcriptions are better than nothing"

then 70 years from now we'll still be struggling to debunk these entirely hallucinated transcriptions of thousands of manuscripts that were pissed into the pool of human knowledge.

some things are worse than nothing. "signal-shaped noise" is worse than nothing.

@elilla My job has us watch these training videos on "AI" 🤮 The presenter actually said something to the effect of “Now, you shouldn't trust the output blindly, but if you try, you will find that the “AI” is almost right most of the time”. So it's either worse than a coin toss (“almost most of the time” < 50 %), or it's most often “almost right”. That slip-up reveals a lot.