Dan Conway (@magisterconway.bsky.social)

So, um... this is bad. Really bad. I looked at the letters that were translated by the AI, and the very first one I found was almost entirely hallucination. Thread: [contains quote post or other embedded content]

Blacksky

"AI" users are like, "I know this is imprecise but as a convenience these transcriptions are better than nothing"

then 70 years from now we'll still be struggling to debunk these entirely hallucinated transcriptions of thousands of manuscripts that were pissed into the pool of human knowledge.

some things are worse than nothing. "signal-shaped noise" is worse than nothing.

@elilla

Thing is, our myths and literature have been telling us this for millennia!

*All* the oracle stories involve an oracle saying something ambiguous which the protagonist dangerously misinterprets. It will always be mushy, you'll always choose the wrong interpretation, and it will always be your fault. In that sense, saying "you have to check the AI result" is a threat, meaning the AI is free to make mistakes, but you will be held liable.

This is not positive information; it is almost *negative* information in that we still don't know the truth, but are tempted into dangerous fantasies of mis interpretation,

We've even turned the whole mess into a cautionary tale with the "ibis redibis" story of the oracle at Dodona, a caution heeded nowadays by almost nobody:

https://en.wikipedia.org/wiki/Ibis_redibis_nunquam_per_bella_peribis

Ibis redibis nunquam per bella peribis - Wikipedia