@scalzi I can't find the paper now, but Microsoft Research once called that error-ridden spam as a "reverse pons asinorum".
A pons asinorum is metaphorically a demonstration that a student is ready for more advanced work (Euclid's Fifth Proof). Error-filled spam reverses this idea, showing who is most gullible and easily fooled.
The Microsoft paper notes that scammers face costs and must expend effort. Best to use the spam to weed out those who won't be fooled and target the easy marks.
I knew about the mechanism but thank you for putting a term to it.
Actual use for LLMs: to massively respond with pretend interest to spammers, increasing their vetting costs a thousand fold, rendering their business no longer viable
@bulletsweetp @scalzi If LLMs can be used that way, scammers would also use them to reduce their costs to pull people into the con.
At some point, we'd just get LLMs trying to con each other.
@paper_clip @scalzi The paper is here:
False positives cause many promising detection technologies to be unworkable in practice. Attackers, we show, face this problem too. In deciding who to attack true positives are targets successfully attacked, while false positives are those that are attacked but yield nothing. This allows us to view the attacker’s problem as a binary classification, and use […]