💯 “Decisions made by the general public about emergent technologies depend much more on what that public attributes to such technologies than on what they actually are or can and cannot do.”
@fishidwardrobe @stevenf Yes, of course it’s quite probable that I don’t express myself clearly enough (as you noted).
The thing I think I object to is the “people don't understand language entirely”, because as a linguist, I define language loosely as “the thing that people understand”, and that’s why I found your reasoning “reversed”.
If it’s “people don’t understand everything everyone says”, then that’s trivially true: not all humans know all languages, not all subjects, etc.
@ahltorp @stevenf Well, no. I don't think Weizenbaum is saying either of these things. He's saying that even given a common language and subject, people STILL often fail to understand each other, because they have a different context for the same words and phrases.
For example, the word "woke" will have very different connotations for you depending on your politics. But essentially it still means the same thing.
And of course a computer program can have no understanding of it at all.
People have an incredibly strong cognitive bias toward ascribing personhood to phenomena. It's why we assumed that there had to be a thunder god behind the thunder. It's why people project complex cognition onto their pets. It's why I call my Google Home voice assistant "she".
With systems that can mimic personhood as well as current AI, most of us don't stand a chance of avoiding this misperception. And they're going to keep getting better.