@Ryder So I think talking about that end of it, it's basically like Dennett's "intentional stance" - For humans, at some point a system becomes complex enough that it's easier (and effective) to explain it using theory of mind principles.
But that's separate from the machine itself having enough meta-level awareness of its own functionality to 'transfer' that for use as the model of how a human is going to react, which is what I feel would be "theory of mind" in the machine.
@Ryder It wouldn't hurt, but isn't that Pandora's Box already open at this point? I think at least as helpful would be solutions that mitigate the geopolitical game-theoretic configurations that drive this arms race. You can tell countries to stop what they're doing, but 1. It's a Prisoner's Dilemma, so everyone wants to talk peace and then cheat; and 2. It's not just nation-states - this stuff is accessible enough that random groups can do it. Any ideas? What do people think?