Here's a draft blog post in dialog with ideas from @pluralistic on process knowledge and communicative intent, wherein I try to tie these concepts together.
https://monogr.ph/69e92950b5760cc244f822bd
Bad bosses, like AI vibers, don't know what they don't know. They fail to appreciate process knowledge, which I call the expertise byproduct, and don't appreciate the gaps in their communicative intent that their workers (human or AI) fill in for them.
@jakek @pluralistic This is very much why writing autonomous behavior specifications is hard.
Getting someone to explain *exactly* what they want the robot to do, under *precisely* which constraints and conditions, depends on the human knowing enough about the robot and about their own work to be able to pull that invisible byproduct knowledge out and make it visible - knowledge that frequently they don't even know they have.
Strongly agree. I've been working on the tech side of the newsroom as an engineer, and before that I was a data journalist and before that I was a shoe leather journo. I build stuff for reporters, not for bosses to fire them. And I'm constantly in awe of how much knowledge is baked into their workflow.
I've gotten very good at getting to product decisions with non technical people but it is a lot of work!
Jake
Robotistry