If he gets heated in any way, if he demands his frame be activated, rather than respond to anything, what I will say is this
"Every other women in this office you treat with respect, and you treated me with respect as well for a year. But all it took was the faintest rumor for you to decide you can define who I am.
What that tells me is that EITHER you never had any respect for me in the first place, or that you are a threat to EVERY woman in this office unless we conform to whatever ideals you have about what we should be for you."