If you want a big tent, you need to push out the assholes. Otherwise, the only people who remain in your tent are the assholes and people not attacked by the assholes.
See how this naturally gives a lot of power to the assholes? When you allow assholes, they decide who remains in your tent, by pushing out those they don't like.