When it comes to narratives surrounding muslims, ex-muslims and many other minority groups, it is talking about people, not with people.
"Nothing about us without us" is the principle in which we conduct communication about religious beliefs. Often, anti-muslim rhetoric, including that of ex-muslims pertains to projection of certain interpretations of religions beliefs. Likewise, this happens between muslims and from muslims to non-muslims.