The uncommitted movement will, in fact, be called for the general election - by assholes who just want Biden to lose.
You can ignore them. But they will be there. And the mouth noises they make will be based on sincere and reasonable criticism.
The thing about objecting ‘we can’t do [blank] because conservatives will abuse it in bad faith’ is, conservatives will absofuckinglutely abuse [blank] in bad faith. Probably whether or not we do it. That part of the objection is real - even if we should still do [blank]. We can only do [blank] in spite of them.