Probably the critics of anarchism that I take the most seriously are survivors of decentralized genocides or warzones who tend to become staunch conservatives upon immigration to western democracies. They may recognize shit sucks, but also assume any boat rocking will return society to a much worse baseline.
Among radicals, revolutionaries and other critics of the status quo there's a general lack of awareness of *how much worse things can be* and I think factoring such in is important.