There's only one problem with a lot of individualist lenses on liberty and self-determination: it assumes all bodies and minds are equally capable of the same things. This is ableism.
What we need to do is realize that there is value in shared responsibility; that we must not only protect ourselves from external (material, social, and emotional) threats, but protect others from the threats we present to them, too.