@WTL Explanations and communication can be improved, but it's not just a perception that setup and use is difficult, it IS measurably more complicated in several ways than using other social media.
I think the main obstacle is that inter-server interactions need to be made completely seamless for the user (with zero extra hassle) and moving to a different server needs to be improved starting with auto-import of your follows, not just follow-ERS.
@WTL Oh and posts... it also really needs to be able to transfer all your old posts automatically.
Ideally there should also be some kind of optional mechanism for having a full backup in case a server goes down suddenly, so you can still start over even if it's too late to move the normal way.
Without that there isn't enough stability to feel fully safe building up your social network here, if it can just disappear overnight because your server admin had a bad day, or life happened.