@llimllib only if you've set the privacy level appropriately too (https://docs.joinmastodon.org/user/posting/#privacy).

Just writing a post that @-mentions someone else does not change the privacy level.