I sometimes feel the same,
@saper, but then remember that those people can just as easily contact or visit me, something that's taken me many years to get comfortable with as they always seem to expect me to call or visit them, something I don't do as much since I don't want to be in the place where they are, though I'd love to spend time with them elsewhere.