@slack2thefuture

When you create a post there's a globe icon in the bottom left to set who can see it, Direct Message is one of the options so only the person (s) you tag can see that post and any convo following it

If you add someone at a later date they can see the entire convo