“ja” as an adverb/particle means approximately “as you know”, sometimes it can be translated “after all”. The idea is that he assumes they already know about him not being alone, he’s just reminding them of this. It does make sense without the “ja”, but doesn’t have the nuance that they’re already supposed to know this.