If you’re passing them off as just regular people nbd in that setting then yeah that’d be inaccurate.

Then again, plopping in random white people into an Ancient Chinese setting would be pretty inaccurate too, even though there might’ve been “some non zero number” of whites over there at the time. Or in a random crowd shot of Nazi soldiers you plop in a few black soldiers. Certainly existed, but it does make it seem inaccurate (and silly imo).