To be fair they lived 5ft away, it may as well have been one big apartment.
Ross doesn’t live in the same building. Later on he moves into the building across the road from them though.