Fair but also I think we should consider that we may be among the first intelligence with the technical capabilities that allow us to build and reach the stars to arrive on the stage in our galaxy.
Another important factor I never see mentioned here, that I think needs to be another layer to the Fermi Paradox, and which I've been writing into my books, is what I've coined as "relativistic fracture." The fragmentation of a galactic civilization is inevitable when physical bodies are moved through the medium of spacetime. The effects of time dilation are inevitable, and there are a lot of factors that come into play as to whether or not a civilization can survive that as a single unit. The two obvious survivability factors would be a civilization that is nomadic and travels together OR a post-biological civilization that can transmit body controllers via lasers and data to come online in faraway places.
This is why I always say that post-biological civilizations and true machine intelligence is the evolutionary endgame for galactic survival. As far as intergalactic, that's a whole other story.