It’s the difference between believing the pyramids were built by Egyptian gods, and believing they were built by aliens. It just doesn’t fit the swashbuckling source material the other Indiana Jones movies were built on. Same reason time travel didn’t work as a plot device.