Is it possible for experiments with 23,000 subjects to be underpowered for plausible, potentially important effect sizes?

Yes.

Here with more subtle discussions of the recent Facebook/Instagram experiments
https://tecunningham.github.io/posts/2023-07-27-meta-2020-elections-experiments.html