Yes, Critical Race Theory is "just a theory."
But a theory is nothing more than a model explaining observed facts in the least complicated way possible.
If there is a better theory about how minority races have been treated historically in the US, I have not heard it.