We argue that when discussing “understanding” in phil sci and epistemology philosophers have overlooked its predictive aspect - one that practitioners of science refer to systematically. Text mining allows the discovery of concepts and enables a broad look on how they’re used. And what’s more, such concepts may be useful for current debates - as we argue predictive understanding is for explainable AI!