Winter 2025 - Researcher positions in AI and machine learning — FCAI

Lessons for Theory from Scientific Domains Where Evidence is Sparse or Indirect - Computational Brain & Behavior

In many scientific fields, sparseness and indirectness of empirical evidence pose fundamental challenges to theory development. Theories of the evolution of human cognition provide a guiding example, where the targets of study are evolutionary processes that occurred in the ancestors of present-day humans. In many cases, the evidence is both very sparse and very indirect (e.g., archaeological findings regarding anatomical changes that might be related to the evolution of language capabilities); in other cases, the evidence is less sparse but still very indirect (e.g., data on cultural transmission in groups of contemporary humans and non-human primates). From examples of theoretical and empirical work in this domain, we distill five virtuous practices that scientists could aim to satisfy when evidence is sparse or indirect: (i) making assumptions explicit, (ii) making alternative theories explicit, (iii) pursuing computational and formal modelling, (iv) seeking external consistency with theories of related phenomena, and (v) triangulating across different forms and sources of evidence. Thus, rather than inhibiting theory development, sparseness or indirectness of evidence can catalyze it. To the extent that there are continua of sparseness and indirectness that vary across domains and that the principles identified here always apply to some degree, the solutions and advantages proposed here may generalise to other scientific domains.