Jeff Greene

This is an adequate introduction to some of the issues prompting Open Science & other research reform movements. If it inspires people to look further, great. But I wish it went deeper into the need for better theory, measurement, design, etc (i.e., beyond p-values & HARKing). Also, structural issues re: peer review must be addressed (e.g., fewer tenure track faculty who gain value from reviewing).

https://www.chronicle.com/article/how-shoddy-data-becomes-sensational-research

#education #psychology #educationalpsychology @edutooters @psychology

Opinion | How Shoddy Data Becomes Sensational Research

Academics are addicted to p-hacking, data torturing, and other statistical sins. We must break these habits.

The Chronicle of Higher Education
Jun 8, 2023 at 10:21amWeb
Show threadJeff GreeneJun 8, 2023

For #education and #educationalpsychology researchers interested in learning more about Open Science, there's a great special issue of #educationalpsychologist guest edited by Hunter Gehlbach and Carly Robinson on the topic: https://www.tandfonline.com/doi/full/10.1080/00461520.2021.1898961

@edutooters @psychology

From old school to open science: The implications of new research norms for educational psychology and beyond

Recently, scholars have noted how several “old-school” practices—a host of long-standing scientific norms—in combination, sometimes compromise the credibility of research. In response, other schola...

Taylor & Francis
Show threadJeff GreeneJun 8, 2023

And for some of my thoughts on how #theory development can and should contribute to open science and other research reform in #education and #educationalpsychology see here: https://link.springer.com/article/10.1007/s10648-022-09682-5

@edutooters @psychology

What Can Educational Psychology Learn From, and Contribute to, Theory Development Scholarship? - Educational Psychology Review

One of the field of psychology’s stated goals is to produce scholarship with findings that benefit the world. Over the last 10 years, psychology scholarship and its presumed societal benefits have been called into question due to the field’s history of questionable research practices, racism, and epistemic oppression. Calls for methodological, ethical, and practical reforms are essential to building a psychological science that is just, effective, reliable, and beneficial. Recently, these calls have been complemented by a push to reform how theory is developed and used in psychology. There is great need for better understanding and implementation of theory development, both in the field of psychology broadly as well as in its subdisciplines, including educational psychology. At the same time, educational psychologists have much to contribute to the tripartite calls for methodological, ethical, and theory reforms. In this paper, I explore theory development in psychology by discussing the importance of developing both the descriptive and explanatory aspects of theory as well as the need to refine how theory is evaluated and integrated. Then, I review how innovations and practices in educational psychology can inform the broader theory reform movement in psychology writ large. Finally, I identify important future directions for further advancing theory reform in psychology, including addressing ableism in the field, increasing the field’s hospitability for theory revision, furthering theory development transparency, and more deeply integrating theory development into preparation programs.

SpringerLink