Meta science project on the transparency in research products sampled randomly from the Knowledge Infrastructure for Nonprofit and Philanthropic Studies (KINPS). How do publications in nonprofit and philanthropic studies report on the type of data they report on? What are the characteristics of samples and measurement instruments used in research? Which research designs and methods are used in the analysis of data? To what extent do publications describe the generalizability and validity of observations? Which criteria do publications use to support the methodological quality of research in nonprofit and philanthropic studies? Hosted on the Open Science Framework
Within the current peer review system, here are some things you can do to write developmental reviews:
1. Be honest but constructive. You are not at war. There is no need to burn a paper to the ground.
2. Identify problems and suggest ways to repair them.
3. Avoid addressing the authors personally.
4. Look beyond bad writing style and typos.
This stuff and more at
https://osf.io/7ug4w
Upcoming talk at the #ARNOVA22 conference:
Raising the Bar in Peer Review
https://renebekkers.files.wordpress.com/2022/11/221118_raising-the-bar-for-peer-review-in-science.pptx
The added value of journals organizing peer review is quality control.
I identify problems in the current system of peer review, and propose to introduce registered reports and use artificial intelligence to screen the quality of submissions.