9 Followers
25 Following
20 Posts
What's Special About Metascience?

I highlight a few points raised in Flipe Romero's (2023) recent presentation on “The conceptual origins of metascience,” and I provide some comments along the way.

Critical Metascience
What's Special About Metascience?

I highlight a few points raised in Flipe Romero's (2023) recent presentation on “The conceptual origins of metascience,” and I provide some comments along the way.

Critical Metascience
New Critical Metascience blog post:

"The preregistration prescriptiveness trade-off and unknown unknowns in science: Comments on Van Drimmelen (2023)”

https://markrubin.substack.com/p/the-preregistration-prescriptiveness

#Science
#OpenScience
#MetaScience2023
#CriticalMetascience
#Preregistration
The Preregistration Prescriptiveness Trade-Off and Unknown Unknowns in Science

I discuss Van Drimmelen’s (2023) Metascience2023 presentation on researchers’ decision making during the research process.

Critical Metascience
New Critical Metascience blog post:

"The preregistration prescriptiveness trade-off and unknown unknowns in science: Comments on Van Drimmelen (2023)”

https://markrubin.substack.com/p/the-preregistration-prescriptiveness

#Science
#OpenScience
#MetaScience2023
#CriticalMetascience
#Preregistration
The Preregistration Prescriptiveness Trade-Off and Unknown Unknowns in Science

I discuss Van Drimmelen’s (2023) Metascience2023 presentation on researchers’ decision making during the research process.

Critical Metascience

Vice-Chancellor Salaries

More than half of New South Wales vice-chancellor salaries go up as their universities' financial performances go down!

https://www.theguardian.com/australia-news/2023/jun/01/nsw-vice-chancellors-get-big-pay-bumps-despite-universities-plunging-into-the-red

#HigherEducation
#HigherEd

NSW vice-chancellors get big pay bumps despite universities plunging into the red

Critics say million-dollar salaries are ‘wildly out of touch’ as annual reports show some academic chiefs got $200,000 raise last year

The Guardian
@MarkRubin very interesting, if only because counter narrative to what a lot of chatter says about peer review ("useless", "perverse", "senior people just comment on a whim" etc)
@tomstafford Yes that’s the bit I picked up on, but @nicebread has some good points about the overall low rate of rejections of subsequently retracted articles (8%), plus the lack of a control group prevents clear conclusions.

https://scicomm.xyz/@nicebread/110433598047017750
Felix Schönbrodt (@[email protected])

@[email protected] @[email protected] I have a less positive reading of the results: Only 8% of reviews recommended rejection of to-be-retracted papers - but 10% of reviews mentioned the retraction issue with a praising tone! And most importantly: w/o a matched control group of non-retracted papers, we have no idea whether 8% of recommended rejections are diagnostically relevant. Maybe the non-retracted papers had >= rejection recommendations? Maybe more senior reviewers reject more papers in general?

A science community for science communication.
Peer Review and Article Retractions

New study of 260 peer reviews finds that expert and senior reviewers are more likely to identify issues in manuscript submissions that later lead to article retractions.

https://doi.org/10.1016/j.joi.2023.101423

#Science
#MetaScience
#MetaResearch
#AcademicChatter

The Illusion of Generalizability

"Although the project recruited 171 researchers from 109 institutions, and 13629 research participants speaking 40 languages across 61 countries, we argue that relying solely on the typical big team methodology created an "illusion of generalizability", leading authors to overestimate the extent to which research findings can be applied globally."

Preprint: https://psyarxiv.com/avcsp/

🦣 Authors: @psforscher, @hcp4715

#MetaScience
#CrossCulturalResearch
#ManyLabs

@MarkRubin It is still the most read article with over 11,500 views. Truly impressive!