I submitted a poster abstract to the #ICAME47 because I thought this would be the most low-key format to present work-in-progress, but then there were only four posters and we each got a four minutes after today‘s plenary in the large auditorium 😱Definitely more attention than I had envisaged, but I think it went well. I was done at 3‘59! ⏱️ Lots of encouraging feedback and interesting follow-up ideas! ☺️

Poster and abstract: https://linktr.ee/elefoll.

#CorpusLinguistics #linguistics #metascience
@corpuslinguistics

On 17 June, Sheena Bartscherer will be reporting online on her new project, “Reforming Science”.
The project is looking to investigate the different actors who are currently, but also historically advocating for science reforms, how they discuss these matters publicly, how critiques are interacted with, and how they organise themselves.

Further information and registration details can be found here: https://www.eventbrite.co.uk/e/metascience-research-seminar-dr-sheena-f-bartscherer-tickets-1989914011375
#Metascience #ScienceReform #NetworkAnalysis #SocualMediaAnalysis #LIS

1/ If you're following the debacle on the Democratic National Committee autopsy on the 2024 election, here's my #metascience take on the problem.

Why Kamala Harris lost in 2024 is an empirical question. It's a complicated empirical question with dozens, hundreds, or thousands of relevant factors. It's made even more complicated by the presence of background preferences and wishful thinking.

If we're not careful, it's a tangled mix of descriptive empirical questions (why did some previous Dem voters shift to the right) and normative questions (what should we do next time to prevent that). Here I'll bracket the normative questions and focus on the empirical ones.

When scientists address complicated empirical questions, we don't expect one researcher or team to identify all the relevant factors in one publication. We don't even expect the entire field to identify all relevant factors in one generation. We expect incremental advances. We expect many researchers to identify many factors over time, tussle over the empirical evidence for and against them, give different factors different weights, differ on which factors are most salient, and differ in how to take the most salient factors into account. And we do all that in public.

#Democrats #DNC #Metaresearch #USPol #USPolitics

🧵

Feminist Metascience, Risk-Averse Peer Review, & Can Systems Change Theory Strengthen Metascience?

#Metascience

https://open.substack.com/pub/markrubin/p/feminist-metascience-risk-averse?r=2bqjb7&utm_campaign=post-expanded-share&utm_medium=web

Feminist Metascience, Risk-Averse Peer Review, & Systems Change Theory

Feminist Metascience, Risk-Averse Peer Review, & Can Systems Change Theory Strengthen Metascience?

Critical Metascience
New preprint: "A Framework for Reproducible AI-Assisted Research in the Social and Behavioral Sciences"
https://osf.io/preprints/psyarxiv/xdtqh_v1
#reproducibility #metascience #openscience
OSF

#ScholComm and #metascience folks beware that there's now a second #FAIR acronym. The first was Findability, Accessibility, Interoperability, and Reusability. The new one is Fairness, Accountability, Integrity, and Responsibility. It's an "ethically-guided hybrid #peerreview system" mixing #AI and human expertise.
https://www.degruyterbrill.com/document/doi/10.1515/jpm-2025-0285/html

Some recent #metascience work and news…

• Average replicability rates

• Theories don’t die!

• Is the replication crisis overblown?

• Postdoctoral Fellowships

• Partial replications

https://open.substack.com/pub/markrubin/p/critical-metascience-roundup-f3f?r=2bqjb7&utm_campaign=post-expanded-share&utm_medium=web

Critical Metascience Roundup

- Average replicability rates - Theories don’t die! - Is the replication crisis overblown? - Postdoctoral Fellowships - Partial replications

Critical Metascience

How can research findings be made more durable over time?

A Nature analysis highlights key strategies to improve reproducibility, replicability, and robustness across the social and behavioural sciences.

🔗 https://www.nature.com/articles/d41586-026-00965-3

#OpenScience #Reproducibility #Replication #ResearchIntegrity #metascience

More self-reflection in research can lead to better science

A package of papers looking at the social and behavioural sciences shows the value of researchers collaborating to further the cause of reproducible, replicable and robust findings.

Under the banner "The winding road to better science", we are joining forces with our metaresearch centre and are offering ourselves as hosts for potential MSCA postdoctoral fellows. If you are interested in developing a project on or across the boundaries of #metascience and #STS, reach out! 1/

#metascience What if we could study all grant applications—not just the funded ones—without compromising privacy?

Introducing MIGA: a minimal standard for open funding data https://doi.org/10.31222/osf.io/9hguf_v1

OSF