Today, the large-scale SCORE program publishes its primary findings—865 researchers examined reproducibility, robustness, and replicability across the social and behavioral sciences, testing how well humans and machines can forecast replication outcomes.
Results are out now in three papers + five preprints published in Nature.

📑 Explore the papers: https://www.nature.com/collections/idajfifcfg
💡 Read more about SCORE: https://www.cos.io/score

#metascience #openscience

Any bright ideas out there? 💡 Here's an "essay competition inviting active scientists from any sector to share concrete research challenges that you hypothesize are caused by broad structural or systemic bottlenecks in science, and experimental strategies to fix them": https://astera.org/essay-competition/. The first prize is 30,000$!

EDIT: Please read @ced's reply below. It turns out "active scientists" don't include economists, sociologists, psychologists, historians, and presumably anyone else doing social sciences and humanities research! 🤬

#academia #science #AcademicChatter #metascience

Critical Metascience Roundup

Update #2 highlights work on:

- Barriers and enablers of reproducibility

- Cataloguing open research practices in the humanities and social sciences

- Reconsidering reproducibility and questionable research practices in animal-based biomedicine

- Naming individual studies in metascience work

https://open.substack.com/pub/markrubin/p/critical-metascience-roundup

#Metascience

A quick report by me on running a randomisation process to distribute emergency research funds, now on the @RoRInstitute substack

https://researchonresearchinstitute.substack.com/p/bingo-partial-randomisation-for-emergency

#ResearchFunding #Metascience

Come work with us!

Postdoctoral researcher position in metascience on the UKRI-Funded PRIME project (Bath U), evaluating & implementing results‑blind peer review & translating evidence into policy & practice.

FT/PT flexibility possible

Details: https://www.bath.ac.uk/jobs/Vacancy.aspx?ref=ED13505

#metascience

RE: https://fosstodon.org/@researchsoft/116245545044086743

If you are interested in any aspect of #ResearchSoftware, including #RSEng, #funding, #publishing, #training, #metascience, #policy, etc., please consider submitting a proposal to and/or attending #IRSC26 (immediately before #RSECon26 in Sheffield, UK, in Sept). We're trying to bring all elements of the #ResearchSoftware community together

#statstab #504 Likelihood Ratio Test for Publication Bias

Thoughts: Interesting idea for a problem many of us think is present, but is hard to measure.

#likelihood #publicationbias #QRPs #metascience #metapsychology #metaresearch

https://freestylerscientist.pl/projects/likelihood-ratio-test-for-publication-bias/

RE: https://flipboard.com/@wsj/business-b1985f4jz/-/a-T6_YAnIFSTSuzZdNlac-EA%3Aa%3A248213600-%2F0

“Instead of paying humans to join focus groups and complete surveys, #Auru uses thousands of #AI agents, or bots, to simulate human responses. It feeds #demographic and psychographic information into its models to create human profiles that match clients’ needs, and the results those bots spit out are being used for product #development, #pricing, identifying new customers and political #polling.”

Researchers have warned about the inaccuracies of treating #LLMs as human proxies (https://doi.org/10.1007/s10462-025-11297-5), but I wouldn’t be surprised #languageModels beat #qualitative interpretation of non-representative focus groups.

#marketing #psychometrics #statistics #quantMethods #philSci #metascience #business