RE: https://fosstodon.org/@researchsoft/116245545044086743

If you are interested in any aspect of #ResearchSoftware, including #RSEng, #funding, #publishing, #training, #metascience, #policy, etc., please consider submitting a proposal to and/or attending #IRSC26 (immediately before #RSECon26 in Sheffield, UK, in Sept). We're trying to bring all elements of the #ResearchSoftware community together

#statstab #504 Likelihood Ratio Test for Publication Bias

Thoughts: Interesting idea for a problem many of us think is present, but is hard to measure.

#likelihood #publicationbias #QRPs #metascience #metapsychology #metaresearch

https://freestylerscientist.pl/projects/likelihood-ratio-test-for-publication-bias/

Likelihood Ratio Test for Publication Bias

Likelihood Ratio Test for Publication Bias — a statistical method to detect and quantify publication bias in heterogeneous datasets.

Paweł Lenartowicz

RE: https://flipboard.com/@wsj/business-b1985f4jz/-/a-T6_YAnIFSTSuzZdNlac-EA%3Aa%3A248213600-%2F0

“Instead of paying humans to join focus groups and complete surveys, #Auru uses thousands of #AI agents, or bots, to simulate human responses. It feeds #demographic and psychographic information into its models to create human profiles that match clients’ needs, and the results those bots spit out are being used for product #development, #pricing, identifying new customers and political #polling.”

Researchers have warned about the inaccuracies of treating #LLMs as human proxies (https://doi.org/10.1007/s10462-025-11297-5), but I wouldn’t be surprised #languageModels beat #qualitative interpretation of non-representative focus groups.

#marketing #psychometrics #statistics #quantMethods #philSci #metascience #business

Are there any examples where it is defensible to combine observational and randomised data in a metaanalysis? #stats #metascience

#statstab #498 FReD Annotator:

Thoughts: "Check among citations whether one of the cited studies has been replicated" cool tool.

#OpenScience #replication #integrity #metascience #reproducibility #tool

https://metaanalyses.shinyapps.io/replicationdatabase/

Research collaborations often start out vague, and participants may have different expectations about issues like workload, authorship, publication form, and open science. We are developing a toolkit where project initiators can state how they foresee the collaboration, and potential collaborators can evaluate if the project is right for them.

Please try it out and give feedback!
https://docs.google.com/document/d/19hi7Diro6NuE5QExR8YZ8eozCCLTSE5hhEh-xvc2g9M/edit

#BigTeamScience #MultiLab #MegaStudy #ResearchCollaboration #ResearchPlanning #MetaScience #OpenScience #AcademicChatter

Research collaboration planning toolkit (v 0.24)

Research collaboration planning toolkit Version 0.24 Instructions Welcome to the research collaboration planning toolkit. The current document is a template for filling out how the collaboration for a research project is planned. The idea is for the project initiators to first suggest how the col...

Google Docs

Following up for this, I've written a longer piece for the new @RoRInstitute #Metascience substack

https://researchonresearchinstitute.substack.com/p/the-point-of-no-return

My minimal claim is that, contra Schweiger, it is very hard to definitely claim any scheme a waste of time and money, since the full costs and benefits of awarding funding in a particular way (e.g. by competition) are difficult to account for

The point of no return?

Diagnosing wasted effort in research funding is harder than it looks

Go Meta! News and Views from RoRI
Go Meta! News and Views from RoRI | Research on Research Institute | Substack

By the Research on Research Institute (RoRI). We publish timely essays, reflections and signals from across metascience, research policy and reform. Expect original thinking, reactions to live debates, and practical insights from people studying research. Click to read Go Meta! News and Views from RoRI, by Research on Research Institute, a Substack publication with thousands of subscribers.

Metascience seminar 1: Improve our inferences from observational studies

https://events.humanitix.com/metascience-seminar-1-harrison-hansford

The event is free for all.

Date and time: March 12 at 11AM (GMT + 11; Sydney, Melbourne, Canberra time)

Speaker: Harrison Hansford

#MetaScience #GMT+11 from @aimos

Designing observational studies for safer inferences: Harrison Hansford

How can we better design observational studies to make the inferences we seek?

RE: https://mastodon.social/@MetaArXiv/116098607342372256

Yet another example of how so-called "#AI" entrenches existing problems in academic research.

#metaScience #metaresearch #academia #academicChatter #NoAI #maihT3k