The final paper in our upcoming special issue on #Replicability and #Reproducibility, Joseph Holler and colleagues use open science practices to develop a GIScience study on access t oCOVID-19 healthcare in Illinois, US https://doi.org/10.1080/15230406.2025.2591124 #OpenAccess #GISchat

Reading a paper this morning https://onlinelibrary.wiley.com/doi/10.1002/pds.4295 that follows Nosek & Errington (2017) https://elifesciences.org/articles/23383.pdf in muddling the distinction between #replicability as a broader scientific aim vs #reproducibility as captured in the narrow (purely 'computational') idea of #reproducibleresearch discussed e.g. in a #Guix context here https://guix.gnu.org/cookbook/en/html_node/Reproducible-Research.html.

This mistake is not uncommon, and leads (in this present paper, at least) to insufficient stress on computational reproducibility as a sine qua non of any higher-order quality attribute.

An #openaccess toolbox aimed at unifying the field of auditory reverse correlation studies by providing a consistent experimental and analysis framework allowing for better #replicability and #reproducibility
https://fediscience.org/@LeoVarnet/115627592918266083
#revcorr #revcor #psychphysics #psychology #psychoacoustics #OpenScience @psycholinguistics @psychology
LΓ©o Varnet (@LeoVarnet@fediscience.org)

1/5 New article published in #FrontiersIn #Psychology! We introduce **fastACI**, an #openaccess toolbox that enables researchers to design auditory reverse-correlation experiments and analyze the resulting data. Auditory reverse-correlation is a powerful "ear-tracking" technique: it reveals which acoustic features participants rely on while listening to sounds, using nothing more than a computer and a pair of headphones. https://www.frontiersin.org/journals/psychology/articles/10.3389/fpsyg.2025.1668690/full

FediScience.org

A new article by Chloe Patton shows how debates about #OpenScience often slip into absurdity – like demanding #replication from the #Humanities. You can’t replicate history, culture, or interpretation the way you replicate a physics experiment. It’s a different kind of knowledge.

 https://doi.org/10.1093/reseval/rvaf052

Forcing STEM-style standards onto the humanities doesn’t improve #science – it just adds bureaucracy and limits academic freedom.

#Reproducibility #ResearchEvaluation #Replicability

Have you checked out our #OpenScience Bites #podcast yet? Stay tuned!

Very soon, we’ll be talking with Felipe Romero, Assistant Professor at the Faculty of #Philosophy. From a #MetaScience perspective, we’ll dive into the concepts of #reproducibility and #replicability, and why they matter for #research practice.

We’ll let you know as soon as the new episode is online!

In the meantime, feel free to listen to our earlier episodes:

🎧 https://www.rug.nl/research/openscience/podcast/

#PublicEngagement #OpenEducation

How Scrutiny and Iteration Made Behavioral Economics Better https://www.chicagobooth.edu/review/how-scrutiny-iteration-made-behavioral-economics-better
"However, direct #replicability should not be confused with #generalizability or universality. While the basic patterns of behavior documented in the original experiments reliably show up in subsequent replications, their magnitudes can vary substantially across contexts. Loss aversion might be stronger in some settings than in others. Understanding this variation has become a central focus of contemporary behavioral economics research. Rather than viewing such #heterogeneity as a challenge to the field’s foundations, researchers increasingly see it as a source of insight into the underlying psychological mechanisms driving behavioral anomalies."
#BehavioralEconomics
How Scrutiny and Iteration Made Behavioral Economics Better

A step-by-step approach to science gave the field a strong foundation.

The University of Chicago Booth School of Business

Even discounting bad faith and charlatans, in the biological sciences (which I am familiar with) and probably other research, we get results... but even with meticulous lab books, it's hard to reproduce the exact same experiment and replicate the exact same results. Because we really don't know all the variables
#Science #Experiments #Replicability

Unreplicable results are an open secret | Dynamic Ecology

https://dynamicecology.wordpress.com/2025/07/17/unreplicable-results-are-an-open-secret/

Unreplicable results are an open secret

A couple of new preprints claim that the large majority of results in fruit fly immunology are replicable. Link goes to a news article in Science. The authors of the linked preprints both reviewed …

Dynamic Ecology
New I4R discussion paper by Philipp KnΓΆpfle, @drfollowmario, and me: "A Replication Report on "Political polarization of news media and
influencers on Twitter in the 2016 and 2020 US presidential elections" by Flamino et al. 2023
https://www.econstor.eu/handle/10419/319836
#replicability #computationalsocialscience
EconStor: A Replication Report on "Political polarization of news media and influencers on Twitter in the 2016 and 2020 US presidential elections" by Flamino et al. 2023

EconStor is a publication server for scholarly economic literature, provided as a non-commercial public service by the ZBW.

#statstab #378 Selective Inference: The Silent Killer of Replicability

Thoughts: Benjamin overviews the replicability crisis, alternatives to p-values (and their issues), and suggests selective reporting is a large issue itself.

#replication #crisis #pvalue #nhst #selectivereporting #replicability #reproducibility

https://hdsr.mitpress.mit.edu/pub/l39rpgyc/release/3

Selective Inference: The Silent Killer of Replicability

Harvard Data Science Review
How to make Rscripts more reproducible with Nix package Manager : Rix for R make it possible to go a step further than using only Renv or even Docker ; see documentation here https://docs.ropensci.org/rix/index.html#quick-start-for-returning-users #nix #R #replicability
Reproducible Data Science Environments with Nix

Simplifies the creation of reproducible data science environments using the Nix package manager, as described in Dolstra (2006) <ISBN 90-393-4130-3>. The included `rix()` function generates a complete description of the environment as a `default.nix` file, which can then be built using Nix. This results in project specific software environments with pinned versions of R, packages, linked system dependencies, and other tools or programming languages such as Python or Julia. Additional helpers make it easy to run R code in Nix software environments for testing and production.