#statstab #497 On the Statistical Analysis of Experiments
With Manipulation Checks

Thoughts: All psychologists reading this title will panic. Yes, you can't just delete data and assume all is well.

#assumptions #QRPs #estimand #causalinference #ITT #ATE #bias

https://journals.sagepub.com/doi/pdf/10.1177/25152459241297537

#statstab #470 Low power bias {shiny} app

Thoughts: easily show what conducting an underpowered study would do to your effect size (type M error).

#teaching #bias #power #typeM #typeS #QRPs #underpowered #samplesize

https://c-jaksic.shinyapps.io/small_power_bias/

Low power bias

#statstab #469 We should focus on the biases that matter

Thoughts: I recommend this entire issue with the discussions and reply. They are a great insight into how science develops.

#metascience #bias #publicationbias #QRPs #TES

http://dx.doi.org/10.1016/j.jmp.2013.06.001

#statstab #467 Replication, statistical consistency, and publication bias

Thoughts: Is the replication of a a finding the "gold standard" for scientific discovery? Maybe not.

#replication #metascience #metapsychology #statistics #bias #QRPs #nhst

https://doi.org/10.1016/j.jmp.2013.02.003

#statstab #456 Bestiary of Questionable Research Practices in Psychology

Happy new year! โœจ

Thoughts: Starting the year with a resource to make you more cynical in 2026.

#QRPs #phacking #metascience #research #ethics

https://journals.sagepub.com/doi/10.1177/25152459251348431

#statstab #442 Understanding uncertainty in school league tables

Thoughts: Rankings are virtually meaningless, especially neighbour values.

#ranking #comparison #uncertainty #QRPs #education #academia

https://research-information.bris.ac.uk/ws/portalfiles/portal/40324984/leckie2011fs.pdf

#statstab #396 If researchers find Cohenโ€™s d = 8, no they didnโ€™t

Thoughts: Sometimes an effect is so impressive that its unbelievable.

#effectsize #cohend #QRPs #sesoi

https://mmmdata.io/posts/2025/07/if-researchers-find-cohens-d-8-no-they-didnt/

#statstab #381 In psychology everything mediates everything

Thoughts: Another great explanation of the pitfalls of mediation analysis. Mediation is not a simple procedure and require strong theory.

#mediation #QRPs #correlation #regression #PROCESS

https://steamtraen.blogspot.com/2020/04/in-psychology-everything-mediates.html?m=1

In psychology everything mediates everything

In the past couple of years I have reviewed half a dozen manuscripts with abstracts that go something like this: <Construct X> is know...

#statstab #369 Don't Trust Internal Meta-Analysis

Thoughts: I don't agree with all the assumptions, but interesting to know how bad these can be.

#metaanalysis #QRPs #minimeta #datacolada #falsepositive #replication

https://datacolada.org/73

[73] Don't Trust Internal Meta-Analysis - Data Colada

Researchers have increasingly been using internal meta-analysis to summarize the evidence from multiple studies within the same paper. Much of the time, this involves computing the average effect size across the studies, and assessing whether that effect size is significantly different from zero. At first glance, internal meta-analysis seems like a wonderful idea. It increases...

Data Colada

#statstab #366 Type M error might explain Weisburdโ€™s Paradox

Thoughts: Learn about type M error while you learn about the issues in criminology!

#replication #typeM #typeS #QRPs #paradox #power #effectsize #errorrate

https://sites.stat.columbia.edu/gelman/research/published/weisburd_28.05.2017.pdf