#statstab #497 On the Statistical Analysis of Experiments
With Manipulation Checks
Thoughts: All psychologists reading this title will panic. Yes, you can't just delete data and assume all is well.
#assumptions #QRPs #estimand #causalinference #ITT #ATE #bias
https://journals.sagepub.com/doi/pdf/10.1177/25152459241297537
#statstab #470 Low power bias {shiny} app
Thoughts: easily show what conducting an underpowered study would do to your effect size (type M error).
#teaching #bias #power #typeM #typeS #QRPs #underpowered #samplesize
https://c-jaksic.shinyapps.io/small_power_bias/
#statstab #469 We should focus on the biases that matter
Thoughts: I recommend this entire issue with the discussions and reply. They are a great insight into how science develops.
#metascience #bias #publicationbias #QRPs #TES
http://dx.doi.org/10.1016/j.jmp.2013.06.001
#statstab #467 Replication, statistical consistency, and publication bias
Thoughts: Is the replication of a a finding the "gold standard" for scientific discovery? Maybe not.
#replication #metascience #metapsychology #statistics #bias #QRPs #nhst
https://doi.org/10.1016/j.jmp.2013.02.003
#statstab #456 Bestiary of Questionable Research Practices in Psychology
Happy new year! โจ
Thoughts: Starting the year with a resource to make you more cynical in 2026.
#QRPs #phacking #metascience #research #ethics
https://journals.sagepub.com/doi/10.1177/25152459251348431
#statstab #396 If researchers find Cohenโs d = 8, no they didnโt
Thoughts: Sometimes an effect is so impressive that its unbelievable.
#effectsize #cohend #QRPs #sesoi
https://mmmdata.io/posts/2025/07/if-researchers-find-cohens-d-8-no-they-didnt/
#statstab #381 In psychology everything mediates everything
Thoughts: Another great explanation of the pitfalls of mediation analysis. Mediation is not a simple procedure and require strong theory.
#mediation #QRPs #correlation #regression #PROCESS
https://steamtraen.blogspot.com/2020/04/in-psychology-everything-mediates.html?m=1
In psychology everything mediates everything
In the past couple of years I have reviewed half a dozen manuscripts with abstracts that go something like this: <Construct X> is know...
#statstab #369 Don't Trust Internal Meta-Analysis
Thoughts: I don't agree with all the assumptions, but interesting to know how bad these can be.
#metaanalysis #QRPs #minimeta #datacolada #falsepositive #replication
https://datacolada.org/73

[73] Don't Trust Internal Meta-Analysis - Data Colada
Researchers have increasingly been using internal meta-analysis to summarize the evidence from multiple studies within the same paper. Much of the time, this involves computing the average effect size across the studies, and assessing whether that effect size is significantly different from zero. At first glance, internal meta-analysis seems like a wonderful idea. It increases...
Data Colada