#statstab #493 What denominator does the Cohen's d use on JASP??

Thoughts: A thread spanning years, where people figure out the many ways to compute Cohen's d. This stuff needs better labels.

#effectsize #cohend #design #japs #r

https://forum.cogsci.nl/discussion/3013/what-denominator-does-the-cohens-d-use-on-jasp

What denominator does the Cohen's d use on JASP??

As I'm getting different results when calculating Cohen's d with SD Pooled as the denominator to the results JASP is giving me.

Forum

#statstab #479 Uncertainty limits the use of power analysis

Thoughts: Frequentists avoiding uncertainty is never good.

#poweranalysis #error #uncertainty #simulation #cohend #effectsize

https://www.researchgate.net/publication/361158443_Uncertainty_limits_the_use_of_power_analysis

#statstab #402 On Bayes factors for hypothesis tests {emBayes Factor}

Thoughts: On bsky there were renewed debates about BFs. This paper provides "better" priors (mixture t centred on the ES). Also some p-value BFs

#bayesian #bayesfactor #priors #cohend

https://link.springer.com/article/10.3758/s13423-024-02612-2

On Bayes factors for hypothesis tests - Psychonomic Bulletin & Review

We develop alternative families of Bayes factors for use in hypothesis tests as alternatives to the popular default Bayes factors. The alternative Bayes factors are derived for the statistical analyses most commonly used in psychological research โ€“ one-sample and two-sample t tests, regression, and ANOVA analyses. They possess the same desirable theoretical and practical properties as the default Bayes factors and satisfy additional theoretical desiderata while mitigating against two features of the default priors that we consider implausible. They can be conveniently computed via an R package that we provide. Furthermore, hypothesis tests based on Bayes factors and those based on significance tests are juxtaposed. This discussion leads to the insight that default Bayes factors as well as the alternative Bayes factors are equivalent to test-statistic-based Bayes factors as proposed by Johnson. Journal of the Royal Statistical Society Series B: Statistical Methodology, 67, 689โ€“701. (2005). We highlight test-statistic-based Bayes factors as a general approach to Bayes-factor computation that is applicable to many hypothesis-testing problems for which an effect-size measure has been proposed and for which test power can be computed.

SpringerLink

#statstab #396 If researchers find Cohenโ€™s d = 8, no they didnโ€™t

Thoughts: Sometimes an effect is so impressive that its unbelievable.

#effectsize #cohend #QRPs #sesoi

https://mmmdata.io/posts/2025/07/if-researchers-find-cohens-d-8-no-they-didnt/

Experience Statistics

#statstab #294 So You Think You Can Graph - effectiveness of presenting the magnitude of an effect

Thoughts: Competition in the many ways to display effect magnitude. Some cool ideas.

#dataviz #stats #effectsize #effects #plots #figures #cohend

https://amplab.colostate.edu/SYTYCG_S1/SYTYCG_Season1_Results.html

So You Think You Can Graph - Season 1

#statstab #281 Correcting Cohenโ€™s d for Measurement Error (A Method!)

Thoughts: Scale reliability can be incorporated into effect size computation (i.e., remove attenuation)

#measurementerror #effectsize #cohend #reliability #scales

http://rpubs.com/JLLJ/RPBD

RPubs - Classical Reliability Correction for Cohen's d and the Point-Biserial

#statstab #260 Effect size measures in a two-independent-samples case with nonnormal and nonhomogeneous data

Thoughts: "A_w and d_r were generally robust to these violations"

#robust #effectsize #ttest #2groups #metaanalysis #assumptions #ttest #cohend

https://link.springer.com/article/10.3758/s13428-015-0667-z

#psychology #statistics #research #abtesting

Effect size measures in a two-independent-samples case with nonnormal and nonhomogeneous data - Behavior Research Methods

In psychological science, the โ€œnew statisticsโ€ refer to the new statistical practices that focus on effect size (ES) evaluation instead of conventional null-hypothesis significance testing (Cumming, Psychological Science, 25, 7โ€“29, 2014). In a two-independent-samples scenario, Cohenโ€™s (1988) standardized mean difference (d) is the most popular ES, but its accuracy relies on two assumptions: normality and homogeneity of variances. Five other ESsโ€”the unscaled robust d (d r * ; Hogarty & Kromrey, 2001), scaled robust d (d r ; Algina, Keselman, & Penfield, Psychological Methods, 10, 317โ€“328, 2005), point-biserial correlation (r pb ; McGrath & Meyer, Psychological Methods, 11, 386โ€“401, 2006), common-language ES (CL; Cliff, Psychological Bulletin, 114, 494โ€“509, 1993), and nonparametric estimator for CL (A w ; Ruscio, Psychological Methods, 13, 19โ€“30, 2008)โ€”may be robust to violations of these assumptions, but no study has systematically evaluated their performance. Thus, in this simulation study the performance of these six ESs was examined across five factors: data distribution, sample, base rate, variance ratio, and sample size. The results showed that A w and d r were generally robust to these violations, and A w slightly outperformed d r . Implications for the use of A w and d r in real-world research are discussed.

SpringerLink

#statstab #226 Standardization and other approaches to meta-analyze differences in means

Thoughts: "standardization after meta-analysis...can be used to assess magnitudes of a meta-analyzed mean effect"

#metaanalysis #effectsize #cohend #clinical

https://onlinelibrary.wiley.com/doi/10.1002/sim.10114?af=R

#statstab #153 Difference between Cohen's d and beta coefficient in a standardized regression

Thoughts: This relationship bw (beta) and (d) may be useful in some reporting edge cases, like #metaanalysis

#cohend #regression #effectsize

https://stats.stackexchange.com/questions/472810/difference-between-cohens-d-and-beta-coefficient-in-a-standardized-regression-m

Difference between Cohen's d and beta coefficient in a standardized regression model with dummy coded predictor variable

I have been wondering about this for a while now and I just could not find an answer to it, so I'd be glad if someone here could help me out! If I have a simple regression model with a standardized

Cross Validated