#statstab #327 Effect Sizes for Equivalence Testing: Incorporating the Equivalence Interval

Thoughts: Not sure what value this approach has yet, but sharing for feedback.

#equivalencetests #sesoi #nhst #noeffect #nonsignificant #practicalsignificance

https://osf.io/preprints/psyarxiv/5buz9_v1

OSF

#statstab #238 Bridging null hypothesis testing and estimation

Thoughts: An overview of the ways you can claim "no effect" under a bayesian framework.

#bayesian #bayesfactors #nullresults #noeffect #equivalencetests #equivalence #jasp #r

https://osf.io/preprints/psyarxiv/c7b45

OSF

#statstab #233 Conditional equivalence testing (CET rule)

Thoughts: Many might not know that there are several decision rules for equivalence test. This one is slightly different from TOST classic.

#equivalencetests #equivalence #rules #nhst

https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0195145

Conditional equivalence testing: An alternative remedy for publication bias

We introduce a publication policy that incorporates β€œconditional equivalence testing” (CET), a two-stage testing scheme in which standard NHST is followed conditionally by testing for equivalence. The idea of CET is carefully considered as it has the potential to address recent concerns about reproducibility and the limited publication of null results. In this paper we detail the implementation of CET, investigate similarities with a Bayesian testing scheme, and outline the basis for how a scientific journal could proceed to reduce publication bias while remaining relevant.

#statstab #232 Bayesian Interval-Null Testing

Thoughts: @JASPStats has a module for Equivalence Tests that include Bayesian Overlapping and Non-Overlapping Hypothesis Testing.

#equivalencetests #bayesfactors #jasp #noeffect #bayes
https://jasp-stats.org/2020/06/02/frequentist-and-bayesian-equivalence-testing-in-jasp/

Frequentist and Bayesian Equivalence Testing in JASP - JASP - Free and User-Friendly Statistical Software

This post demonstrates the Equivalence Testing Module, new in JASP 0.12. In traditional hypothesis testing, both frequentist and Bayesian, the null hypothesis is often specified as a point (i.e., there is no effect whatsoever in the population). Consequently, in very… Continue reading β†’

JASP - Free and User-Friendly Statistical Software

#statstab #222 ROPE sensitivity to scales

Thoughts: Insightful github thread on setting ROPE ranges for equivalence tests, & scaled / standardized predictors. PSA: make sure your model makes sense.

#ROPE #equivalencetests #signficance #parameters #r

https://github.com/easystats/bayestestR/issues/144

ROPE sensitivity to scales? Β· Issue #144 Β· easystats/bayestestR

From ROPE article: However, keep in mind that unlike indices of effect existence (such as the pd), indices of effect size, such as the ROPE percentage, depend on the unit of its parameter, and can ...

GitHub

#statstab #215 Four one-sided test of significance (FOST)

Thoughts: If you liked the "two one-sided t-tests" you'll love four! 2x the fun and inference. Superiority+equivalence+inferiority

#NHST #TOST #equivalencetests

https://pedermisager.org/blog/four-one-sided-test/

Four one-sided test of significance (FOST). Dear reader, does this make sense? | Peder M. Isager

Personal website of Dr. Peder M. Isager

Peder M. Isager

#statstab #205 Equivalence Tests Using {marginaleffects}

Thoughts: Easily testing for "no effect" is important. Here's a tutorial by @carlislerainey using @VincentAB r pkg.

#equivalencetests #equivalence #TOST #marginaleffects #tutorial #nullresults #r

https://www.carlislerainey.com/blog/2023-08-18-equivalence-tests/

Equivalence Tests with {marginaleffects}

Reproducing the Clark and Golder (2006) example from Rainey (2014)

#statstab #199 Mixed model equivalence test using R and PANGEA

Thoughts: While there are easier ways to compute #EQ tests for such models now, it is nice to see how you'd do so manually.

#equivalencetests #NHST #mixedeffects #r #stats #nullresults

https://pedermisager.org/blog/mixed_model_equivalence/

Mixed model equivalence test using R and PANGEA | Peder M. Isager

Personal website of Dr. Peder M. Isager

Peder M. Isager

#statstab #194 Design and analysis of noninferiority studies

Thoughts: Sometimes all you want to know is "is this new thing not worse than the previous one?". Enter noninferiority tests.

#noninferiority #equivalencetests #nhst #testing

https://support.sas.com/kb/48/616.html

48616 - Design and analysis of noninferiority studies

Equivalence testing is introduced and PROC POWER is illustrated for determining sample size for noninferiority studies. Noninferiority tests for proportions and means are conducted using PROC FREQ and PROC TTEST.

What to do with "null" results - Part II: Nonsignificant but with sufficient data

[Originally features on my stats blog - Figuring Stuff Out - 14 Jan 202]

Figuring Stuff Out - Dr Mircea Zloteanu