#statstab #315 What fraction of repeat experiments will have an effect size within the 95% confidence interval of the first experiment?

Thoughts: CV is a great place to learn. We see the same answer as Cumming: 83%

#replicability #confidenceintervals #replication #metascience #estimation #research #science

https://stats.stackexchange.com/questions/218602/what-fraction-of-repeat-experiments-will-have-an-effect-size-within-the-95-conf

What fraction of repeat experiments will have an effect size within the 95% confidence interval of the first experiment?

Let's stick to an ideal situation with random sampling, Gaussian populations, equal variances, no P-hacking, etc. Step 1. You run an experiment say comparing two sample means, and compute a 95%

Cross Validated

#statstab #312 {presize} pkg: Understanding Precision-Based Sample Size Calculations

Thoughts: Do you care about effect sizes? Then precision-based planning is for you. Expect higher Ns!

#r #samplesize #precision #estimation #power #Confidenceintervals

https://library.virginia.edu/data/articles/understanding-precision-based-sample-size-calculations

Understanding Precision-Based Sample Size Calculations | UVA Library

#statstab #295 The Fallacy of the Null-Hypothesis Significance Test

Thoughts: "the [..] aim of a scientific experiment is not to precipitate decisions, but to make an appropriate adjustment in the degree to which one accepts, or believes, the hypothesis"

#NHST #Bayes #ConfidenceIntervals #pvalues #significance #testing #hypotheses #likelihood #critique #fallacy

http://stats.org.uk/statistical-inference/Rozeboom1960.pdf

#statstab #268 Understanding Confidence Intervals With Visual Representations

Thoughts: A decent overview of CIs and how they can aid inference. Also a shoutout to the {esci} website. Great tools for teaching.

#confidenceintervals #estimation #effects

https://www.researchgate.net/publication/299500871_Understanding_Confidence_Intervals_With_Visual_Representations_English

#statstab #256 Rule of three (95%CI for no event)

Thoughts: Sometimes you have 0 recorded events, so how do you compute a Confidence Interval? Using the rule of 3!

#Confidenceintervals #clinical #effectsize #statistics

https://en.m.wikipedia.org/wiki/Rule_of_three_(statistics)

Rule of three (statistics) - Wikipedia

β€œIf confidence procedures do not allow an assessment of the probability that an interval contains the true value, if they do not yield measures of precision, and if they do not yield assessments of the likelihood or plausibility of parameter values, then what are they?”
#statistics #stats #ConfidenceIntervals

RE: https://bayes.club/@modrak_m/113595053801980378

Martin ModrΓ‘k (@modrak_m@bayes.club)

A positively great account of some of the weirder properties of (some) confidence intervals. https://doi.org/10.3758/s13423-015-0947-8 HT: @rlmcelreath@nerdculture.de #stats #NotAllConfidenceIntervals

Bayes Club

#statstab #85 Demystifying Confidence Intervals

Thoughts: I like the visuals in this example. And the author recommends bootstrapped CIs which I like (for large datasets).

#dataviz #rstats #research #Confidenceintervals

https://towardsdatascience.com/demystifying-confidence-intervals-with-examples-7bdef30f7b0a

Demystifying Confidence Intervals with Examples - Towards Data Science

Confidence intervals are of the most important concepts in statistics. In data science, we often need to calculate statistics for a given data variable. The common problem we encounter is the lack of…

Towards Data Science

#statstab #46 Confidence intervals exclude nothing

Thoughts: Following the heated threads on CIs this wknd, I thought I'd share one of the first papers I know to show why a single CI can be problematic

#NHST #estimation #statistics #Confidenceintervals

https://www.ncbi.nlm.nih.gov/pmc/articles/PMC1646956/?page=2

Confidence intervals exclude nothing.

PubMed Central (PMC)

#stats Q: Confidence Intervals (CI) confuse many researchers. I think it is partly because, just like p-values, you can use them to make *per study* inferences and/or *long-run* (frequentist) inferences.

Maybe we could call the two methods "descriptive CI" and "decision CI"?

#research #Confidenceintervals #NHST #statistics