Menu

What a 95% confidence interval actually tells you
📰

What a 95% confidence interval actually tells you

DEV Community: beginners·wanqiuxu·5 days ago
#SAA8ylm4
#devtobeginners#devto#dev#interval#model
Reading 0:00
15s threshold

A scientific paper reports that a mean difference is 1.4, with a 95% confidence interval of 0.6 to 2.2. In the news, and sometimes even in research talks, this is shortened to a more comforting sentence: we can be 95 percent sure the true value lies between 0.6 and 2.2. That sentence is easy to remember. For a frequentist confidence interval, it is also the wrong meaning.

The core idea is this: a 95% confidence interval describes the long-run behavior of a method, not the probability that this particular interval covers the true value. The number 95% belongs to the procedure. It does not attach itself, as a posterior probability, to the one interval you have just computed.

Here is what the procedure is supposed to do. You adopt a statistical model, collect a sample, and compute an interval from that sample by a fixed rule. Imagine, as a thought experiment, repeating the whole study many times, each time drawing a new sample from the same process and applying the same rule.…

Continue reading — create a free account

Join HashtagPLUS to read full articles, follow hashtags, vote, and join the conversation.