The first time I came across the term Confidence Level of 95%, I misunderstood that it means we are 95% sure that 95% of the data lies within a Confidence Interval. This is a common misconception and it took quite a few attempts to get the concept right. So here’s my attempt at explaining it in simple terms using a chai analogy.
Before I get into the details, let’s understand why we have a Confidence Interval and not a confidence value in statistics. I recently read in Practical Statistics for Data Scientists that humans are naturally averse to uncertainty, so we like single, confident numbers. But a single estimate from a sample hides how uncertain it is. A confidence interval gives a range of plausible values instead, which is a more honest answer.
In order to explain the concept of Confidence Intervals, I’ll use a simple example of a Chai/Tea dataset I created. There are two columns, personID and their milk-to-water preference ratio in tea.…