70% sounds like an edge. Over 20 trades, it is statistically indistinguishable from a coin flip. The Wilson interval shows why β with the numbers worked out.
A vendor shows you a model with a 70% win rate. Impressive β until you ask the only question that matters: over how many trades?
Over 20 trades, 70% means 14 wins and 6 losses. Over 2,000 trades, 70% means 1,400 wins and 600 losses. Same headline, completely different evidence. The difference is the Wilson interval, and it is the single most useful statistical idea a non-quant trader can learn.
What the Wilson interval does
Every win rate is an estimate from a sample. The Wilson interval answers: given this sample, what range of true win rates is still plausible? Small samples give wide ranges. Large samples give narrow ones. The interval is honest in a way the headline never is.
Worked roughly, at 95% confidence
70% over 20 trades: the true win rate could plausibly be anywhere from about 48% to 86%.β¦