Backtest Validation

Cross-validation changes the exam. Rolling validation also keeps time moving forward. Here’s how to tell whether a backtest learned a real pattern or memorized history.

Short answer: Cross-validation swaps the exam. Rolling validation also keeps time moving forward. The one question that matters is whether the strategy ever got to peek at the answers.

Quant reports have a customer-service problem.

You ask, “Does this strategy actually hold up?”

The report replies with K-Fold , Walk-Forward , Purged CV , and Embargo —four acronyms and the emotional warmth of a tax form.

I asked about a backtest. Why am I suddenly sitting an acronym exam?

The jargon sounds intimidating. The job is simple: find out whether the strategy can pass a new test, or whether it merely memorized the old one.

Start with one exam the strategy has never seen

Say you have trading data from 2024 and 2025.

The simplest honest test is to hide the final few months. Use the earlier data to build the rules.…