Idea · Bubbles, Black Swans and Crisis Alpha
Overfitting
A system tuned to the past fails in the future
A trading system tuned to fit past prices to the last detail will in most cases fail on future ones, because it has learned the noise as well as the signal.
Robert Pardo's walk-forward testing, and the explore-and-exploit rules described by Brian Christian and Tom Griffiths, are ways to guard against it.
Shows up in
- 1998 Long-Term Capital Management
- 2007 Quant quake