Risk management

You Cannot Backtest a Crash. You Can Insure Against One.

Market crashes are too rare for any algorithm to be validated on them. The alternative is to stop forecasting, and to track in real time how much of each crash is already covered.

Ten crashes in thirty-six years

Our Crash Clusters study lists the S&P 500 drawdowns deeper than 15% since 1990. There are ten. Sorted by the speed and length of the fall, they make three groups: one flash shock (Covid, 2020), six fast corrections (the Gulf War, LTCM, 2010, the euro debt crisis, Q4 2018 and the 2025 tariff shock) and three extended bears (dot-com, 2007–09 and 2022). Three shallower episodes are kept aside as controls.

Each of those events is vivid, so ten feels like a lot. As a statistical sample it is almost nothing, and the rest of this article is about what follows from that: not that hedging is pointless, but that the way we usually justify a hedge cannot be applied to crashes.

What ten events can and cannot tell you

Even the frequency is barely known. Ten events in 36.7 years is 0.27 a year, or one every 3.7 years. The exact 95% interval on a count of ten runs from 0.13 to 0.50 a year: somewhere between one crash every 2.0 years and one every 7.7 years. The base rate itself is uncertain by a factor of four.

A hit rate needs many trials. Suppose a trigger rule "worked" in all three extended bears. The true hit rate that is consistent with 3 out of 3 starts at 29%. If it worked in 7 of the 10 crashes, the plausible range is 35% to 93%. For the flash-shock group, which contains a single event, the range is 3% to 100%: no information at all.

Observed result 95% interval for the true hit rate 0% 25% 50% 75% 100% coin flip (50%) Flash shocks: 1 of 1 Extended bears: 3 of 3 All ten crashes: 7 of 10 All ten crashes: 8 of 10
Exact (Clopper–Pearson) 95% intervals. Dots are the observed hit rates. Every interval, even 8 out of 10, still contains 50%: none of these results can be told apart from a coin flip.

Telling a good rule from luck takes about 47 crashes. To distinguish a rule that catches 70% of crashes from one that catches 50%, with the usual 5% significance and 80% power, you need about 47 events. At one crash every 3.7 years, that is roughly 170 years of history. With ten events the power of the test is 15%: most of the time, a genuinely useful rule would not stand out from noise.

Searching makes it worse. Every variant you try is another draw. Take twenty rules with no skill at all, each catching any given crash with probability one half. The chance that at least one of them catches 8 or more of the ten is 67%. In practice, moving-average lengths, thresholds, hedge ratios and exit rules give dozens of variants. The one that survives will look like insight.

The events are not repeats of one experiment. Covid was a pandemic, 2007–09 a credit crisis, Q4 2018 a Fed tightening, 2025 a tariff shock. Statistics assumes repeated draws from one process; here every mechanism appears once. And the boundaries of the sample matter. The Crash Clusters window starts in 1990, so Black Monday, 1987 is left out. It would sit with the flash shocks, and adding that single date would double the size of the group.

The Crash Clusters study was built with these limits in plain view. It does not estimate probabilities or claim an edge for any trigger. It is a catalogue of what a crash can look like, and it should be read that way.

A better forecast would not fix it

Suppose we had a warning signal we could trust. The arithmetic is still unforgiving. Ten crashes over about 1,900 weeks is a base rate near 0.5% a week. A signal that doubled the odds would put the chance of a crash starting next week at 1%, which means that 99 times out of 100 the alarm is followed by no crash. A hedge that switches on at every alarm pays its cost each time, and that is exactly what the control episodes in the study measure: hedges that fire, pay their cost and never meet the crisis they were waiting for.

So the two possible answers to "when will the next crash come?" both fail. A precise answer cannot be validated, and an imprecise one is too costly to act on.

Think like an underwriter, one event at a time

Insurance changes the question. A homeowner does not need a model of the probability of a fire to decide that the house should be covered. They decide how much loss they can bear, protect the rest, and pay the premium in the years when nothing burns.

A portfolio has one house and no pool of independent policies to diversify across, so the decision cannot rest on expected frequency. It has to be made event by event:

  1. Fix the maximum loss per event. This is the retention: the drawdown you can absorb without being forced to sell or to abandon the strategy. It is a fact about the investor, not a statistic.
  2. Take each crash type as a scenario. Use the catalogue as it stands, with no probability attached.
  3. Compute the cover each scenario requires. If a scenario would cost a fully invested portfolio a loss L and the tolerance is R, the hedge in force must be at least 1 − R/L.
  4. Check that the cover can arrive in time. A flash shock ends before any price-based trigger reacts, so its cover has to be in the portfolio beforehand. In fast corrections a trigger enters mid-decline and the sharp rebound gives back the hedge gain, so cover there should be modest and the exit rule matters more than the entry. Only in extended bears is a full hedge switched on by a trend rule likely to repay itself.
  5. Price it. Each unit of cover has an annual cost. The decision is which scenarios to cover, and how much of that cost to accept.
Scenario Reference event Loss Cover for 15% cap Loss, 30% hedged Gap
Flash shockCovid 2020−34.1%56%−23.9%8.9 pt
Fast correctionQ4 2018−20.2%26%−14.1%none
Extended bear, moderateRates and inflation 2022−25.4%41%−17.8%2.8 pt
Extended bear, severeFinancial crisis 2007–09−56.5%73%−39.6%24.6 pt

Illustrative. Assumes a portfolio that moves one-for-one with the S&P 500, a 15% tolerance and a hedge that is fully in force before the fall begins. The losses are the worst observed in each group, from the Crash Clusters study; they are reference points, not ceilings.

Nothing in the table needed a probability. It says that a 30% hedge is enough for a Q4 2018, falls short of a Covid, and leaves a wide gap in a 2008. Whether to close a gap is then a question of cost and conviction, and it can be answered scenario by scenario.

Keep the ledger in real time

Cover is not a decision you take once. It changes every day: triggers switch hedges on and off, option protection expires and has to be rolled, the size of the portfolio moves, and a hedge that was 50% last month can be 0% today. A policy you cannot see is a policy you may not have.

So the table above should not be a slide, but a ledger that is recalculated daily, with one row per scenario:

  1. Exposure and hedge in force today, for each market.
  2. Loss if the scenario started today, after the hedge.
  3. Gap to the retention, with an alert when it opens.
  4. Contingent cover, shown separately and not counted. A hedge that would arrive only after a 10% fall is not protection against a flash shock. Only what is in force counts.
  5. Premium spent against budget, so that cover is never bought without knowing its price.

The ledger does not forecast anything. Its numbers move because exposure and hedge levels move, not because a model changed its mind. That is what makes it reliable in a domain where models cannot be validated. A tool like the Hedge Gauge, which publishes a suggested hedge level for each market every day, supplies the input on how much cover the rules call for; the ledger measures how much cover the portfolio actually holds against each scenario.

What this does not solve

Cover has a cost. The premium is a drag in every year without a crash, and this article does not price it. That is the number the whole approach depends on, and the Crash Clusters study frames the choice in the same terms: which group you want to hedge, and what it costs each year.

The scenario library is small too. Ten observations are a good set of shapes, not a bound on what can happen. Black Monday and the 1930s sit outside the window. Use the catalogue to build scenarios, and stress it, rather than treating its worst case as a limit.

Retention is a judgement. The 15% in the example is not derived from data. It comes from the investor, and different investors will rightly choose different numbers.

Rare events cannot be validated, but they can be covered, and coverage can be measured every day.

Back to Publications