Mini-course 4 of 6

Variability: Mack and bootstrap

A reserve is an estimate, and every estimate carries uncertainty. This mini-course shows how to measure it with the two most widely used stochastic models for triangles, what their results mean and what they leave out.

35 min
Estimated time
4
Lessons
5
Questions
ObjectivesLessonsWorked exampleSelf-assessmentReadings
01

Objectives

By the end of this mini-course you will be able to:

  • Distinguish process error from parameter estimation error.
  • Compute and interpret the Mack standard error by year and in total.
  • Explain the steps of the ODP bootstrap and read the percentiles it produces.
  • Recognize which risks these models do not capture.
02

Lessons

Lesson 1

Why measure variability

The best estimate is a mean. For the risk margin, capital, the IFRS 17 risk adjustment, or simply to know whether a deviation is normal, you need a measure of dispersion around that mean.

Prediction error has two parts: process error, because even with the exact model future claims are random, and estimation error, because the factors were estimated from limited data. In small triangles the second usually weighs more than people expect.

Lesson 2

The Mack standard error

Mack (1993) showed that the chain ladder with weighted factors is unbiased under three assumptions: the mean of the next value is proportional to the current one, so is its variance (with parameter \(\sigma_j^2\)), and origin years are independent. Without assuming any distribution, he derived the standard error:

\[\widehat{\mathrm{mse}}(\hat R_i)=\hat C_{i,n}^{2}\sum_{k=n+1-i}^{n-1}\frac{\hat\sigma_k^{2}}{\hat f_k^{2}}\left(\frac{1}{\hat C_{i,k}}+\frac{1}{\sum_{j=1}^{n-k}C_{j,k}}\right)\]

The first term in the parentheses is process error; the second is estimation error. The error of the total is not the sum of the errors by year, because every year shares the same estimated factors. The original version excludes the tail; Mack published an extension in 1999 that includes it.

Lesson 3

The ODP bootstrap

Renshaw and Verrall (1998) showed that an over-dispersed Poisson (ODP) generalized linear model reproduces the chain ladder. England and Verrall (2002) describe how to simulate its distribution: (1) fit the model and compute expected increments; (2) obtain Pearson residuals and adjust them for degrees of freedom; (3) resample the residuals to build thousands of synthetic triangles; (4) in each one, re-estimate the factors and project the future adding process noise.

\[r_{i,j}=\frac{X_{i,j}-\hat m_{i,j}}{\sqrt{\hat m_{i,j}}},\qquad \hat\phi=\frac{\sum r_{i,j}^2}{N-p}\]

The result is a full distribution of the reserve, from which you read the mean, standard deviation and percentiles. It requires positive column sums of increments and residuals without patterns; if they show patterns, the model needs adjusting before use.

Lesson 4

Use and interpretation

Bootstrap percentiles feed the IFRS 17 risk adjustment, economic capital and stress tests. Always review the coefficient of variation by year: mature years can be volatile in relative terms even when the amount is small.

No triangle model captures a regime change that is not in the data: a legal reform, inflation different from the past, or a change in mix. Those risks are added with judgment, scenarios or explicit margins. Estimated variability is a floor, not a ceiling.

03

Worked example

Using the series triangle, we measure chain ladder variability without a tail, because neither model in its basic form includes one. That is why base IBNR is lower than in mini-course 2: the difference is exactly the effect of the 1.01 tail. Amounts in millions of pesos.

Step 1. Mack standard error

YearIBNR, no tailStandard errorCoefficient of variation
20210.00.0
202277.97.09.0%
2023271.919.07.0%
2024768.847.26.1%
20252,073.285.54.1%
Total3,191.7110.93.5%
Estimated variance parameters: 1.4620, 0.4447, 0.0635, 0.0091. The last one is extrapolated with Mack's rule because there is only one factor in that column.
  1. IBNR without a tail is 3,191.7 and its total standard error is 110.9, a coefficient of variation of 3.5%. The difference from mini-course 2 (3,339.9 minus 3,191.7 = 148.2) is the tail effect.
  2. 2025 carries the largest absolute error (85.5), but 2022 and 2023 have the highest coefficient of variation: with little reserve left, any deviation weighs more in relative terms.

Step 2. ODP bootstrap

StatisticValue
Mean3,192.9
Standard deviation129.2
50th percentile3,193.0
75th percentile3,280.3
90th percentile3,361.1
99.5th percentile3,519.7
ODP bootstrap with 10,000 simulations, Pearson residuals adjusted for degrees of freedom (15 data points, 9 parameters) and gamma process noise with scale parameter 1.253. With another seed, results change by a few tenths.
  1. The bootstrap mean (3,192.9) matches the chain ladder, as it should. Its standard deviation (129.2) is somewhat larger than Mack's (110.9): with only 6 degrees of freedom, the residual adjustment and gamma process noise widen the distribution.
  2. The 75th percentile is 87.3 million above the mean. That number returns in mini-course 6 as the basis for the IFRS 17 risk adjustment.
Key point: Two reasonable models give similar but not identical dispersion. What matters is reporting the method, its assumptions and what is left out: here, the tail and any regime change not observed in the triangle.
04

Self-assessment

Choose one answer per question: you will see right away whether it is correct and why. At the end, check your score. Nothing is stored or sent.

1. What does parameter estimation error measure?
2. Why is the standard error of the total not the sum of the errors by year?
3. In the ODP bootstrap, what is resampled?
4. Which condition complicates the basic ODP bootstrap?
5. A legal reform will raise indemnities starting next year. Does the Mack error capture it?
05

Readings

Primary sources and reference texts, all publicly accessible at the time of publication.

On actuaria.mx

PreviousBF, Benktander and Cape CodNextReserves in Mexico