Bessel's Correction

In statistics, Bessel's correction, named after Friedrich Bessel, is the use of n − 1 instead of n in the formula for the sample variance and sample standard deviation, where n is the number of observations in a sample: it corrects the bias in the estimation of the population variance, and some (but not all) of the bias in the estimation of the population standard deviation.

That is, when estimating the population variance and standard deviation from a sample when the population mean is unknown, the sample variance is a biased estimator of the population variance, and systematically underestimates it. Multiplying the standard sample variance by n/(n − 1) (equivalently, using 1/(n − 1) instead of 1/n in the estimator's formula) corrects for this, and gives an unbiased estimator of the population variance. The cost of this correction is that the unbiased estimator has uniformly higher mean squared error than the biased estimator. In some terminology, the factor n/(n − 1) is itself called Bessel's correction.

A subtle point is that, while the sample variance (using Bessel's correction) is an unbiased estimate of the population variance, its square root, the sample standard deviation, is a biased estimate of the population standard deviation; because the square root is a concave function, the bias is downward, by Jensen's inequality. There is no general formula for an unbiased estimator of the population standard deviation, though there are correction factors for particular distributions, such as the normal; see unbiased estimation of standard deviation for details.

One can understand Bessel's correction intuitively as the degrees of freedom in the residuals vector:

where is the sample mean. While there are n independent samples, there are only n − 1 independent residuals, as they sum to 0. This is explained further in the article Degrees of freedom (statistics).

Read more about Bessel's Correction:  The Source of The Bias, Terminology, Formula, Proof of Correctness, Alternate Proof of Correctness

Famous quotes containing the word correction:

    There are always those who are willing to surrender local self-government and turn over their affairs to some national authority in exchange for a payment of money out of the Federal Treasury. Whenever they find some abuse needs correction in their neighborhood, instead of applying the remedy themselves they seek to have a tribunal sent on from Washington to discharge their duties for them, regardless of the fact that in accepting such supervision they are bartering away their freedom.
    Calvin Coolidge (1872–1933)