Bessel's Correction - Proof of Correctness

Proof of Correctness

Click to expand

As a background fact, we use the identity which follows from the definition of the standard deviation and linearity of expectation.

A very helpful observation is that for any distribution, the variance equals half the expected value of when are independent samples. To prove this observation we will use that (which follows from the fact that they are independent) as well as linearity of expectation:

Now that the observation is proven, it suffices to show that the expected squared difference of two samples from the sample population equals times the expected squared difference of two samples from the original distribution. To see this, note that when we pick and via u, v being integers selected independently and uniformly from 1 to n, a fraction of the time we will have u=v and therefore the sampled squared difference is zero independent of the original distribution. The remaining of the time, the value of is the expected squared difference between two unrelated samples from the original distribution. Therefore, dividing the sample expected squared difference by, or equivalently multiplying by gives an unbiased estimate of the original expected squared difference.

Read more about this topic:  Bessel's Correction

Famous quotes containing the words proof of, proof and/or correctness:

    “A short letter to a distant friend is, in my opinion, an insult like that of a slight bow or cursory salutation—a proof of unwillingness to do much, even where there is a necessity of doing something.”
    —Samuel Johnson (1709–1784)

    “If some books are deemed most baneful and their sale forbid, how, then, with deadlier facts, not dreams of doting men? Those whom books will hurt will not be proof against events. Events, not books, should be forbid.”
    —Herman Melville (1819–1891)

    “Rather would I have the love songs of romantic ages, rather Don Juan and Madame Venus, rather an elopement by ladder and rope on a moonlight night, followed by the father’s curse, mother’s moans, and the moral comments of neighbors, than correctness and propriety measured by yardsticks.”
    —Emma Goldman (1869–1940)