Law of Large Numbers - Forms

Forms

Two different versions of the Law of Large Numbers are described below; they are called the Strong Law of Large Numbers, and the Weak Law of Large Numbers. Both versions of the law state that – with virtual certainty – the sample average

converges to the expected value

where X1, X2, ... is an infinite sequence of i.i.d. integrable random variables with expected value E(X1) = E(X2) = ...= µ. Integrability means that E(|Xj|) < ∞ for j=1,2,....

An assumption of finite variance Var(X1) = Var(X2) = ... = σ2 < ∞ is not necessary. Large or infinite variance will make the convergence slower, but the LLN holds anyway. This assumption is often used because it makes the proofs easier and shorter.

The difference between the strong and the weak version is concerned with the mode of convergence being asserted. For interpretation of these modes, see Convergence of random variables.

Read more about this topic:  Law Of Large Numbers

Famous quotes containing the word forms:

    “The analogy between the mind and a computer fails for many reasons. The brain is constructed by principles that assure diversity and degeneracy. Unlike a computer, it has no replicative memory. It is historical and value driven. It forms categories by internal criteria and by constraints acting at many scales, not by means of a syntactically constructed program. The world with which the brain interacts is not unequivocally made up of classical categories.”
    —Gerald M. Edelman (b. 1928)

    “The failure of women to produce genius of the first rank in most of the supreme forms of human effort has been used to block the way of all women of talent and ambition for intellectual achievement.”
    —Anna Garlin Spencer (1851–1931)

    “Culture’s essential service to a religion is to destroy intellectual idolatry, the recurrent tendency in religion to replace the object of its worship with its present understanding and forms of approach to that object.”
    —Northrop Frye (b. 1912)