Law of Total Variance

In probability theory, the law of total variance or variance decomposition formula, also known by the acronym EVVE (or Eve's law), states that if X and Y are random variables on the same probability space, and the variance of Y is finite, then

Some writers on probability call this the "conditional variance formula". In language perhaps better known to statisticians than to probabilists, the two terms are the "unexplained" and the "explained component of the variance" (cf. fraction of variance unexplained, explained variation).

There is a general variance decomposition formula for c2 components (see below) . For example, with two conditioning random variables:

which follows from the law of total conditional variance:

Note that the conditional expected value E( Y | X ) is a random variable in its own right, whose value depends on the value of X. Notice that the conditional expected value of Y given the event X = x is a function of x (this is where adherence to the conventional and rigidly case-sensitive notation of probability theory becomes important!). If we write E( Y | X = x ) = g(x) then the random variable E( Y | X ) is just g(X). Similar comments apply to the conditional variance.

Read more about Law Of Total Variance:  Proof, General Variance Decomposition Applicable To Dynamic Systems, The Square of The Correlation and Explained (or Informational) Variation, Higher Moments

Famous quotes containing the words law of, law, total and/or variance:

    We accept and welcome ... as conditions to which we must accommodate ourselves, great inequality of environment; the concentration of business, industrial and commercial, in the hands of a few; and the law of competition between these, as being not only beneficial, but essential for the future progress of the race.
    Andrew Carnegie (1835–1919)

    Nothing in the world is single;
    All things by a law divine
    In one spirit meet and mingle.
    Why not I with thine?
    Percy Bysshe Shelley (1792–1822)

    Computers are good at swift, accurate computation and at storing great masses of information. The brain, on the other hand, is not as efficient a number cruncher and its memory is often highly fallible; a basic inexactness is built into its design. The brain’s strong point is its flexibility. It is unsurpassed at making shrewd guesses and at grasping the total meaning of information presented to it.
    Jeremy Campbell (b. 1931)

    There is an untroubled harmony in everything, a full consonance in nature; only in our illusory freedom do we feel at variance with it.
    Fyodor Tyutchev (1803–1873)