Law of Total Variance

In probability theory, the law of total variance or variance decomposition formula, also known by the acronym EVVE (or Eve's law), states that if X and Y are random variables on the same probability space, and the variance of Y is finite, then

Some writers on probability call this the "conditional variance formula". In language perhaps better known to statisticians than to probabilists, the two terms are the "unexplained" and the "explained component of the variance" (cf. fraction of variance unexplained, explained variation).

There is a general variance decomposition formula for c2 components (see below) . For example, with two conditioning random variables:

which follows from the law of total conditional variance:

Note that the conditional expected value E( Y | X ) is a random variable in its own right, whose value depends on the value of X. Notice that the conditional expected value of Y given the event X = x is a function of x (this is where adherence to the conventional and rigidly case-sensitive notation of probability theory becomes important!). If we write E( Y | X = x ) = g(x) then the random variable E( Y | X ) is just g(X). Similar comments apply to the conditional variance.

Read more about Law Of Total Variance:  Proof, General Variance Decomposition Applicable To Dynamic Systems, The Square of The Correlation and Explained (or Informational) Variation, Higher Moments

Famous quotes containing the words law of, law, total and/or variance:

    What, then, is the true Gospel of consistency? Change. Who is the really consistent man? The man who changes. Since change is the law of his being, he cannot be consistent if he stick in a rut.
    Mark Twain [Samuel Langhorne Clemens] (1835–1910)

    Revenge is a kind of wild justice, which the more a man’s nature runs to, the more ought law to weed it out.
    Francis Bacon (1561–1626)

    The techniques of opening conversation are universal. I knew long ago and rediscovered that the best way to attract attention, help, and conversation is to be lost. A man who seeing his mother starving to death on a path kicks her in the stomach to clear the way, will cheerfully devote several hours of his time giving wrong directions to a total stranger who claims to be lost.
    John Steinbeck (1902–1968)

    There is an untroubled harmony in everything, a full consonance in nature; only in our illusory freedom do we feel at variance with it.
    Fyodor Tyutchev (1803–1873)