Law of Total Variance

In probability theory, the law of total variance or variance decomposition formula, also known by the acronym EVVE (or Eve's law), states that if X and Y are random variables on the same probability space, and the variance of Y is finite, then

Some writers on probability call this the "conditional variance formula". In language perhaps better known to statisticians than to probabilists, the two terms are the "unexplained" and the "explained component of the variance" (cf. fraction of variance unexplained, explained variation).

There is a general variance decomposition formula for c2 components (see below) . For example, with two conditioning random variables:

which follows from the law of total conditional variance:

Note that the conditional expected value E( Y | X ) is a random variable in its own right, whose value depends on the value of X. Notice that the conditional expected value of Y given the event X = x is a function of x (this is where adherence to the conventional and rigidly case-sensitive notation of probability theory becomes important!). If we write E( Y | X = x ) = g(x) then the random variable E( Y | X ) is just g(X). Similar comments apply to the conditional variance.

Read more about Law Of Total Variance:  Proof, General Variance Decomposition Applicable To Dynamic Systems, The Square of The Correlation and Explained (or Informational) Variation, Higher Moments

Famous quotes containing the words law of, law, total and/or variance:

    Just as the constant increase of entropy is the basic law of the universe, so it is the basic law of life to be ever more highly structured and to struggle against entropy.
    Václav Havel (b. 1936)

    Who does not know history’s first law to be that an author must not dare to tell anything but the truth? And its second that he must make bold to tell the whole truth? That there must be no suggestion of partiality anywhere in his writings? Nor of malice?
    Marcus Tullius Cicero (106–43 B.C.)

    “Never hug and kiss your children! Mother love may make your children’s infancy unhappy and prevent them from pursuing a career or getting married!” That’s total hogwash, of course. But it shows on extreme example of what state-of-the-art “scientific” parenting was supposed to be in early twentieth-century America. After all, that was the heyday of efficiency experts, time-and-motion studies, and the like.
    Lawrence Kutner (20th century)

    There is an untroubled harmony in everything, a full consonance in nature; only in our illusory freedom do we feel at variance with it.
    Fyodor Tyutchev (1803–1873)