The proposition in probability theory known as the law of total expectation, the law of iterated expectations, Adam's law, the tower rule, the smoothing theorem, among other names, states that if X is an integrable random variable (i.e., a random variable satisfying E( | X | ) < ∞) and Y is any random variable, not necessarily integrable, on the same probability space, then
i.e., the expected value of the conditional expected value of X given Y is the same as the expected value of X.
The nomenclature used here parallels the phrase law of total probability. See also law of total variance.
(The conditional expected value E( X | Y ) is a random variable in its own right, whose value depends on the value of Y. Notice that the conditional expected value of X given the event Y = y is a function of y (this is where adherence to the conventional rigidly case-sensitive notation of probability theory becomes important!). If we write E( X | Y = y) = g(y) then the random variable E( X | Y ) is just g(Y).
Read more about Law Of Total Expectation: Proof in The Discrete Case, Iterated Expectations With Nested Conditioning Sets
Famous quotes containing the words law of, law, total and/or expectation:
“All men, in the abstract, are just and good; what hinders them, in the particular, is, the momentary predominance of the finite and individual over the general truth. The condition of our incarnation in a private self, seems to be, a perpetual tendency to prefer the private law, to obey the private impulse, to the exclusion of the law of the universal being.”
—Ralph Waldo Emerson (1803–1882)
“Judge—A law student who marks his own examination-papers.”
—H.L. (Henry Lewis)
“You need an infinite stretch of time ahead of you to start to think, infinite energy to make the smallest decision. The world is getting denser. The immense number of useless projects is bewildering. Too many things have to be put in to balance up an uncertain scale. You can’t disappear anymore. You die in a state of total indecision.”
—Jean Baudrillard (b. 1929)
“The expectation that every neurotic phenomenon can be cured may, I suspect, be derived from the layman’s belief that the neuroses are something quite unnecessary which have no right whatever to exist. Whereas in fact they are severe, constitutionally fixed illnesses, which rarely restrict themselves to only a few attacks but persist as a rule over long periods throughout life.”
—Sigmund Freud (1856–1939)