Law of Total Expectation - Proof in The Discrete Case

Proof in The Discrete Case

\begin{align} \operatorname{E}_Y \left( \operatorname{E}_X(X|Y) \right) &{} = \operatorname{E}_y \Bigg \\ &{}=\sum_y \Bigg \cdot \operatorname{P}(Y=y) \\ &{}=\sum_y \sum_x x \cdot \operatorname{P}(X=x|Y=y) \cdot \operatorname{P}(Y=y) \\ &{}=\sum_x x \sum_y \operatorname{P}(X=x|Y=y) \cdot \operatorname{P}(Y=y) \\ &{}=\sum_x x \sum_y \operatorname{P}(X=x, Y=y) \\ &{}=\sum_x x \cdot \operatorname{P}(X=x) \\ &{}=\operatorname{E}(X). \end{align}

Read more about this topic:  Law Of Total Expectation

Famous quotes containing the words proof, discrete and/or case:

    “Ah! I have penetrated to those meadows on the morning of many a first spring day, jumping from hummock to hummock, from willow root to willow root, when the wild river valley and the woods were bathed in so pure and bright a light as would have waked the dead, if they had been slumbering in their graves, as some suppose. There needs no stronger proof of immortality. All things must live in such a light. O Death, where was thy sting? O Grave, where was thy victory, then?”
    —Henry David Thoreau (1817–1862)

    “One can describe a landscape in many different words and sentences, but one would not normally cut up a picture of a landscape and rearrange it in different patterns in order to describe it in different ways. Because a photograph is not composed of discrete units strung out in a linear row of meaningful pieces, we do not understand it by looking at one element after another in a set sequence. The photograph is understood in one act of seeing; it is perceived in a gestalt.”
    —Joshua Meyrowitz, U.S. educator, media critic. “The Blurring of Public and Private Behaviors,” No Sense of Place: The Impact of Electronic Media on Social Behavior, Oxford University Press (1985)

    “If a playwright tried to see eye to eye with everybody, he would get the worst case of strabismus since Hannibal lost an eye trying to count his nineteen elephants during a snowstorm while crossing the Alps.”
    —James Thurber (1894–1961)