Law of Total Expectation - Proof in The Discrete Case

Proof in The Discrete Case

\begin{align} \operatorname{E}_Y \left( \operatorname{E}_X(X|Y) \right) &{} = \operatorname{E}_y \Bigg \\ &{}=\sum_y \Bigg \cdot \operatorname{P}(Y=y) \\ &{}=\sum_y \sum_x x \cdot \operatorname{P}(X=x|Y=y) \cdot \operatorname{P}(Y=y) \\ &{}=\sum_x x \sum_y \operatorname{P}(X=x|Y=y) \cdot \operatorname{P}(Y=y) \\ &{}=\sum_x x \sum_y \operatorname{P}(X=x, Y=y) \\ &{}=\sum_x x \cdot \operatorname{P}(X=x) \\ &{}=\operatorname{E}(X). \end{align}

Read more about this topic:  Law Of Total Expectation

Famous quotes containing the words proof, discrete and/or case:

    “The proof of a poet is that his country absorbs him as affectionately as he has absorbed it.”
    —Walt Whitman (1819–1892)

    “One can describe a landscape in many different words and sentences, but one would not normally cut up a picture of a landscape and rearrange it in different patterns in order to describe it in different ways. Because a photograph is not composed of discrete units strung out in a linear row of meaningful pieces, we do not understand it by looking at one element after another in a set sequence. The photograph is understood in one act of seeing; it is perceived in a gestalt.”
    —Joshua Meyrowitz, U.S. educator, media critic. “The Blurring of Public and Private Behaviors,” No Sense of Place: The Impact of Electronic Media on Social Behavior, Oxford University Press (1985)

    “I often used to think myself in the case of the fox-hunter, who, when he had toiled and sweated all day in the chase as if some unheard-of blessing was to crown his success, finds at last all he has got by his labor is a stinking nauseous animal. But my condition was yet worse than his; for he leaves the loathsome wretch to be torn by his hounds, whilst I was obliged to fondle mine, and meanly pretend him to be the object of my love.”
    —Sarah Fielding (1710–1768)