Law of Total Expectation - Proof in The Discrete Case

Proof in The Discrete Case

\begin{align} \operatorname{E}_Y \left( \operatorname{E}_X(X|Y) \right) &{} = \operatorname{E}_y \Bigg \\ &{}=\sum_y \Bigg \cdot \operatorname{P}(Y=y) \\ &{}=\sum_y \sum_x x \cdot \operatorname{P}(X=x|Y=y) \cdot \operatorname{P}(Y=y) \\ &{}=\sum_x x \sum_y \operatorname{P}(X=x|Y=y) \cdot \operatorname{P}(Y=y) \\ &{}=\sum_x x \sum_y \operatorname{P}(X=x, Y=y) \\ &{}=\sum_x x \cdot \operatorname{P}(X=x) \\ &{}=\operatorname{E}(X). \end{align}

Read more about this topic:  Law Of Total Expectation

Famous quotes containing the words proof, discrete and/or case:

    “There are some persons in this world, who, unable to give better proof of being wise, take a strange delight in showing what they think they have sagaciously read in mankind by uncharitable suspicions of them.”
    —Herman Melville (1819–1891)

    “We have good reason to believe that memories of early childhood do not persist in consciousness because of the absence or fragmentary character of language covering this period. Words serve as fixatives for mental images. . . . Even at the end of the second year of life when word tags exist for a number of objects in the child’s life, these words are discrete and do not yet bind together the parts of an experience or organize them in a way that can produce a coherent memory.”
    —Selma H. Fraiberg (20th century)

    “When a cat cries over a rat, it’s a case of false compassion.”
    —Chinese proverb.