The Square of The Correlation and Explained (or Informational) Variation
In cases where (Y, X) are such that the conditional expected value is linear; i.e., in cases where
it follows from the bilinearity of Cov(-,-) that
and
and the explained component of the variance divided by the total variance is just the square of the correlation between Y and X; i.e., in such cases,
One example of this situation is when (X, Y) have a bivariate normal (Gaussian) distribution.
More generally, when the conditional expectation E( Y | X ) is a non-linear function of X
which can be estimated as the R squared from a non-linear regression of Y on X, using data drawn from the joint distribution of (X,Y). When E( Y | X ) has a Gaussian distribution (and is an invertible function of X), or Y itself has a (marginal) Gaussian distribution, this explained component of variation sets a lower bound on the mutual information:
Read more about this topic: Law Of Total Variance
Famous quotes containing the words square and/or explained:
“I would say it was the coffin of a midget
Or a square baby
Were there not such a din in it.”
—Sylvia Plath (19321963)
“There are several natural phenomena which I shall have to have explained to me before I can keep on going as a resident member of the human race. One is the metamorphosis which hats and suits undergo exactly one week after their purchase, whereby they are changed from smart, intensely becoming articles of apparel into something children use when they want to dress up like daddy.”
—Robert Benchley (18891945)