Minimum Mean Square Error - Definition

Definition

Let be an unknown random vector variable, and let be a known random vector variable (the measurement or observation). An estimator of is any function of the measurement . The estimation error vector is given by and its mean squared error (MSE) is given by the trace of error covariance matrix

,

where the expectation is taken over both and . When is a scalar variable, then MSE expression simplifies to . Note that MSE could equivalently be defined in other ways, since

The MMSE estimator is then defined as the estimator achieving minimal MSE.

Read more about this topic:  Minimum Mean Square Error

Famous quotes containing the word definition:

    “... we all know the wag’s definition of a philanthropist: a man whose charity increases directly as the square of the distance.”
    —George Eliot [Mary Ann (or Marian)

    “It is very hard to give a just definition of love. The most we can say of it is this: that in the soul, it is a desire to rule; in the spirit, it is a sympathy; and in the body, it is but a hidden and subtle desire to possess—after many mysteries—what one loves.”
    —François, Duc De La Rochefoucauld (1613–1680)

    “The very definition of the real becomes: that of which it is possible to give an equivalent reproduction.... The real is not only what can be reproduced, but that which is always already reproduced. The hyperreal.”
    —Jean Baudrillard (b. 1929)