Minimum Mean Square Error - Definition

Definition

Let be an unknown random vector variable, and let be a known random vector variable (the measurement or observation). An estimator of is any function of the measurement . The estimation error vector is given by and its mean squared error (MSE) is given by the trace of error covariance matrix

,

where the expectation is taken over both and . When is a scalar variable, then MSE expression simplifies to . Note that MSE could equivalently be defined in other ways, since

The MMSE estimator is then defined as the estimator achieving minimal MSE.

Read more about this topic:  Minimum Mean Square Error

Famous quotes containing the word definition:

    The very definition of the real becomes: that of which it is possible to give an equivalent reproduction.... The real is not only what can be reproduced, but that which is always already reproduced. The hyperreal.
    Jean Baudrillard (b. 1929)

    ... we all know the wag’s definition of a philanthropist: a man whose charity increases directly as the square of the distance.
    George Eliot [Mary Ann (or Marian)

    Mothers often are too easily intimidated by their children’s negative reactions...When the child cries or is unhappy, the mother reads this as meaning that she is a failure. This is why it is so important for a mother to know...that the process of growing up involves by definition things that her child is not going to like. Her job is not to create a bed of roses, but to help him learn how to pick his way through the thorns.
    Elaine Heffner (20th century)