Maximum A Posteriori Estimation - Example

Example

Suppose that we are given a sequence of IID random variables and an a priori distribution of is given by . We wish to find the MAP estimate of .

The function to be maximized is then given by

which is equivalent to minimizing the following function of :

Thus, we see that the MAP estimator for μ is given by

which turns out to be a linear interpolation between the prior mean and the sample mean weighted by their respective covariances.

The case of is called a non-informative prior and leads to an ill-defined a priori probability distribution; in this case

Read more about this topic:  Maximum A Posteriori Estimation

Famous quotes containing the word example:

    Our intellect is not the most subtle, the most powerful, the most appropriate, instrument for revealing the truth. It is life that, little by little, example by example, permits us to see that what is most important to our heart, or to our mind, is learned not by reasoning but through other agencies. Then it is that the intellect, observing their superiority, abdicates its control to them upon reasoned grounds and agrees to become their collaborator and lackey.
    Marcel Proust (1871–1922)