Description
Assume that we want to estimate an unobserved population parameter on the basis of observations . Let be the sampling distribution of, so that is the probability of when the underlying population parameter is . Then the function
is known as the likelihood function and the estimate
is the maximum likelihood estimate of .
Now assume that a prior distribution over exists. This allows us to treat as a random variable as in Bayesian statistics. Then the posterior distribution of is as follows:
where is density function of, is the domain of . This is a straightforward application of Bayes' theorem.
The method of maximum a posterior estimation then estimates as the mode of the posterior distribution of this random variable:
The denominator of the posterior distribution (so-called partition function) does not depend on and therefore plays no role in the optimization. Observe that the MAP estimate of coincides with the ML estimate when the prior is uniform (that is, a constant function). The MAP estimate is a limit of Bayes estimators under a sequence of 0-1 loss functions, but generally not a Bayes estimator per se, unless is discrete.
Read more about this topic: Maximum A Posteriori Estimation
Famous quotes containing the word description:
“Whose are the truly labored sentences? From the weak and flimsy periods of the politician and literary man, we are glad to turn even to the description of work, the simple record of the month’s labor in the farmer’s almanac, to restore our tone and spirits.”
—Henry David Thoreau (1817–1862)
“The type of fig leaf which each culture employs to cover its social taboos offers a twofold description of its morality. It reveals that certain unacknowledged behavior exists and it suggests the form that such behavior takes.”
—Freda Adler (b. 1934)
“To give an accurate description of what has never occurred is not merely the proper occupation of the historian, but the inalienable privilege of any man of parts and culture.”
—Oscar Wilde (1854–1900)