Description
Assume that we want to estimate an unobserved population parameter on the basis of observations . Let be the sampling distribution of, so that is the probability of when the underlying population parameter is . Then the function
is known as the likelihood function and the estimate
is the maximum likelihood estimate of .
Now assume that a prior distribution over exists. This allows us to treat as a random variable as in Bayesian statistics. Then the posterior distribution of is as follows:
where is density function of, is the domain of . This is a straightforward application of Bayes' theorem.
The method of maximum a posterior estimation then estimates as the mode of the posterior distribution of this random variable:
The denominator of the posterior distribution (so-called partition function) does not depend on and therefore plays no role in the optimization. Observe that the MAP estimate of coincides with the ML estimate when the prior is uniform (that is, a constant function). The MAP estimate is a limit of Bayes estimators under a sequence of 0-1 loss functions, but generally not a Bayes estimator per se, unless is discrete.
Read more about this topic: Maximum A Posteriori Estimation
Famous quotes containing the word description:
“I was here first introduced to Joe.... He was a good-looking Indian, twenty-four years old, apparently of unmixed blood, short and stout, with a broad face and reddish complexion, and eyes, methinks, narrower and more turned up at the outer corners than ours, answering to the description of his race. Besides his underclothing, he wore a red flannel shirt, woolen pants, and a black Kossuth hat, the ordinary dress of the lumberman, and, to a considerable extent, of the Penobscot Indian.”
—Henry David Thoreau (1817–1862)
“Everything to which we concede existence is a posit from the standpoint of a description of the theory-building process, and simultaneously real from the standpoint of the theory that is being built. Nor let us look down on the standpoint of the theory as make-believe; for we can never do better than occupy the standpoint of some theory or other, the best we can muster at the time.”
—Willard Van Orman Quine (b. 1908)
“The next Augustan age will dawn on the other side of the Atlantic. There will, perhaps, be a Thucydides at Boston, a Xenophon at New York, and, in time, a Virgil at Mexico, and a Newton at Peru. At last, some curious traveller from Lima will visit England and give a description of the ruins of St. Paul’s, like the editions of Balbec and Palmyra.”
—Horace Walpole (1717–1797)