Theory
It generates sampling values from an arbitrary probability distribution function by using an instrumental distribution, under the only restriction that where is an appropriate bound on .
Rejection sampling is usually used in cases where the form of makes sampling difficult. Instead of sampling directly from the distribution, we use an envelope distribution where sampling is easier. These samples from are probabilistically accepted or rejected.
This method relates to the general field of Monte Carlo techniques, including Markov chain Monte Carlo algorithms that also use a proxy distribution to achieve simulation from the target distribution . It forms the basis for algorithms such as the Metropolis algorithm.
The unconditional acceptance probability is the proportion of proposed samples which are accepted, which is . If is low, fewer samples are rejected, and the required number of samples for the target distribution is obtained more quickly. Because must be no less than the maximum of, the unconditional acceptance probability is higher the less that ratio varies, however to obtain acceptance probability 1, which defeats the purpose of sampling.
Read more about this topic: Rejection Sampling
Famous quotes containing the word theory:
“Everything to which we concede existence is a posit from the standpoint of a description of the theory-building process, and simultaneously real from the standpoint of the theory that is being built. Nor let us look down on the standpoint of the theory as make-believe; for we can never do better than occupy the standpoint of some theory or other, the best we can muster at the time.”
—Willard Van Orman Quine (b. 1908)
“A theory of the middle class: that it is not to be determined by its financial situation but rather by its relation to government. That is, one could shade down from an actual ruling or governing class to a class hopelessly out of relation to government, thinking of gov’t as beyond its control, of itself as wholly controlled by gov’t. Somewhere in between and in gradations is the group that has the sense that gov’t exists for it, and shapes its consciousness accordingly.”
—Lionel Trilling (1905–1975)
“In the theory of gender I began from zero. There is no masculine power or privilege I did not covet. But slowly, step by step, decade by decade, I was forced to acknowledge that even a woman of abnormal will cannot escape her hormonal identity.”
—Camille Paglia (b. 1947)