Theory
It generates sampling values from an arbitrary probability distribution function by using an instrumental distribution, under the only restriction that where is an appropriate bound on .
Rejection sampling is usually used in cases where the form of makes sampling difficult. Instead of sampling directly from the distribution, we use an envelope distribution where sampling is easier. These samples from are probabilistically accepted or rejected.
This method relates to the general field of Monte Carlo techniques, including Markov chain Monte Carlo algorithms that also use a proxy distribution to achieve simulation from the target distribution . It forms the basis for algorithms such as the Metropolis algorithm.
The unconditional acceptance probability is the proportion of proposed samples which are accepted, which is . If is low, fewer samples are rejected, and the required number of samples for the target distribution is obtained more quickly. Because must be no less than the maximum of, the unconditional acceptance probability is higher the less that ratio varies, however to obtain acceptance probability 1, which defeats the purpose of sampling.
Read more about this topic: Rejection Sampling
Famous quotes containing the word theory:
“... the first reason for psychology’s failure to understand what people are and how they act, is that clinicians and psychiatrists, who are generally the theoreticians on these matters, have essentially made up myths without any evidence to support them; the second reason for psychology’s failure is that personality theory has looked for inner traits when it should have been looking for social context.”
—Naomi Weisstein (b. 1939)
“No theory is good unless it permits, not rest, but the greatest work. No theory is good except on condition that one use it to go on beyond.”
—André Gide (1869–1951)
“It is not enough for theory to describe and analyse, it must itself be an event in the universe it describes. In order to do this theory must partake of and become the acceleration of this logic. It must tear itself from all referents and take pride only in the future. Theory must operate on time at the cost of a deliberate distortion of present reality.”
—Jean Baudrillard (b. 1929)