Integration By Substitution - Application in Probability

Application in Probability

Substitution can be used to answer the following important question in probability: given a random variable with probability density and another random variable related to by the equation, what is the probability density for ?

It is easiest to answer this question by first answering a slightly different question: what is the probability that takes a value in some particular subset ? Denote this probability . Of course, if has probability density then the answer is

but this isn't really useful because we don't know p_y; it's what we're trying to find in the first place. We can make progress by considering the problem in the variable . takes a value in S whenever X takes a value in, so

Changing from variable x to y gives

$P(Y \in S) = \int_{\Phi^{-1}(S)} p_x(x)~dx = \int_S p_x(\Phi^{-1}(y)) ~ \left|\frac{d\Phi^{-1}}{dy}\right|~dy.$

Combining this with our first equation gives

$\int_S p_y(y)~dy = \int_S p_x(\Phi^{-1}(y)) ~ \left|\frac{d\Phi^{-1}}{dy}\right|~dy$

$p_y(y) = p_x(\Phi^{-1}(y)) ~ \left|\frac{d\Phi^{-1}}{dy}\right|.$

In the case where and depend on several uncorrelated variables, i.e., and, can be found by substitution in several variables discussed above. The result is

$p_y(y) = p_x(\Phi^{-1}(y)) ~ \left|\det \left \right|.$

Read more about this topic: Integration By Substitution

Famous quotes containing the words application and/or probability:

“We will not be imposed upon by this vast application of forces. We believe that most things will have to be accomplished still by the application called Industry. We are rather pleased, after all, to consider the small private, but both constant and accumulated, force which stands behind every spade in the field. This it is that makes the valleys shine, and the deserts really bloom.”
—Henry David Thoreau (1817–1862)

“The probability of learning something unusual from a newspaper is far greater than that of experiencing it; in other words, it is in the realm of the abstract that the more important things happen in these times, and it is the unimportant that happens in real life.”
—Robert Musil (1880–1942)