Integration By Substitution - Application in Probability

Application in Probability

Substitution can be used to answer the following important question in probability: given a random variable with probability density and another random variable related to by the equation, what is the probability density for ?

It is easiest to answer this question by first answering a slightly different question: what is the probability that takes a value in some particular subset ? Denote this probability . Of course, if has probability density then the answer is

but this isn't really useful because we don't know p_y; it's what we're trying to find in the first place. We can make progress by considering the problem in the variable . takes a value in S whenever X takes a value in, so

Changing from variable x to y gives

$P(Y \in S) = \int_{\Phi^{-1}(S)} p_x(x)~dx = \int_S p_x(\Phi^{-1}(y)) ~ \left|\frac{d\Phi^{-1}}{dy}\right|~dy.$

Combining this with our first equation gives

$\int_S p_y(y)~dy = \int_S p_x(\Phi^{-1}(y)) ~ \left|\frac{d\Phi^{-1}}{dy}\right|~dy$

$p_y(y) = p_x(\Phi^{-1}(y)) ~ \left|\frac{d\Phi^{-1}}{dy}\right|.$

In the case where and depend on several uncorrelated variables, i.e., and, can be found by substitution in several variables discussed above. The result is

$p_y(y) = p_x(\Phi^{-1}(y)) ~ \left|\det \left \right|.$

Read more about this topic: Integration By Substitution

Famous quotes containing the words application and/or probability:

“The application requisite to the duties of the office I hold [governor of Virginia] is so excessive, and the execution of them after all so imperfect, that I have determined to retire from it at the close of the present campaign.”
—Thomas Jefferson (1743–1826)

“Only in Britain could it be thought a defect to be “too clever by half.” The probability is that too many people are too stupid by three-quarters.”
—John Major (b. 1943)