Integration By Substitution - Application in Probability

Application in Probability

Substitution can be used to answer the following important question in probability: given a random variable with probability density and another random variable related to by the equation, what is the probability density for ?

It is easiest to answer this question by first answering a slightly different question: what is the probability that takes a value in some particular subset ? Denote this probability . Of course, if has probability density then the answer is

but this isn't really useful because we don't know py; it's what we're trying to find in the first place. We can make progress by considering the problem in the variable . takes a value in S whenever X takes a value in, so

Changing from variable x to y gives

P(Y \in S) = \int_{\Phi^{-1}(S)} p_x(x)~dx = \int_S p_x(\Phi^{-1}(y)) ~ \left|\frac{d\Phi^{-1}}{dy}\right|~dy.

Combining this with our first equation gives

\int_S p_y(y)~dy = \int_S p_x(\Phi^{-1}(y)) ~ \left|\frac{d\Phi^{-1}}{dy}\right|~dy

so

p_y(y) = p_x(\Phi^{-1}(y)) ~ \left|\frac{d\Phi^{-1}}{dy}\right|.

In the case where and depend on several uncorrelated variables, i.e., and, can be found by substitution in several variables discussed above. The result is

p_y(y) = p_x(\Phi^{-1}(y)) ~ \left|\det \left \right|.

Read more about this topic:  Integration By Substitution

Famous quotes containing the words application and/or probability:

    “Great abilites are not requisite for an Historian; for in historical composition, all the greatest powers of the human mind are quiescent. He has facts ready to his hand; so there is no exercise of invention. Imagination is not required in any degree; only about as much as is used in the lowest kinds of poetry. Some penetration, accuracy, and colouring, will fit a man for the task, if he can give the application which is necessary.”
    —Samuel Johnson (1709–1784)

    “Only in Britain could it be thought a defect to be “too clever by half.” The probability is that too many people are too stupid by three-quarters.”
    —John Major (b. 1943)