Variance Reduction - Underlying Principle of The CRN Technique

Underlying Principle of The CRN Technique

Suppose and are the observations from the first and second configurations on the jth independent replication.

We want to estimate

If we perform n replications of each configuration and let

then and Z(n) = Σ Zj / n is an unbiased estimator of .

And since the 's are independent identically distributed random variables,

In case of independent sampling, i.e., no common random numbers used then Cov(X1j, X2j) = 0. But if we succeed to induce an element of positive correlation between X1 and X2 such that Cov(X1j, X2j) > 0, it can be seen from the equation above that the variance is reduced.

It can also be observed that if the CRN induces a negative correlation, i.e., Cov(X1j, X2j) < 0, this technique can actually backfire, where the variance is increased and not decreased (as intended).

Read more about this topic:  Variance Reduction

Famous quotes containing the words underlying, principle and/or technique:

    Every age develops its own peculiar forms of pathology, which express in exaggerated form its underlying character structure.
    Christopher Lasch (b. 1932)

    Why does philosophy use concepts and why does faith use symbols if both try to express the same ultimate? The answer, of course, is that the relation to the ultimate is not the same in each case. The philosophical relation is in principle a detached description of the basic structure in which the ultimate manifests itself. The relation of faith is in principle an involved expression of concern about the meaning of the ultimate for the faithful.
    Paul Tillich (1886–1965)

    The more technique you have, the less you have to worry about it. The more technique there is, the less there is.
    Pablo Picasso (1881–1973)