Variance Reduction - Underlying Principle of The CRN Technique

Underlying Principle of The CRN Technique

Suppose and are the observations from the first and second configurations on the jth independent replication.

We want to estimate

If we perform n replications of each configuration and let

then and Z(n) = Σ Zj / n is an unbiased estimator of .

And since the 's are independent identically distributed random variables,

In case of independent sampling, i.e., no common random numbers used then Cov(X1j, X2j) = 0. But if we succeed to induce an element of positive correlation between X1 and X2 such that Cov(X1j, X2j) > 0, it can be seen from the equation above that the variance is reduced.

It can also be observed that if the CRN induces a negative correlation, i.e., Cov(X1j, X2j) < 0, this technique can actually backfire, where the variance is increased and not decreased (as intended).

Read more about this topic:  Variance Reduction

Famous quotes containing the words underlying, principle and/or technique:

    Mothers seem to be in subtle competition with teachers. There is always an underlying fear that teachers will do a better job than they have done with their child.... But mostly mothers feel that their areas of competence are very much similar to those of the teacher. In fact they feel they know their child better than anyone else and that the teacher doesn’t possess any special field of authority or expertise.
    Sara Lawrence Lightfoot (20th century)

    A certain secret jealousy of the British Minister is always lurking in the breast of every American Senator, if he is truly democratic; for democracy, rightly understood, is the government of the people, by the people, for the benefit of Senators, and there is always a danger that the British Minister may not understand this political principle as he should.
    Henry Brooks Adams (1838–1918)

    The more technique you have, the less you have to worry about it. The more technique there is, the less there is.
    Pablo Picasso (1881–1973)