Variance Reduction - Underlying Principle of The CRN Technique

Underlying Principle of The CRN Technique

Suppose and are the observations from the first and second configurations on the jth independent replication.

We want to estimate

If we perform n replications of each configuration and let

then and Z(n) = Σ Zj / n is an unbiased estimator of .

And since the 's are independent identically distributed random variables,

In case of independent sampling, i.e., no common random numbers used then Cov(X1j, X2j) = 0. But if we succeed to induce an element of positive correlation between X1 and X2 such that Cov(X1j, X2j) > 0, it can be seen from the equation above that the variance is reduced.

It can also be observed that if the CRN induces a negative correlation, i.e., Cov(X1j, X2j) < 0, this technique can actually backfire, where the variance is increased and not decreased (as intended).

Read more about this topic:  Variance Reduction

Famous quotes containing the words underlying, principle and/or technique:

    Sport in the sense of a mass-spectacle, with death to add to the underlying excitement, comes into existence when a population has been drilled and regimented and depressed to such an extent that it needs at least a vicarious participation in difficult feats of strength or skill or heroism in order to sustain its waning life-sense.
    Lewis Mumford (1895–1990)

    The more the specific feelings of being under obligation range themselves under a supreme principle of human dependence the clearer and more fertile will be the realization of the concept, indispensable to all true culture, of service; from the service of God down to the simple social relationship as between employer and employee.
    Johan Huizinga (1872–1945)

    I cannot think that espionage can be recommended as a technique for building an impressive civilisation. It’s a lout’s game.
    Rebecca West (1892–1983)