Variance Reduction - Underlying Principle of The CRN Technique

Underlying Principle of The CRN Technique

Suppose and are the observations from the first and second configurations on the jth independent replication.

We want to estimate

If we perform n replications of each configuration and let

then and Z(n) = Σ Zj / n is an unbiased estimator of .

And since the 's are independent identically distributed random variables,

In case of independent sampling, i.e., no common random numbers used then Cov(X1j, X2j) = 0. But if we succeed to induce an element of positive correlation between X1 and X2 such that Cov(X1j, X2j) > 0, it can be seen from the equation above that the variance is reduced.

It can also be observed that if the CRN induces a negative correlation, i.e., Cov(X1j, X2j) < 0, this technique can actually backfire, where the variance is increased and not decreased (as intended).

Read more about this topic:  Variance Reduction

Famous quotes containing the words underlying, principle and/or technique:

    It is commonplace that a problem stated is well on its way to solution, for statement of the nature of a problem signifies that the underlying quality is being transformed into determinate distinctions of terms and relations or has become an object of articulate thought.
    John Dewey (1859–1952)

    I often wish for the end of the wretched remnant of my life; and that wish is a rational one; but then the innate principle of self-preservation, wisely implanted in our natures, for obvious purposes, opposes that wish, and makes us endeavour to spin out our thread as long as we can, however decayed and rotten it may be.
    Philip Dormer Stanhope, 4th Earl Chesterfield (1694–1773)

    The moment a man begins to talk about technique that’s proof that he is fresh out of ideas.
    Raymond Chandler (1888–1959)