Description
Suppose the available data consists of T iid observations {Yt } t = 1,...,T, where each observation Yt is an n-dimensional multivariate random variable. The data comes from a certain statistical model, defined up to an unknown parameter θ ∈ Θ. The goal of the estimation problem is to find the “true” value of this parameter, θ0, or at least a reasonably close estimate.
In order to apply GMM there should exist a vector-valued function g(Y,θ) such that
where E denotes expectation, and Yt is a generic observation, which are all assumed to be iid. Moreover, function m(θ) must not be equal to zero for θ ≠ θ0, or otherwise parameter θ will not be identified.
The basic idea behind GMM is to replace the theoretical expected value E with its empirical analog — sample average:
and then to minimize the norm of this expression with respect to θ.
By the law of large numbers, for large values of T, and thus we expect that . The generalized method of moments looks for a number which would make as close to zero as possible. Mathematically, this is equivalent to minimizing a certain norm of (norm of m, denoted as ||m||, measures the distance between m and zero). The properties of the resulting estimator will depend on the particular choice of the norm function, and therefore the theory of GMM considers an entire family of norms, defined as
where W is a positive-definite weighting matrix, and m′ denotes transposition. In practice, the weighting matrix W is computed based on the available data set, which will be denoted as . Thus, the GMM estimator can be written as
Under suitable conditions this estimator is consistent, asymptotically normal, and with right choice of weighting matrix asymptotically efficient.
Read more about this topic: Generalized Method Of Moments
Famous quotes containing the word description:
“He hath achieved a maid
That paragons description and wild fame;
One that excels the quirks of blazoning pens.”
—William Shakespeare (1564–1616)
“Everything to which we concede existence is a posit from the standpoint of a description of the theory-building process, and simultaneously real from the standpoint of the theory that is being built. Nor let us look down on the standpoint of the theory as make-believe; for we can never do better than occupy the standpoint of some theory or other, the best we can muster at the time.”
—Willard Van Orman Quine (b. 1908)
“As they are not seen on their way down the streams, it is thought by fishermen that they never return, but waste away and die, clinging to rocks and stumps of trees for an indefinite period; a tragic feature in the scenery of the river bottoms worthy to be remembered with Shakespeare’s description of the sea-floor.”
—Henry David Thoreau (1817–1862)