Maximum-likelihood Estimation For The Multivariate Normal Distribution
A random vector X ∈ Rp (a p×1 "column vector") has a multivariate normal distribution with a nonsingular covariance matrix Σ precisely if Σ ∈ Rp × p is a positive-definite matrix and the probability density function of X is
where μ ∈ Rp×1 is the expected value of X. The covariance matrix Σ is the multidimensional analog of what in one dimension would be the variance, and normalizes the density so that it integrates to 1.
Suppose now that X1, ..., Xn are independent and identically distributed samples from the distribution above. Based on the observed values x1, ..., xn of this sample, we wish to estimate Σ.
Read more about this topic: Estimation Of Covariance Matrices
Famous quotes containing the words estimation, normal and/or distribution:
“A higher class, in the estimation and love of this city- building, market-going race of mankind, are the poets, who, from the intellectual kingdom, feed the thought and imagination with ideas and pictures which raise men out of the world of corn and money, and console them for the short-comings of the day, and the meanness of labor and traffic.”
—Ralph Waldo Emerson (1803–1882)
“Marriages will survive despite enormous strains. A lover will ask, “Is he happy? Can he still love her?” They don’t realise that’s not the point, it’s all the normal things they do together—going to the supermarket, choosing wallpaper, doing things with the children.”
—Carol Clewlow (b. 1947)
“There is the illusion of time, which is very deep; who has disposed of it? Mor come to the conviction that what seems the succession of thought is only the distribution of wholes into causal series.”
—Ralph Waldo Emerson (1803–1882)