In statistics, the hat matrix, H, sometimes also called projection matrix, maps the vector of observed values to the vector of fitted values. It describes the influence each observed value has on each fitted value. The diagonal elements of the hat matrix are the leverages, which describe the influence each observed value has on the fitted value for that same observation.
If the vector of observed values is denoted by y and the vector of fitted values by ŷ,
As ŷ is usually pronounced "y-hat", the hat matrix is so named as it "puts a hat on y".
Suppose that we wish to solve a linear model using linear least squares. The model can be written as
where X is a matrix of explanatory variables (the design matrix), β is a vector of unknown parameters to be estimated, and ε is the error vector.
Read more about Hat Matrix: Uncorrelated Errors, Correlated Errors, Blockwise Formula
Famous quotes containing the words hat and/or matrix:
“Every one knows about the young man who falls in love with the chorus-girl because she can kick his hat off, and his sister’s friends can’t or won’t. But the youth who marries her, expecting that all her departures from convention will be as agile or as delightful to him as that, is still the classic example of folly.”
—Katharine Fullerton Gerould (1879–1944)
““The matrix is God?”
“In a manner of speaking, although it would be more accurate ... to say that the matrix has a God, since this being’s omniscience and omnipotence are assumed to be limited to the matrix.”
“If it has limits, it isn’t omnipotent.”
“Exactly.... Cyberspace exists, insofar as it can be said to exist, by virtue of human agency.””
—William Gibson (b. 1948)