In statistics, the hat matrix, H, sometimes also called projection matrix, maps the vector of observed values to the vector of fitted values. It describes the influence each observed value has on each fitted value. The diagonal elements of the hat matrix are the leverages, which describe the influence each observed value has on the fitted value for that same observation.
If the vector of observed values is denoted by y and the vector of fitted values by ŷ,
As ŷ is usually pronounced "y-hat", the hat matrix is so named as it "puts a hat on y".
Suppose that we wish to solve a linear model using linear least squares. The model can be written as
where X is a matrix of explanatory variables (the design matrix), β is a vector of unknown parameters to be estimated, and ε is the error vector.
Read more about Hat Matrix: Uncorrelated Errors, Correlated Errors, Blockwise Formula
Famous quotes containing the words hat and/or matrix:
“The hat I was married in,
will it do?
White, broad, fake flowers in a tiny array.
It’s old-fashioned, as stylish as a bedbug,
but it suits to die in something nostalgic.”
—Anne Sexton (1928–1974)
“As all historians know, the past is a great darkness, and filled with echoes. Voices may reach us from it; but what they say to us is imbued with the obscurity of the matrix out of which they come; and try as we may, we cannot always decipher them precisely in the clearer light of our day.”
—Margaret Atwood (b. 1939)