Blockwise Formula
Suppose the design matrix can be decomposed by columns as . Define the Hat operator as . Similarly, define the residual operator as . Then the Hat matrix of can be decomposed as follows:
There are a number of applications of such a partitioning. The classical application has a column of all ones, which allows one to analyze the effects of adding an intercept term to a regression. Another use is in the fixed effects model, where is a large sparse matrix of the dummy variables for the fixed effect terms. One can use this partition to compute the hat matrix of without explicitly forming the matrix, which might be too large to fit into computer memory.
Read more about this topic: Hat Matrix
Famous quotes containing the word formula:
“Ideals possess the strange quality that if they were completely realized they would turn into nonsense. One could easily follow a commandment such as “Thou shalt not kill” to the point of dying of starvation; and I might establish the formula that for the proper functioning of the mesh of our ideals, as in the case of a strainer, the holes are just as important as the mesh.”
—Robert Musil (1880–1942)