Relationship To Principal Components
The first principal component about the mean of a set of points can be represented by that line which most closely approaches the data points (as measured by squared distance of closest approach, i.e. perpendicular to the line). In contrast, linear least squares tries to minimize the distance in the direction only. Thus, although the two use a similar error metric, linear least squares is a method that treats one dimension of the data preferentially, while PCA treats all dimensions equally.
Read more about this topic: Least Squares
Famous quotes containing the words relationship, principal and/or components:
“Guilty, guilty, guilty is the chant divorced parents repeat in their heads. This constant reminder remains just below our consciousness. Nevertheless, its presence clouds our judgment, inhibits our actions, and interferes in our relationship with our children. Guilt is a major roadblock to building a new life for yourself and to being an effective parent.”
—Stephanie Marston (20th century)
“I would urge that the yeast of education is the idea of excellence, and the idea of excellence comprises as many forms as there are individuals, each of whom develops his own image of excellence. The school must have as one of its principal functions the nurturing of images of excellence.”
—Jerome S. Bruner (20th century)
“Hence, a generative grammar must be a system of rules that can iterate to generate an indefinitely large number of structures. This system of rules can be analyzed into the three major components of a generative grammar: the syntactic, phonological, and semantic components.”
—Noam Chomsky (b. 1928)