The General Problem
Consider an overdetermined system
of m linear equations in n unknown coefficients, β1,β2,…,βn, with m > n. This can be written in matrix form as
where
Such a system usually has no solution, so the goal is instead to find the coefficients β which fit the equations "best," in the sense of solving the quadratic minimization problem
where the objective function S is given by
A justification for choosing this criterion is given in properties below. This minimization problem has a unique solution, provided that the n columns of the matrix X are linearly independent, given by solving the normal equations
Read more about this topic: Linear Least Squares (mathematics)
Famous quotes containing the words general and/or problem:
“The general feeling was, and for a long time remained, that one had several children in order to keep just a few. As late as the seventeenth century . . . people could not allow themselves to become too attached to something that was regarded as a probable loss. This is the reason for certain remarks which shock our present-day sensibility, such as Montaignes observation, I have lost two or three children in their infancy, not without regret, but without great sorrow.”
—Philippe Ariés (20th century)
“Involuntary mental hospitalization is like slavery. Refining the standards for commitment is like prettifying the slave plantations. The problem is not how to improve commitment, but how to abolish it.”
—Thomas Szasz (b. 1920)
