Linear Least Squares (mathematics) - Objective Function

Objective Function

The objective function can be written as

since (IH) is also symmetric and idempotent. It can be shown from this, that the expected value of S is m-n. Note, however, that this is true only if the weights have been assigned correctly. If unit weights are assumed, the expected value of S is, where is the variance of an observation.

If it is assumed that the residuals belong to a Normal distribution, the objective function, being a sum of weighted squared residuals, will belong to a Chi-squared distribution with m-n degrees of freedom. Some illustrative percentile values of are given in the following table.

m-n
10 9.34 18.3 23.2
25 24.3 37.7 44.3
100 99.3 124 136

These values can be used for a statistical criterion as to the goodness-of-fit. When unit weights are used, the numbers should be divided by the variance of an observation.

Read more about this topic:  Linear Least Squares (mathematics)

Famous quotes containing the words objective and/or function:

    In what does the objective measure of value lie? In the quantum of enhanced and organized power alone, in accordance with what occurs in all occurrence, a will to increase.
    Friedrich Nietzsche (1844–1900)

    The function of literature, through all its mutations, has been to make us aware of the particularity of selves, and the high authority of the self in its quarrel with its society and its culture. Literature is in that sense subversive.
    Lionel Trilling (1905–1975)