Linear Least Squares (mathematics) - Objective Function

Objective Function

The objective function can be written as

since (IH) is also symmetric and idempotent. It can be shown from this, that the expected value of S is m-n. Note, however, that this is true only if the weights have been assigned correctly. If unit weights are assumed, the expected value of S is, where is the variance of an observation.

If it is assumed that the residuals belong to a Normal distribution, the objective function, being a sum of weighted squared residuals, will belong to a Chi-squared distribution with m-n degrees of freedom. Some illustrative percentile values of are given in the following table.

m-n
10 9.34 18.3 23.2
25 24.3 37.7 44.3
100 99.3 124 136

These values can be used for a statistical criterion as to the goodness-of-fit. When unit weights are used, the numbers should be divided by the variance of an observation.

Read more about this topic:  Linear Least Squares (mathematics)

Famous quotes containing the words objective and/or function:

    Reason is a faculty far larger than mere objective force. When either the political or the scientific discourse announces itself as the voice of reason, it is playing God, and should be spanked and stood in the corner.
    Ursula K. Le Guin (b. 1929)

    Every boy was supposed to come into the world equipped with a father whose prime function was to be our father and show us how to be men. He can escape us, but we can never escape him. Present or absent, dead or alive, real or imagined, our father is the main man in our masculinity.
    Frank Pittman (20th century)