Linear Least Squares (mathematics) - Objective Function

Objective Function

The objective function can be written as

since (IH) is also symmetric and idempotent. It can be shown from this, that the expected value of S is m-n. Note, however, that this is true only if the weights have been assigned correctly. If unit weights are assumed, the expected value of S is, where is the variance of an observation.

If it is assumed that the residuals belong to a Normal distribution, the objective function, being a sum of weighted squared residuals, will belong to a Chi-squared distribution with m-n degrees of freedom. Some illustrative percentile values of are given in the following table.

m-n
10 9.34 18.3 23.2
25 24.3 37.7 44.3
100 99.3 124 136

These values can be used for a statistical criterion as to the goodness-of-fit. When unit weights are used, the numbers should be divided by the variance of an observation.

Read more about this topic:  Linear Least Squares (mathematics)

Famous quotes containing the words objective and/or function:

    I am not a great man, but sometimes I think the impersonal and objective equality of my talent and the sacrifices of it, in pieces, to preserve its essential value has some sort of epic grandeur.
    F. Scott Fitzgerald (1896–1940)

    As a medium of exchange,... worrying regulates intimacy, and it is often an appropriate response to ordinary demands that begin to feel excessive. But from a modernized Freudian view, worrying—as a reflex response to demand—never puts the self or the objects of its interest into question, and that is precisely its function in psychic life. It domesticates self-doubt.
    Adam Phillips, British child psychoanalyst. “Worrying and Its Discontents,” in On Kissing, Tickling, and Being Bored, p. 58, Harvard University Press (1993)