Sum of Squares and Degrees of Freedom
In statistical testing problems, one usually isn't interested in the component vectors themselves, but rather in their squared lengths, or Sum of Squares. The degrees of freedom associated with a sum-of-squares is the degrees-of-freedom of the corresponding component vectors.
The three-population example above is an example of one-way Analysis of Variance. The model, or treatment, sum-of-squares is the squared length of the second vector,
with 2 degrees of freedom. The residual, or error, sum-of-squares is
with 3(n-1) degrees of freedom. Of course, introductory books on ANOVA usually state formulae without showing the vectors, but it is this underlying geometry that gives rise to SS formulae, and shows how to unambiguously determine the degrees of freedom in any given situation.
Under the null hypothesis of no difference between population means (and assuming that standard ANOVA regularity assumptions are satisfied) the sums of squares have scaled chi-squared distributions, with the corresponding degrees of freedom. The F-test statistic is the ratio, after scaling by the degrees of freedom. If there is no difference between population means this ratio follows an F distribution with 2 and 3n − 3 degrees of freedom.
In some complicated settings, such as unbalanced split-plot designs, the sums-of-squares no longer have scaled chi-squared distributions. Comparison of sum-of-squares with degrees-of-freedom is no longer meaningful, and software may report certain fractional 'degrees of freedom' in these cases. Such numbers have no genuine degrees-of-freedom interpretation, but are simply providing an approximate chi-squared distribution for the corresponding sum-of-squares. The details of such approximations are beyond the scope of this page.
Read more about this topic: Degrees Of Freedom (statistics)
Famous quotes containing the words sum of, sum, squares, degrees and/or freedom:
“What God abandoned, these defended,
And saved the sum of things for pay.”
—A.E. (Alfred Edward)
“The ornament is a statuette, a black figure of a bird. I am prepared to pay on behalf of the figure’s rightful owner the sum of $5000 for its recovery. I am prepared to promise, to promise ... what is the phrase?—’No questions will be asked.’”
—John Huston (1906–1987)
“And New York is the most beautiful city in the world? It is not far from it. No urban night is like the night there.... Squares after squares of flame, set up and cut into the aether. Here is our poetry, for we have pulled down the stars to our will.”
—Ezra Pound (1885–1972)
“The political truths declared in that solemn manner acquire by degrees the character of fundamental maxims of free Government, and as they become incorporated with national sentiment, counteract the impulses of interest and passion.”
—James Madison (1751–1836)
“Here we have the beautiful British compromise: a man can say anything, he mustn’t do anything; a man can listen to anything, but he musn’t be roused to do anything. By freedom of speech is meant freedom to talk about; speech is not saying-as-an-action.”
—Paul Goodman (1911–1972)