Partition of Sums of Squares - Partitioning The Sum of Squares in Linear Regression

Partitioning The Sum of Squares in Linear Regression

Theorem. Given a linear regression model including a constant based on a sample containing n observations, the total sum of squares (TSS) can be partitioned as follows into the explained sum of squares (ESS) and the residual sum of squares (RSS):

where this equation is equivalent to each of the following forms:


\begin{align} \left\| y - \bar{y} \mathbf{1} \right\|^2 &= \left\| \hat{y} - \bar{y} \mathbf{1} \right\|^2 + \left\| \hat{\varepsilon} \right\|^2, \quad \mathbf{1} = (1, 1, \ldots, 1)^T ,\\ \sum_{i = 1}^n (y_i - \bar{y})^2 &= \sum_{i = 1}^n (\hat{y}_i - \bar{y})^2 + \sum_{i = 1}^n (y_i - \hat{y}_i)^2 ,\\ \sum_{i = 1}^n (y_i - \bar{y})^2 &= \sum_{i = 1}^n (\hat{y}_i - \bar{y})^2 + \sum_{i = 1}^n \hat{\varepsilon}_i^2 .\\ \end{align}

Read more about this topic:  Partition Of Sums Of Squares

Famous quotes containing the words sum and/or squares:

    “The ornament is a statuette, a black figure of a bird. I am prepared to pay on behalf of the figure’s rightful owner the sum of $5000 for its recovery. I am prepared to promise, to promise ... what is the phrase?—’No questions will be asked.’”
    —John Huston (1906–1987)

    “An afternoon of nurses and rumours;
    The provinces of his body revolted,
    The squares of his mind were empty,
    Silence invaded the suburbs,”
    —W.H. (Wystan Hugh)