Local Regression - Degree of Local Polynomials

Degree of Local Polynomials

The local polynomials fit to each subset of the data are almost always of first or second degree; that is, either locally linear (in the straight line sense) or locally quadratic. Using a zero degree polynomial turns LOESS into a weighted moving average. Such a simple local model might work well for some situations, but may not always approximate the underlying function well enough. Higher-degree polynomials would work in theory, but yield models that are not really in the spirit of LOESS. LOESS is based on the ideas that any function can be well approximated in a small neighborhood by a low-order polynomial and that simple models can be fit to data easily. High-degree polynomials would tend to overfit the data in each subset and are numerically unstable, making accurate computations difficult.

Read more about this topic:  Local Regression

Famous quotes containing the words degree of, degree and/or local:

    Words are made for a certain exactness of thought, as tears are for a certain degree of pain. What is least distinct cannot be named; what is clearest is unutterable.
    René Daumal (1908–1944)

    A new degree of intellectual power seems cheap at any price.
    Ralph Waldo Emerson (1803–1882)

    The poet’s eye, in a fine frenzy rolling,
    Doth glance from heaven to earth, from earth to heaven;
    And as imagination bodies forth
    The forms of things unknown, the poet’s pen
    Turns them to shapes, and gives to airy nothing
    A local habitation and a name.
    William Shakespeare (1564–1616)