Local Regression - Degree of Local Polynomials

Degree of Local Polynomials

The local polynomials fit to each subset of the data are almost always of first or second degree; that is, either locally linear (in the straight line sense) or locally quadratic. Using a zero degree polynomial turns LOESS into a weighted moving average. Such a simple local model might work well for some situations, but may not always approximate the underlying function well enough. Higher-degree polynomials would work in theory, but yield models that are not really in the spirit of LOESS. LOESS is based on the ideas that any function can be well approximated in a small neighborhood by a low-order polynomial and that simple models can be fit to data easily. High-degree polynomials would tend to overfit the data in each subset and are numerically unstable, making accurate computations difficult.

Read more about this topic:  Local Regression

Famous quotes containing the words degree of, degree and/or local:

    It has become a people’s war, and peoples of all sorts and races, of every degree of power and variety of fortune, are involved in its sweeping processes of change and settlement.
    Woodrow Wilson (1856–1924)

    The world is burdened with young fogies. Old men with ossified minds are easily dealt with. But men who look young, act young and everlastingly harp on the fact that they are young, but who nevertheless think and act with a degree of caution that would be excessive in their grandfathers, are the curse of the world. Their very conservatism is secondhand, and they don’t know what they are conserving.
    Robertson Davies (b. 1913)

    Wags try to invent new stories to tell about the legislature, and end by telling the old one about the senator who explained his unaccustomed possession of a large roll of bills by saying that someone pushed it over the transom while he slept. The expression “It came over the transom,” to explain any unusual good fortune, is part of local folklore.
    —For the State of Montana, U.S. public relief program (1935-1943)