Nonlinear Regression - General

General

The data consist of error-free independent variables (explanatory variables), x, and their associated observed dependent variables (response variables), y. Each y is modeled as a random variable with a mean given by a nonlinear function f(x,β). Systematic error may be present but its treatment is outside the scope of regression analysis. If the independent variables are not error-free, this is an errors-in-variables model, also outside this scope.

For example, the Michaelis–Menten model for enzyme kinetics

can be written as

where is the parameter, is the parameter and is the independent variable, x. This function is nonlinear because it cannot be expressed as a linear combination of the s.

Other examples of nonlinear functions include exponential functions, logarithmic functions, trigonometric functions, power functions, Gaussian function, and Lorenz curves. Some functions, such as the exponential or logarithmic functions, can be transformed so that they are linear. When so transformed, standard linear regression can be performed but must be applied with caution. See Linearization, below, for more details.

In general, there is no closed-form expression for the best-fitting parameters, as there is in linear regression. Usually numerical optimization algorithms are applied to determine the best-fitting parameters. Again in contrast to linear regression, there may be many local minima of the function to be optimized and even the global minimum may produce a biased estimate. In practice, estimated values of the parameters are used, in conjunction with the optimization algorithm, to attempt to find the global minimum of a sum of squares.

For details concerning nonlinear data modeling see least squares and non-linear least squares.

Read more about this topic:  Nonlinear Regression

Famous quotes containing the word general:

    As a general rule, do not kick the shins of the opposite gentleman under the table, if personally unaquainted with him; your pleasantry is liable to be misunderstood—a circumstance at all times unpleasant.
    Lewis Carroll [Charles Lutwidge Dodgson] (1832–1898)

    I suggested to them also the great desirability of a general knowledge on the Island of the English language. They are under an English speaking government and are a part of the territory of an English speaking nation.... While I appreciated the desirability of maintaining their grasp on the Spanish language, the beauty of that language and the richness of its literature, that as a practical matter for them it was quite necessary to have a good comprehension of English.
    Calvin Coolidge (1872–1933)

    When General Motors has to go to the bathroom ten times a day, the whole country’s ready to let go. You heard of that market crash in ‘29? I predicted that.... I was nursing a director of General Motors. Kidney ailment, they said; nerves, I said. Then I asked myself, “What’s General Motors got to be nervous about?” “Overproduction,” I says. “Collapse.”
    John Michael Hayes (b. 1919)