Akaike Information Criterion

The Akaike information criterion is a measure of the relative goodness of fit of a statistical model. The AIC is grounded in the concept of information entropy, in effect offering a relative measure of the information lost when a given model is used to describe reality. It can be said to describe the tradeoff between bias and variance in model construction, or loosely speaking between accuracy and complexity of the model.

AIC values provide a means for model selection. AIC does not provide a test of a model in the sense of testing a null hypothesis; i.e. AIC can tell nothing about how well a model fits the data in an absolute sense. If all the candidate models fit poorly, AIC will not give any warning of that.

Read more about Akaike Information Criterion:  Definition, How To Apply AIC in Practice, AICc, Relevance To Chi-squared Fitting, History, Bayesian Information Criterion

Famous quotes containing the words information and/or criterion:

    As information technology restructures the work situation, it abstracts thought from action.
    Shoshana Zuboff (b. 1951)

    ... the condition of women affords, in all countries, the best criterion by which to judge the character of men.
    Frances Wright (1795–1852)