The Akaike information criterion is a measure of the relative goodness of fit of a statistical model. The AIC is grounded in the concept of information entropy, in effect offering a relative measure of the information lost when a given model is used to describe reality. It can be said to describe the tradeoff between bias and variance in model construction, or loosely speaking between accuracy and complexity of the model.
AIC values provide a means for model selection. AIC does not provide a test of a model in the sense of testing a null hypothesis; i.e. AIC can tell nothing about how well a model fits the data in an absolute sense. If all the candidate models fit poorly, AIC will not give any warning of that.
Read more about Akaike Information Criterion: Definition, How To Apply AIC in Practice, AICc, Relevance To Chi-squared Fitting, History, Bayesian Information Criterion
Famous quotes containing the words information and/or criterion:
“Theories of child development and guidelines for parents are not cast in stone. They are constantly changing and adapting to new information and new pressures. There is no “right” way, just as there are no magic incantations that will always painlessly resolve a child’s problems.”
—Lawrence Kutner (20th century)
“I divide all literary works into two categories: Those I like and those I don’t like. No other criterion exists for me.”
—Anton Pavlovich Chekhov (1860–1904)