How To Apply AIC in Practice
To apply AIC in practice, we start with a set of candidate models, and then find the models' corresponding AIC values. There will almost always be information lost due to using one of the candidate models to represent the "true" model. We wish to select, from among R candidate models, the model that minimizes the information loss. We cannot choose with certainty, but we can minimize the estimated information loss.
Denote the AIC values of the candidate models by AIC1, AIC2, AIC3, …, AICR. Let AICmin be the minimum of those values. Then exp((AICmin−AICi)/2) can be interpreted as the relative probability that the ith model minimizes the (estimated) information loss.
As an example, suppose that there were three models in the candidate set, with AIC values 100, 102, and 110. Then the second model is exp((100−102)/2) = 0.368 times as probable as the first model to minimize the information loss, and the third model is exp((100−110)/2) = 0.007 times as probable as the first model to minimize the information loss. In this case, we would omit the third model from further consideration. We could take a weighted average of the first two models, with weights 1 and 0.368, respectively, and then do statistical inference based on the weighted multimodel; alternatively, we could gather more data to distinguish between the first two models.
If all the models in the candidate set have the same number of parameters, then using AIC might at first appear to be very similar to using the likelihood-ratio test. There are, however, important distinctions. In particular, the likelihood-ratio test is valid only for nested models whereas AIC (and AICc) has no such restriction.
The quantity exp((AICmin−AICi)/2) is the relative likelihood of model i.
Read more about this topic: Akaike Information Criterion
Famous quotes containing the words apply and/or practice:
“Experiment is necessary in establishing an academy, but certain principles must apply to this business of art as to any other business which affects the artis tic sense of the community. Great art speaks a language which every intelligent person can understand. The people who call themselves modernists today speak a different language.”
—Robert Menzies (18941978)
“Abused as we abuse it at present, dramatic art is in no sense cathartic; it is merely a form of emotional masturbation.... It is the rarest thing to find a player who has not had his character affected for the worse by the practice of his profession. Nobody can make a habit of self-exhibition, nobody can exploit his personality for the sake of exercising a kind of hypnotic power over others, and remain untouched by the process.”
—Aldous Huxley (18941963)