Measures of Fit
The goal of cross-validation is to estimate the expected level of fit of a model to a data set that is independent of the data that were used to train the model. It can be used to estimate any quantitative measure of fit that is appropriate for the data and model. For example, for binary classification problems, each case in the validation set is either predicted correctly or incorrectly. In this situation the misclassification error rate can be used to summarize the fit, although other measures like positive predictive value could also be used. When the value being predicted is continuously distributed, the mean squared error, root mean squared error or median absolute deviation could be used to summarize the errors.
Read more about this topic: Cross-validation (statistics)
Famous quotes containing the words measures and/or fit:
“Away with the cant of “Measures, not men!”Mthe idle supposition that it is the harness and not the horses that draw the chariot along. No, Sir, if the comparison must be made, if the distinction must be taken, men are everything, measures comparatively nothing.”
—George Canning (1770–1827)
“Feeling needy—mistaking vulnerability for weakness—doesn’t fit in with our image of what being a mother is all about. If we are needy, how can we care well for a much needier baby? There is a widespread feeling that we have to do it all alone, and if we don’t know something, or can’t manage it, or, heaven forbid, don’t want to, there is something lacking in our makeup.”
—Sally Placksin (20th century)