Measures of Fit
The goal of cross-validation is to estimate the expected level of fit of a model to a data set that is independent of the data that were used to train the model. It can be used to estimate any quantitative measure of fit that is appropriate for the data and model. For example, for binary classification problems, each case in the validation set is either predicted correctly or incorrectly. In this situation the misclassification error rate can be used to summarize the fit, although other measures like positive predictive value could also be used. When the value being predicted is continuously distributed, the mean squared error, root mean squared error or median absolute deviation could be used to summarize the errors.
Read more about this topic: Cross-validation (statistics)
Famous quotes containing the words measures of, measures and/or fit:
“To have the fear of God before our eyes, and, in our mutual dealings with each other, to govern our actions by the eternal measures of right and wrong:MThe first of these will comprehend the duties of religion;Mthe second, those of morality, which are so inseparably connected together, that you cannot divide these two tables ... without breaking and mutually destroying them both.”
—Laurence Sterne (1713–1768)
“It seems that American patriotism measures itself against an outcast group. The right Americans are the right Americans because they’re not like the wrong Americans, who are not really Americans.”
—Eric J. Hobsbawm (b. 1917)
“Nations do not think, they only feel. They get their feelings at second hand through their temperaments, not their brains. A nation can be brought—by force of circumstances, not argument—to reconcile itself to any kind of government or religion that can be devised; in time it will fit itself to the required conditions; later it will prefer them and will fiercely fight for them.”
—Mark Twain [Samuel Langhorne Clemens] (1835–1910)