Measures of Fit
The goal of cross-validation is to estimate the expected level of fit of a model to a data set that is independent of the data that were used to train the model. It can be used to estimate any quantitative measure of fit that is appropriate for the data and model. For example, for binary classification problems, each case in the validation set is either predicted correctly or incorrectly. In this situation the misclassification error rate can be used to summarize the fit, although other measures like positive predictive value could also be used. When the value being predicted is continuously distributed, the mean squared error, root mean squared error or median absolute deviation could be used to summarize the errors.
Read more about this topic: Cross-validation (statistics)
Famous quotes containing the words measures of, measures and/or fit:
“Those who, while they disapprove of the character and measures of a government, yield to it their allegiance and support are undoubtedly its most conscientious supporters, and so frequently the most serious obstacles to reform.”
—Henry David Thoreau (1817–1862)
“Him the Almighty Power
Hurld headlong flaming from th’ Ethereal Skie
With hideous ruine and combustion down
To bottomless perdition, there to dwell
In Adamantine Chains and penal Fire,
Who durst defie th’ Omnipotent to Arms.
Nine times the Space that measures Day and Night
To mortal men, he with his horrid crew
Lay vanquisht, rowling in the fiery Gulfe”
—John Milton (1608–1674)
“It is bad enough that our geniuses cannot do anything useful, but it is worse that no man is fit for society who has fine traits. He is admired at a distance, but he cannot come near without appearing a cripple.”
—Ralph Waldo Emerson (1803–1882)