Measures of Fit
The goal of cross-validation is to estimate the expected level of fit of a model to a data set that is independent of the data that were used to train the model. It can be used to estimate any quantitative measure of fit that is appropriate for the data and model. For example, for binary classification problems, each case in the validation set is either predicted correctly or incorrectly. In this situation the misclassification error rate can be used to summarize the fit, although other measures like positive predictive value could also be used. When the value being predicted is continuously distributed, the mean squared error, root mean squared error or median absolute deviation could be used to summarize the errors.
Read more about this topic: Cross-validation (statistics)
Famous quotes containing the words measures of, measures and/or fit:
“Those who, while they disapprove of the character and measures of a government, yield to it their allegiance and support are undoubtedly its most conscientious supporters, and so frequently the most serious obstacles to reform.”
—Henry David Thoreau (1817–1862)
“One point in my public life: I did all I could for the reform of the civil service, for the building up of the South, for a sound currency, etc., etc., but I never forgot my party.... I knew that all good measures would suffer if my Administration was followed by the defeat of my party. Result, a great victory in 1880. Executive and legislature both completely Republican.”
—Rutherford Birchard Hayes (1822–1893)
“The United States must be neutral in fact as well as in name.... We must be impartial in thought as well as in action ... a nation that neither sits in judgment upon others nor is disturbed in her own counsels and which keeps herself fit and free to do what is honest and disinterested and truly serviceable for the peace of the world.”
—Woodrow Wilson (1856–1924)