Generalization Error Bounds
One theoretical motivation behind margin classifiers is that their generalization error may be bound by parameters of the algorithm and a margin term. An example of such a bound is for the AdaBoost algorithm. Let be a set of examples sampled independently at random from a distribution . Assume the VC-dimension of the underlying base classifier is and . Then with probability we have the bound
for all .
Read more about this topic: Margin Classifier
Famous quotes containing the words error and/or bounds:
“It is as certain as it is strange that truth and error come from one and the same source; for that reason one must often not do something to the detriment of error since one would do also something detrimental to truth.”
—Johann Wolfgang Von Goethe (1749–1832)
“At bounds of boundless void.”
—Samuel Beckett (1906–1989)