Issues
- It's not clear on how many cases to assign to the training and validation sets
- The result might highly depend on the algorithm which is used to split the data into training and validation set
- Notion of "increasing validation error" is ambiguous; it may go up and down numerous times during training. The safest approach is to train to convergence, then determine which iteration had the lowest validation error. This impairs fast training, one of the advantages of early stopping.
Read more about this topic: Early Stopping
Famous quotes containing the word issues:
“How to attain sufficient clarity of thought to meet the terrifying issues now facing us, before it is too late, is ... important. Of one thing I feel reasonably sure: we can’t stop to discuss whether the table has or hasn’t legs when the house is burning down over our heads. Nor do the classics per se seem to furnish the kind of education which fits people to cope with a fast-changing civilization.”
—Mary Barnett Gilson (1877–?)
“I can never bring you to realize the importance of sleeves, the suggestiveness of thumb-nails, or the great issues that may hang from a boot-lace.”
—Sir Arthur Conan Doyle (1859–1930)
“Cynicism formulates issues clearly, but only to dismiss them.”
—Mason Cooley (b. 1927)