Generative Training
The training methods described above are discriminative training methods, because they seek to find a function that discriminates well between the different output values (see discriminative model). For the special case where is a joint probability distribution and the loss function is the negative log likelihood a risk minimization algorithm is said to perform generative training, because can be regarded as a generative model that explains how the data were generated. Generative training algorithms are often simpler and more computationally efficient than discriminative training algorithms. In some cases, the solution can be computed in closed form as in naive Bayes and linear discriminant analysis.
Read more about this topic: Supervised Learning
Famous quotes containing the words generative and/or training:
“The generative energy, which, when we are loose, dissipates and makes us unclean, when we are continent invigorates and inspires us. Chastity is the flowering of man; and what are called Genius, Heroism, Holiness, and the like, are but various fruits which succeed it.”
—Henry David Thoreau (1817–1862)
“An educational method that shall have liberty as its basis must intervene to help the child to a conquest of liberty. That is to say, his training must be such as shall help him to diminish as much as possible the social bonds which limit his activity.”
—Maria Montessori (1870–1952)