Statistical Learning Theory - Loss Functions

Loss Functions

The choice of loss function is a determining factor on the function that will be chosen by the learning algorithm. The loss function also affects the convergence rate for an algorithm. It is important for the loss function to be convex.

Different loss functions are used depending on whether the problem is one of regression or one of classification.

Read more about this topic:  Statistical Learning Theory

Famous quotes containing the words loss and/or functions:

    Perhaps it is a universal truth that the loss of liberty at home is to be charged to provisions against danger, real or pretended, from abroad.
    James Madison (1751–1836)

    When Western people train the mind, the focus is generally on the left hemisphere of the cortex, which is the portion of the brain that is concerned with words and numbers. We enhance the logical, bounded, linear functions of the mind. In the East, exercises of this sort are for the purpose of getting in tune with the unconscious—to get rid of boundaries, not to create them.
    Edward T. Hall (b. 1914)