Subgradient Method - Classical Subgradient Rules

Classical Subgradient Rules

Let be a convex function with domain . A classical subgradient method iterates

where denotes a subgradient of at . If is differentiable, then its only subgradient is the gradient vector itself. It may happen that is not a descent direction for at . We therefore maintain a list that keeps track of the lowest objective function value found so far, i.e.

Read more about this topic:  Subgradient Method

Famous quotes containing the words classical and/or rules:

    Classical art, in a word, stands for form; romantic art for content. The romantic artist expects people to ask, What has he got to say? The classical artist expects them to ask, How does he say it?
    —R.G. (Robin George)

    The duce of any other rule have I to govern myself by in this affair—and if I had one ... I would twist it and tear it to pieces, and throw it into the fire when I had done—Am I warm? I am, and the cause demands it—a pretty story! is a man to follow rules—or rules to follow him?
    Laurence Sterne (1713–1768)