Subgradient Method - Classical Subgradient Rules

Classical Subgradient Rules

Let be a convex function with domain . A classical subgradient method iterates

where denotes a subgradient of at . If is differentiable, then its only subgradient is the gradient vector itself. It may happen that is not a descent direction for at . We therefore maintain a list that keeps track of the lowest objective function value found so far, i.e.

Read more about this topic:  Subgradient Method

Famous quotes containing the words classical and/or rules:

    “Classical art, in a word, stands for form; romantic art for content. The romantic artist expects people to ask, What has he got to say? The classical artist expects them to ask, How does he say it?”
    —R.G. (Robin George)

    “The reason why men enter into society, is the preservation of their property; and the end why they choose and authorize a legislative, is, that there may be laws made, and rules set, as guards and fences to the properties of all the members of the society: to limit the power, and moderate the dominion, of every part and member of the society.”
    —John Locke (1632–1704)