Subgradient Method - Classical Subgradient Rules

Classical Subgradient Rules

Let be a convex function with domain . A classical subgradient method iterates

where denotes a subgradient of at . If is differentiable, then its only subgradient is the gradient vector itself. It may happen that is not a descent direction for at . We therefore maintain a list that keeps track of the lowest objective function value found so far, i.e.

Read more about this topic:  Subgradient Method

Famous quotes containing the words classical and/or rules:

    Compare the history of the novel to that of rock ‘n’ roll. Both started out a minority taste, became a mass taste, and then splintered into several subgenres. Both have been the typical cultural expressions of classes and epochs. Both started out aggressively fighting for their share of attention, novels attacking the drama, the tract, and the poem, rock attacking jazz and pop and rolling over classical music.
    W. T. Lhamon, U.S. educator, critic. “Material Differences,” Deliberate Speed: The Origins of a Cultural Style in the American 1950s, Smithsonian (1990)

    ... geometry became a symbol for human relations, except that it was better, because in geometry things never go bad. If certain things occur, if certain lines meet, an angle is born. You cannot fail. It’s not going to fail; it is eternal. I found in rules of mathematics a peace and a trust that I could not place in human beings. This sublimation was total and remained total. Thus, I’m able to avoid or manipulate or process pain.
    Louise Bourgeois (b. 1911)