Armijo Rule and Curvature
Denote a univariate function restricted to the direction as . A step length is said to satisfy the Wolfe conditions if the following two inequalities hold:
- i) ,
- ii) ,
with . (In examining condition (ii), recall that to ensure that is a descent direction, we have .)
is usually chosen to quite small while is much larger; Nocedal gives example values of and for Newton or quasi-Newton methods and for the nonlinear conjugate gradient method. Inequality i) is known as the Armijo rule and ii) as the curvature condition; i) ensures that the step length decreases 'sufficiently', and ii) ensures that the slope has been reduced sufficiently.
Read more about this topic: Wolfe Conditions
Famous quotes containing the word rule:
“The principle of majority rule is the mildest form in which the force of numbers can be exercised. It is a pacific substitute for civil war in which the opposing armies are counted and the victory is awarded to the larger before any blood is shed. Except in the sacred tests of democracy and in the incantations of the orators, we hardly take the trouble to pretend that the rule of the majority is not at bottom a rule of force.”
—Walter Lippmann (1889–1974)