Armijo Rule and Curvature
Denote a univariate function restricted to the direction as . A step length is said to satisfy the Wolfe conditions if the following two inequalities hold:
- i) ,
- ii) ,
with . (In examining condition (ii), recall that to ensure that is a descent direction, we have .)
is usually chosen to quite small while is much larger; Nocedal gives example values of and for Newton or quasi-Newton methods and for the nonlinear conjugate gradient method. Inequality i) is known as the Armijo rule and ii) as the curvature condition; i) ensures that the step length decreases 'sufficiently', and ii) ensures that the slope has been reduced sufficiently.
Read more about this topic: Wolfe Conditions
Famous quotes containing the word rule:
“Charity is a cop-out so traditionally female in its apparent self-effacement that there seems resonant comfort in it. We’re no longer supposed to serve the imaginations of men who have dominated us. We are to give up ourselves instead to those whose suffering is greater than our own. Looking down is just as distorting as looking up and as dangerous in perpetuating hierarchies.”
—Jane Rule (b. 1931)