Armijo Rule and Curvature
Denote a univariate function restricted to the direction as . A step length is said to satisfy the Wolfe conditions if the following two inequalities hold:
- i) ,
- ii) ,
with . (In examining condition (ii), recall that to ensure that is a descent direction, we have .)
is usually chosen to quite small while is much larger; Nocedal gives example values of and for Newton or quasi-Newton methods and for the nonlinear conjugate gradient method. Inequality i) is known as the Armijo rule and ii) as the curvature condition; i) ensures that the step length decreases 'sufficiently', and ii) ensures that the slope has been reduced sufficiently.
Read more about this topic: Wolfe Conditions
Famous quotes containing the word rule:
“The first rule of education for me was discipline. Discipline is the keynote to learning. Discipline has been the great factor in my life. I discipline myself to do everything—getting up in the morning, walking, dancing, exercise. If you won’t have discipline, you won’t have a nation. We can’t have permissiveness. When someone comes in and says, “Oh, your room is so quiet,” I know I’ve been successful.”
—Rose Hoffman, U.S. public school third-grade teacher. As quoted in Working, book 8, by Studs Terkel (1973)