Strong Wolfe Condition On Curvature
The Wolfe conditions, however, can result in a value for the step length that is not close to a minimizer of . If we modify the curvature condition to the following,
- iia)
then i) and iia) together form the so-called strong Wolfe conditions, and force to lie close to a critical point of .
The principal reason for imposing the Wolfe conditions in an optimization algorithm where is to ensure convergence of the gradient to zero. In particular, if the cosine of the angle between and the gradient,
is bounded away from zero and the i) and ii) hold, then .
An additional motivation, in the case of a quasi-Newton method is that if, where the matrix is updated by the BFGS or DFP formula, then if is positive definite ii) implies is also positive definite.
Read more about this topic: Wolfe Conditions
Famous quotes containing the words strong, wolfe and/or condition:
“You’ve always reminded me of a seagull, Jo. Strong and wild and fond of the wind and storms. And dreaming of flying far off to sea. And Mother always said that I was like a little cricket. Chirping contentedly on the hearth, never able to bear the thought of leaving home.”
—Victor Heerman (1893–1977)
“A liberal is a conservative who has been arrested.”
—Tom Wolfe (b. 1931)
“We have imagined ourselves a special creation, set apart from other humans. In the last twentieth century, we see that our poverty is as absolute as that of the poorest nations. We have attempted to deny the human condition in our quest for power after power. It would be well for us to rejoin the human race, to accept our essential poverty as a gift, and to share our material wealth with those in need.”
—Robert Neelly Bellah (20th century)