Strong Wolfe Condition On Curvature
The Wolfe conditions, however, can result in a value for the step length that is not close to a minimizer of . If we modify the curvature condition to the following,
- iia)
then i) and iia) together form the so-called strong Wolfe conditions, and force to lie close to a critical point of .
The principal reason for imposing the Wolfe conditions in an optimization algorithm where is to ensure convergence of the gradient to zero. In particular, if the cosine of the angle between and the gradient,
is bounded away from zero and the i) and ii) hold, then .
An additional motivation, in the case of a quasi-Newton method is that if, where the matrix is updated by the BFGS or DFP formula, then if is positive definite ii) implies is also positive definite.
Read more about this topic: Wolfe Conditions
Famous quotes containing the words strong, wolfe and/or condition:
“As kings are begotten and born like other men, it is to be presumed that they are of the human species; and perhaps, had they the same education, they might prove like other men. But, flattered from their cradles, their hearts are corrupted, and their heads are turned, so that they seem to be a species by themselves.... Flattery cannot be too strong for them; drunk with it from their infancy, like old drinkers, they require dreams.”
—Philip Dormer Stanhope, 4th Earl Chesterfield (1694–1773)
“Not a drum was heard, not a funeral note,
As his corse to the rampart we hurried;”
—Charles Wolfe (1791–1823)
“The quest for certainty blocks the search for meaning. Uncertainty is the very condition to impel man to unfold his powers.”
—Erich Fromm (1900–1980)