Geometric Interpretation
The geometric interpretation of Newton's method is that at each iteration one approximates by a quadratic function around, and then takes a step towards the maximum/minimum of that quadratic function (in higher dimensions, this may also be a saddle point). Note that if happens to be a quadratic function, then the exact extremum is found in one step.
Read more about this topic: Newton's Method In Optimization
Famous quotes containing the word geometric:
“In mathematics he was greater
Than Tycho Brahe, or Erra Pater:
For he, by geometric scale,
Could take the size of pots of ale;
Resolve, by sines and tangents straight,
If bread and butter wanted weight;
And wisely tell what hour o’ th’ day
The clock doth strike, by algebra.”
—Samuel Butler (1612–1680)