Newton's Method in Optimization - Geometric Interpretation

Geometric Interpretation

The geometric interpretation of Newton's method is that at each iteration one approximates by a quadratic function around, and then takes a step towards the maximum/minimum of that quadratic function (in higher dimensions, this may also be a saddle point). Note that if happens to be a quadratic function, then the exact extremum is found in one step.

Read more about this topic:  Newton's Method In Optimization

Famous quotes containing the word geometric:

    New York ... is a city of geometric heights, a petrified desert of grids and lattices, an inferno of greenish abstraction under a flat sky, a real Metropolis from which man is absent by his very accumulation.
    Roland Barthes (1915–1980)