Method
Newton's Method attempts to construct a sequence from an initial guess that converges towards such that . This is called a stationary point of .
The second order Taylor expansion of function around (where ) is:, attains its extremum when its derivative with respect to is equal to zero, i.e. when solves the linear equation:
(Considering the right-hand side of the above equation as a quadratic in, with constant coefficients.)
Thus, provided that is a twice-differentiable function well approximated by its second order Taylor expansion and the initial guess is chosen close enough to, the sequence defined by:
will converge towards a root of, i.e. for which .
Read more about this topic: Newton's Method In Optimization
Famous quotes containing the word method:
“Too poor for a bribe, and too proud to importune,
He had not the method of making a fortune.”
—Thomas Gray (1716–1771)
“There is no method but to be very intelligent.”
—T.S. (Thomas Stearns)
“The method of scientific investigation is nothing but the expression of the necessary mode of working of the human mind. It is simply the mode in which all phenomena are reasoned about, rendered precise and exact.”
—Thomas Henry Huxley (1825–95)