Method
Newton's Method attempts to construct a sequence from an initial guess that converges towards such that . This is called a stationary point of .
The second order Taylor expansion of function around (where ) is:, attains its extremum when its derivative with respect to is equal to zero, i.e. when solves the linear equation:
(Considering the right-hand side of the above equation as a quadratic in, with constant coefficients.)
Thus, provided that is a twice-differentiable function well approximated by its second order Taylor expansion and the initial guess is chosen close enough to, the sequence defined by:
will converge towards a root of, i.e. for which .
Read more about this topic: Newton's Method In Optimization
Famous quotes containing the word method:
“There is assuredly no more effectual method of clearing up one’s own mind on any subject than by talking it over, so to speak, with men of real power and grasp, who have considered it from a totally different point of view.”
—Thomas Henry Huxley (1825–95)
“Argument is conclusive ... but ... it does not remove doubt, so that the mind may rest in the sure knowledge of the truth, unless it finds it by the method of experiment.... For if any man who never saw fire proved by satisfactory arguments that fire burns ... his hearer’s mind would never be satisfied, nor would he avoid the fire until he put his hand in it ... that he might learn by experiment what argument taught.”
—Roger Bacon (c. 1214–1294)
“The method of scientific investigation is nothing but the expression of the necessary mode of working of the human mind. It is simply the mode in which all phenomena are reasoned about, rendered precise and exact.”
—Thomas Henry Huxley (1825–95)