Method
Newton's Method attempts to construct a sequence from an initial guess that converges towards such that . This is called a stationary point of .
The second order Taylor expansion of function around (where ) is:, attains its extremum when its derivative with respect to is equal to zero, i.e. when solves the linear equation:
(Considering the right-hand side of the above equation as a quadratic in, with constant coefficients.)
Thus, provided that is a twice-differentiable function well approximated by its second order Taylor expansion and the initial guess is chosen close enough to, the sequence defined by:
will converge towards a root of, i.e. for which .
Read more about this topic: Newton's Method In Optimization
Famous quotes containing the word method:
“The method of scientific investigation is nothing but the expression of the necessary mode of working of the human mind. It is simply the mode in which all phenomena are reasoned about, rendered precise and exact.”
—Thomas Henry Huxley (1825–95)
“The method of painting is the natural growth out of a need. I want to express my feelings rather than illustrate them. Technique is just a means of arriving at a statement.... I can control the flow of paint: there is no accident, just as there is no beginning and no end.”
—Jackson Pollock (1912–1956)
“Letters are above all useful as a means of expressing the ideal self; and no other method of communication is quite so good for this purpose.... In letters we can reform without practice, beg without humiliation, snip and shape embarrassing experiences to the measure of our own desires....”
—Elizabeth Hardwick (b. 1916)