The Conjugate Gradient Method As A Direct Method
We say that two non-zero vectors u and v are conjugate (with respect to A) if
Since A is symmetric and positive definite, the left-hand side defines an inner product
Two vectors are conjugate if they are orthogonal with respect to this inner product. Being conjugate is a symmetric relation: if u is conjugate to v, then v is conjugate to u. (Note: This notion of conjugate is not related to the notion of complex conjugate.)
Suppose that {pk} is a sequence of n mutually conjugate directions. Then the pk form a basis of Rn, so we can expand the solution of Ax = b in this basis:
and we see that
The coefficients are given by
(because are mutually conjugate)
This result is perhaps most transparent by considering the inner product defined above.
This gives the following method for solving the equation Ax = b: find a sequence of n conjugate directions, and then compute the coefficients .
Read more about this topic: Conjugate Gradient Method
Famous quotes containing the words method and/or direct:
“... [a] girl one day flared out and told the principal “the only mission opening before a girl in his school was to marry one of those candidates [for the ministry].” He said he didn’t know but it was. And when at last that same girl announced her desire and intention to go to college it was received with about the same incredulity and dismay as if a brass button on one of those candidate’s coats had propounded a new method for squaring the circle or trisecting the arc.”
—Anna Julia Cooper (1859–1964)
“...I have never known a “movement” in the theater that did not work direct and serious harm. Indeed, I have sometimes felt that the very people associated with various “uplifting” activities in the theater are people who are astoundingly lacking in idealism.”
—Minnie Maddern Fiske (1865–1932)