The Conjugate Gradient Method As A Direct Method
We say that two non-zero vectors u and v are conjugate (with respect to A) if
Since A is symmetric and positive definite, the left-hand side defines an inner product
Two vectors are conjugate if they are orthogonal with respect to this inner product. Being conjugate is a symmetric relation: if u is conjugate to v, then v is conjugate to u. (Note: This notion of conjugate is not related to the notion of complex conjugate.)
Suppose that {pk} is a sequence of n mutually conjugate directions. Then the pk form a basis of Rn, so we can expand the solution of Ax = b in this basis:
and we see that
The coefficients are given by
(because are mutually conjugate)
This result is perhaps most transparent by considering the inner product defined above.
This gives the following method for solving the equation Ax = b: find a sequence of n conjugate directions, and then compute the coefficients .
Read more about this topic: Conjugate Gradient Method
Famous quotes containing the words method and/or direct:
“The good husband finds method as efficient in the packing of fire-wood in a shed, or in the harvesting of fruits in the cellar, as in Peninsular campaigns or the files of the Department of State.”
—Ralph Waldo Emerson (1803–1882)
“Bryan is the least of a liar I know in public life. I have always found him direct and honest, and he never goes back on what he has said to me in private—a rare thing, if found, in public men. I found him purely frank.”
—William Howard Taft (1857–1930)