The Conjugate Gradient Method As A Direct Method
We say that two non-zero vectors u and v are conjugate (with respect to A) if
Since A is symmetric and positive definite, the left-hand side defines an inner product
Two vectors are conjugate if they are orthogonal with respect to this inner product. Being conjugate is a symmetric relation: if u is conjugate to v, then v is conjugate to u. (Note: This notion of conjugate is not related to the notion of complex conjugate.)
Suppose that {pk} is a sequence of n mutually conjugate directions. Then the pk form a basis of Rn, so we can expand the solution of Ax = b in this basis:
and we see that
The coefficients are given by
(because are mutually conjugate)
This result is perhaps most transparent by considering the inner product defined above.
This gives the following method for solving the equation Ax = b: find a sequence of n conjugate directions, and then compute the coefficients .
Read more about this topic: Conjugate Gradient Method
Famous quotes containing the words method and/or direct:
“in the absence of feet, “a method of conclusions”;
“a knowledge of principles,”
in the curious phenomenon of your occipital horn.”
—Marianne Moore (1887–1972)
“I make this direct statement to the American people that there is far less chance of the United States getting into war, if we do all we can now to support the nations defending themselves against attack by the Axis than if we acquiesce in their defeat, submit tamely to an Axis victory, and wait our turn to be the object of attack in another war later on.”
—Franklin D. Roosevelt (1882–1945)