Relation To Free Energy
The sum-product algorithm is related to the calculation of free energy in thermodynamics. Let Z be the partition function. A probability distribution
(as per the factor graph representation) can be viewed as a measure of the internal energy present in a system, computed as
The free energy of the system is then
It can then be shown that the points of convergence of the sum-product algorithm represent the points where the free energy in such a system is minimized. Similarly, it can be shown that a fixed point of the iterative belief propagation algorithm in graphs with cycles is a stationary point of a free energy approximation.
Read more about this topic: Belief Propagation
Famous quotes containing the words relation to, relation, free and/or energy:
“It would be disingenuous, however, not to point out that some things are considered as morally certain, that is, as having sufficient certainty for application to ordinary life, even though they may be uncertain in relation to the absolute power of God.”
—René Descartes (1596–1650)
“The psychoanalysis of individual human beings, however, teaches us with quite special insistence that the god of each of them is formed in the likeness of his father, that his personal relation to God depends on his relation to his father in the flesh and oscillates and changes along with that relation, and that at bottom God is nothing other than an exalted father.”
—Sigmund Freud (1856–1939)
“... the most important effect of the suffrage is psychological. The permanent consciousness of power for effective action, the knowledge that their own thoughts have an equal chance with those of any other person ... this is what has always rendered the men of a free state so energetic, so acutely intelligent, so powerful.”
—Mary Putnam Jacobi (1842–1906)
“The tendencies of the times favor the idea of self-government, and leave the individual, for all code, to the rewards and penalties of his own constitution, which work with more energy than we believe, whilst we depend on artificial restraints.”
—Ralph Waldo Emerson (1803–1882)