Relation To Free Energy
The sum-product algorithm is related to the calculation of free energy in thermodynamics. Let Z be the partition function. A probability distribution
(as per the factor graph representation) can be viewed as a measure of the internal energy present in a system, computed as
The free energy of the system is then
It can then be shown that the points of convergence of the sum-product algorithm represent the points where the free energy in such a system is minimized. Similarly, it can be shown that a fixed point of the iterative belief propagation algorithm in graphs with cycles is a stationary point of a free energy approximation.
Read more about this topic: Belief Propagation
Famous quotes containing the words relation to, relation, free and/or energy:
“The difference between objective and subjective extension is one of relation to a context solely.”
—William James (1842–1910)
“Concord is just as idiotic as ever in relation to the spirits and their knockings. Most people here believe in a spiritual world ... in spirits which the very bullfrogs in our meadows would blackball. Their evil genius is seeing how low it can degrade them. The hooting of owls, the croaking of frogs, is celestial wisdom in comparison.”
—Henry David Thoreau (1817–1862)
“It may be affirmed, without extravagance, that the free institutions we enjoy, have developed the powers, and improved the condition, of our whole people, beyond any example in the world.”
—Abraham Lincoln (1809–1865)
“Children are intensely invested in getting their way. They will devote more emotional and intellectual energy to winning arguments than parents ever will, and are almost always better rested.”
—Jean Callahan (20th century)