Relation To Free Energy
The sum-product algorithm is related to the calculation of free energy in thermodynamics. Let Z be the partition function. A probability distribution
(as per the factor graph representation) can be viewed as a measure of the internal energy present in a system, computed as
The free energy of the system is then
It can then be shown that the points of convergence of the sum-product algorithm represent the points where the free energy in such a system is minimized. Similarly, it can be shown that a fixed point of the iterative belief propagation algorithm in graphs with cycles is a stationary point of a free energy approximation.
Read more about this topic: Belief Propagation
Famous quotes containing the words relation to, relation, free and/or energy:
“A theory of the middle class: that it is not to be determined by its financial situation but rather by its relation to government. That is, one could shade down from an actual ruling or governing class to a class hopelessly out of relation to government, thinking of gov’t as beyond its control, of itself as wholly controlled by gov’t. Somewhere in between and in gradations is the group that has the sense that gov’t exists for it, and shapes its consciousness accordingly.”
—Lionel Trilling (1905–1975)
“Every word was once a poem. Every new relation is a new word.”
—Ralph Waldo Emerson (1803–1882)
“Democracy shows not only its power in reforming governments, but in regenerating a race of men—and this is the greatest blessing of free governments.”
—Andrew Jackson (1767–1845)
“But often the presence of mind and energy of a person remote from the spotlight decide the course of history for centuries to come.”
—Stefan Zweig (18811942)