Relation To Free Energy
The sum-product algorithm is related to the calculation of free energy in thermodynamics. Let Z be the partition function. A probability distribution
(as per the factor graph representation) can be viewed as a measure of the internal energy present in a system, computed as
The free energy of the system is then
It can then be shown that the points of convergence of the sum-product algorithm represent the points where the free energy in such a system is minimized. Similarly, it can be shown that a fixed point of the iterative belief propagation algorithm in graphs with cycles is a stationary point of a free energy approximation.
Read more about this topic: Belief Propagation
Famous quotes containing the words relation to, relation, free and/or energy:
“Only in a house where one has learnt to be lonely does one have this solicitude for things. One’s relation to them, the daily seeing or touching, begins to become love, and to lay one open to pain.”
—Elizabeth Bowen (1899–1973)
“Much poetry seems to be aware of its situation in time and of its relation to the metronome, the clock, and the calendar. ... The season or month is there to be felt; the day is there to be seized. Poems beginning “When” are much more numerous than those beginning “Where” of “If.” As the meter is running, the recurrent message tapped out by the passing of measured time is mortality.”
—William Harmon (b. 1938)
“What blessings thy free bounty gives
Let me not cast away;
For God is paid when man receives,
To enjoy is to obey.”
—Alexander Pope (1688–1744)
“Crime is naught but misdirected energy. So long as every institution of today, economic, political, social, and moral, conspires to misdirect human energy into wrong channels; so long as most people are out of place doing the things they hate to do, living a life they loathe to live, crime will be inevitable.”
—Emma Goldman (1869–1940)