Relation To Free Energy
The sum-product algorithm is related to the calculation of free energy in thermodynamics. Let Z be the partition function. A probability distribution
(as per the factor graph representation) can be viewed as a measure of the internal energy present in a system, computed as
The free energy of the system is then
It can then be shown that the points of convergence of the sum-product algorithm represent the points where the free energy in such a system is minimized. Similarly, it can be shown that a fixed point of the iterative belief propagation algorithm in graphs with cycles is a stationary point of a free energy approximation.
Read more about this topic: Belief Propagation
Famous quotes containing the words relation to, relation, free and/or energy:
“The adolescent does not develop her identity and individuality by moving outside her family. She is not triggered by some magic unconscious dynamic whereby she rejects her family in favour of her peers or of a larger society.... She continues to develop in relation to her parents. Her mother continues to have more influence over her than either her father or her friends.”
—Terri Apter (20th century)
“Art should exhilarate, and throw down the walls of circumstance on every side, awakening in the beholder the same sense of universal relation and power which the work evinced in the artist, and its highest effect is to make new artists.”
—Ralph Waldo Emerson (1803–1882)
“Actually we are a vulgar, pushing mob whose passions are easily mobilized by demagogues, newspaper men, religious quacks, agitators and such like. To call this a society of free peoples is blasphemous. What have we to offer the world besides the superabundant loot which we recklessly plunder from the earth under the maniacal delusion that this insane activity represents progress and enlightenment?”
—Henry Miller (1891–1980)
“Children are intensely invested in getting their way. They will devote more emotional and intellectual energy to winning arguments than parents ever will, and are almost always better rested.”
—Jean Callahan (20th century)