Probability of A Unit's State
The difference in the global energy that results from a single unit being 0 (off) versus 1 (on), written, is given by:
This can be expressed as the difference of energies of two states:
We then substitute the energy of each state with its relative probability according to the Boltzmann Factor (the property of a Boltzmann distribution that the energy of a state is proportional to the negative log probability of that state):
where is Boltzmann's constant and is absorbed into the artificial notion of temperature . We then rearrange terms and consider that the probabilities of the unit being on and off must sum to one:
We can now finally solve for, the probability that the -th unit is on.
where the scalar is referred to as the temperature of the system. This relation is the source of the logistic function found in probability expressions in variants of the Boltzmann machine.
Read more about this topic: Boltzmann Machine
Famous quotes containing the words probability of, probability, unit and/or state:
“The probability of learning something unusual from a newspaper is far greater than that of experiencing it; in other words, it is in the realm of the abstract that the more important things happen in these times, and it is the unimportant that happens in real life.”
—Robert Musil (1880–1942)
“Crushed to earth and rising again is an author’s gymnastic. Once he fails to struggle to his feet and grab his pen, he will contemplate a fact he should never permit himself to face: that in all probability books have been written, are being written, will be written, better than anything he has done, is doing, or will do.”
—Fannie Hurst (1889–1968)
“During the Suffragette revolt of 1913 I ... [urged] that what was needed was not the vote, but a constitutional amendment enacting that all representative bodies shall consist of women and men in equal numbers, whether elected or nominated or coopted or registered or picked up in the street like a coroner’s jury. In the case of elected bodies the only way of effecting this is by the Coupled Vote. The representative unit must not be a man or a woman but a man and a woman.”
—George Bernard Shaw (1856–1950)
“On our streets it is the sight of a totally unknown face or figure which arrests the attention, rather than, as in big cities, the strangeness of occasionally seeing someone you know.”
—For the State of Vermont, U.S. public relief program (1935-1943)