Problems
The Boltzmann machine would theoretically be a rather general computational medium. For instance, if trained on photographs, the machine would theoretically model the distribution of photographs, and could use that model to, for example, complete a partial photograph.
Unfortunately, there is a serious practical problem with the Boltzmann machine, namely that the learning seems to stop working correctly when the machine is scaled up to anything larger than a trivial machine. This is due to a number of effects, the most important of which are:
- the time the machine must be run in order to collect equilibrium statistics grows exponentially with the machine's size, and with the magnitude of the connection strengths
- connection strengths are more plastic when the units being connected have activation probabilities intermediate between zero and one, leading to a so-called variance trap. The net effect is that noise causes the connection strengths to random walk until the activities saturate.
Read more about this topic: Boltzmann Machine
Famous quotes containing the word problems:
“She has problems with separation; he has trouble with unity—problems that make themselves felt in our relationships with our children just as they do in our relations with each other. She pulls for connection; he pushes for separateness. She tends to feel shut out; he tends to feel overwhelmed and intruded upon. It’s one of the reasons why she turns so eagerly to children—especially when they’re very young.”
—Lillian Breslow Rubin (20th century)
“As our disorderly, competitive technological society is piling up its victims and constantly developing new problems of maladjustment, we must use our scientific knowledge to determine the cause and prevention of suffering rather than putting all our emphasis on its alleviation ...”
—Agnes E. Meyer (1887–1970)
“The problems of victory are more agreeable than the problems of defeat, but they are no less difficult.”
—Winston Churchill (1874–1965)