Determining The Update Rule
The likelihood estimate needs to be as large as possible; because it's a lower bound, getting closer improves the approximation of the log likelihood. By substituting in the factorized version of, parameterized over the hidden nodes as above, is simply the negative relative entropy between and plus other terms independent of if is defined as
- ,
where is the expectation over all distributions except . Thus, if we set to be, the bound is maximized.
Read more about this topic: Variational Message Passing
Famous quotes containing the words determining the, determining and/or rule:
“I esteem it the happiness of this country that its settlers, whilst they were exploring their granted and natural rights and determining the power of the magistrate, were united by personal affection. Members of a church before whose searching covenant all rank was abolished, they stood in awe of each other, as religious men.”
—Ralph Waldo Emerson (1803–1882)
“Our civilization has decided ... that determining the guilt or innocence of men is a thing too important to be trusted to trained men.... When it wants a library catalogued, or the solar system discovered, or any trifle of that kind, it uses up its specialists. But when it wishes anything done which is really serious, it collects twelve of the ordinary men standing round. The same thing was done, if I remember right, by the Founder of Christianity.”
—Gilbert Keith Chesterton (1874–1936)
“School days, school days; dear old golden rule days.
Readin’ and ‘ritin’ and ‘rithmetic; taught to the tune of a hick’ry stick.”
—Will D. Cobb (1876–1930)