Determining The Update Rule
The likelihood estimate needs to be as large as possible; because it's a lower bound, getting closer improves the approximation of the log likelihood. By substituting in the factorized version of, parameterized over the hidden nodes as above, is simply the negative relative entropy between and plus other terms independent of if is defined as
- ,
where is the expectation over all distributions except . Thus, if we set to be, the bound is maximized.
Read more about this topic: Variational Message Passing
Famous quotes containing the words determining the, determining and/or rule:
“Our civilization has decided ... that determining the guilt or innocence of men is a thing too important to be trusted to trained men.... When it wants a library catalogued, or the solar system discovered, or any trifle of that kind, it uses up its specialists. But when it wishes anything done which is really serious, it collects twelve of the ordinary men standing round. The same thing was done, if I remember right, by the Founder of Christianity.”
—Gilbert Keith Chesterton (1874–1936)
“The true rule, in determining to embrace, or reject any thing, is not whether it have any evil in it; but whether it have more of evil, than of good. There are few things wholly evil, or wholly good.”
—Abraham Lincoln (1809–1865)
“And they that rule in England
In stately conclave met,
Alas, alas, for England
They have no graves as yet.”
—Gilbert Keith Chesterton (1874–1936)