In Bayesian probability theory, the principle of maximum entropy is a prime doctrine. It states that, subject to precisely stated prior data, which must be a proposition that expresses testable information, the probability distribution which best represents the current state of knowledge is the one with largest information-theoretical entropy.
Let some precisely stated prior data or testable information about a probability distribution function be given. Consider the set of all trial probability distributions that encode the prior data. Of those, the one that maximizes the information entropy is the proper probability distribution under the given prior data.
Read more about Principle Of Maximum Entropy: History, Overview, Testable Information, Justifications For The Principle of Maximum Entropy
Famous quotes containing the words principle of, principle, maximum and/or entropy:
“I often wish for the end of the wretched remnant of my life; and that wish is a rational one; but then the innate principle of self-preservation, wisely implanted in our natures, for obvious purposes, opposes that wish, and makes us endeavour to spin out our thread as long as we can, however decayed and rotten it may be.”
—Philip Dormer Stanhope, 4th Earl Chesterfield (1694–1773)
“I do not mean to exclude altogether the idea of patriotism. I know it exists, and I know it has done much in the present contest. But I will venture to assert, that a great and lasting war can never be supported on this principle alone. It must be aided by a prospect of interest, or some reward.”
—George Washington (1732–1799)
“Probably the only place where a man can feel really secure is in a maximum security prison, except for the imminent threat of release.”
—Germaine Greer (b. 1939)
“Just as the constant increase of entropy is the basic law of the universe, so it is the basic law of life to be ever more highly structured and to struggle against entropy.”
—Václav Havel (b. 1936)