In information theory, Gibbs' inequality is a statement about the mathematical entropy of a discrete probability distribution. Several other bounds on the entropy of probability distributions are derived from Gibbs' inequality, including Fano's inequality. It was first presented by J. Willard Gibbs in the 19th century.
Read more about Gibbs' Inequality: Gibbs' Inequality, Proof, Alternative Proofs, Corollary
Famous quotes containing the word inequality:
“Nature is unfair? So much the better, inequality is the only bearable thing, the monotony of equality can only lead us to boredom.”
—Francis Picabia (1878–1953)