In information theory, Gibbs' inequality is a statement about the mathematical entropy of a discrete probability distribution. Several other bounds on the entropy of probability distributions are derived from Gibbs' inequality, including Fano's inequality. It was first presented by J. Willard Gibbs in the 19th century.
Read more about Gibbs' Inequality: Gibbs' Inequality, Proof, Alternative Proofs, Corollary
Famous quotes containing the word inequality:
“The doctrine of equality!... But there exists no more poisonous poison: for it seems to be preached by justice itself, while it is the end of justice.... “Equality for equals, inequality for unequals”Mthat would be the true voice of justice: and, what follows from it, “Never make equal what is unequal.””
—Friedrich Nietzsche (1844–1900)