Gibbs' Inequality - Corollary

Corollary

The entropy of is bounded by:

The proof is trivial - simply set for all i.

Read more about this topic:  Gibbs' Inequality