Characterization
Shannon entropy is characterized by a small number of criteria, listed below. Any definition of entropy satisfying these assumptions has the form
where K is a constant corresponding to a choice of measurement units.
In the following, and .
Read more about this topic: Entropy (information Theory)