Joint Entropy - Relations To Other Entropy Measures

Relations To Other Entropy Measures

Joint entropy is used in the definition of conditional entropy

and mutual information

In quantum information theory, the joint entropy is generalized into the joint quantum entropy.

Read more about this topic:  Joint Entropy

Famous quotes containing the words relations, entropy and/or measures:

    Consciousness, we shall find, is reducible to relations between objects, and objects we shall find to be reducible to relations between different states of consciousness; and neither point of view is more nearly ultimate than the other.
    —T.S. (Thomas Stearns)

    Just as the constant increase of entropy is the basic law of the universe, so it is the basic law of life to be ever more highly structured and to struggle against entropy.
    Václav Havel (b. 1936)

    Those who, while they disapprove of the character and measures of a government, yield to it their allegiance and support are undoubtedly its most conscientious supporters, and so frequently the most serious obstacles to reform.
    Henry David Thoreau (1817–1862)