Joint Entropy - Relations To Other Entropy Measures

Relations To Other Entropy Measures

Joint entropy is used in the definition of conditional entropy

and mutual information

In quantum information theory, the joint entropy is generalized into the joint quantum entropy.

Read more about this topic:  Joint Entropy

Famous quotes containing the words relations to, relations, entropy and/or measures:

    The interest in life does not lie in what people do, nor even in their relations to each other, but largely in the power to communicate with a third party, antagonistic, enigmatic, yet perhaps persuadable, which one may call life in general.
    Virginia Woolf (1882–1941)

    If one could be friendly with women, what a pleasure—the relationship so secret and private compared with relations with men. Why not write about it truthfully?
    Virginia Woolf (1882–1941)

    Just as the constant increase of entropy is the basic law of the universe, so it is the basic law of life to be ever more highly structured and to struggle against entropy.
    Václav Havel (b. 1936)

    Almost everywhere we find . . . the use of various coercive measures, to rid ourselves as quickly as possible of the child within us—i.e., the weak, helpless, dependent creature—in order to become an independent competent adult deserving of respect. When we reencounter this creature in our children, we persecute it with the same measures once used in ourselves.
    Alice Miller (20th century)