Joint Entropy - Relations To Other Entropy Measures

Relations To Other Entropy Measures

Joint entropy is used in the definition of conditional entropy

and mutual information

In quantum information theory, the joint entropy is generalized into the joint quantum entropy.

Read more about this topic:  Joint Entropy

Famous quotes containing the words relations to, relations, entropy and/or measures:

    Actually, the laboring man has not leisure for a true integrity day by day; he cannot afford to sustain the manliest relations to men; his labor would be depreciated in the market.
    He has no time to be anything but a machine.
    Henry David Thoreau (1817–1862)

    All social rules and all relations between individuals are eroded by a cash economy, avarice drags Pluto himself out of the bowels of the earth.
    Karl Marx (1818–1883)

    Just as the constant increase of entropy is the basic law of the universe, so it is the basic law of life to be ever more highly structured and to struggle against entropy.
    Václav Havel (b. 1936)

    ... moral certainty is certainty which is sufficient to regulate our behaviour, or which measures up to the certainty we have on matters relating to the conduct of life which we never normally doubt, though we know that it is possible, absolutely speaking, that they may be false.
    René Descartes (1596–1650)