Definition
Consider n jointly distributed random variables with a joint probability density function . Let be a subset of . Now we define where . Clearly there are 2n−1 non-empty subsets of . Corresponding to each, we have the joint entropy defined as . A vector in consisting of as its elements for all non-empty subsets of . Such a vector is called an entropic vector.
Read more about this topic: Entropic Vector
Famous quotes containing the word definition:
“... we all know the wag’s definition of a philanthropist: a man whose charity increases directly as the square of the distance.”
—George Eliot [Mary Ann (or Marian)
“Beauty, like all other qualities presented to human experience, is relative; and the definition of it becomes unmeaning and useless in proportion to its abstractness. To define beauty not in the most abstract, but in the most concrete terms possible, not to find a universal formula for it, but the formula which expresses most adequately this or that special manifestation of it, is the aim of the true student of aesthetics.”
—Walter Pater (1839–1894)
“One definition of man is “an intelligence served by organs.””
—Ralph Waldo Emerson (1803–1882)