Z-channel (information Theory) - Capacity

Capacity

The capacity of the Z-channel with the crossover 1 → 0 probability p, when the input random variable X is distributed according to the Bernoulli distribution with probability α for the occurrence of 0, is calculated as follows.

where is the binary entropy function.

The maximum is attained for

yielding the following value of as a function of p

For small p, the capacity is approximated by

as compared to the capacity of the binary symmetric channel with crossover probability p.

Read more about this topic:  Z-channel (information Theory)

Famous quotes containing the word capacity:

    The frequent failure of men to cultivate their capacity for listening has a profound impact on their capacity for parenting, for it is mothers more than fathers who are most likely to still their own voices so they may hear and draw out the voices of their children.
    Mary Field Belenky (20th century)

    The legacies that parents and church and teachers left to my generation of Black children were priceless but not material: a living faith reflected in daily service, the discipline of hard work and stick-to-itiveness, and a capacity to struggle in the face of adversity.
    Marian Wright Edelman (20th century)

    What, then, is the basic difference between today’s computer and an intelligent being? It is that the computer can be made to see but not to perceive. What matters here is not that the computer is without consciousness but that thus far it is incapable of the spontaneous grasp of pattern—a capacity essential to perception and intelligence.
    Rudolf Arnheim (b. 1904)