Z-channel (information Theory) - Capacity

Capacity

The capacity of the Z-channel with the crossover 1 → 0 probability p, when the input random variable X is distributed according to the Bernoulli distribution with probability α for the occurrence of 0, is calculated as follows.

where is the binary entropy function.

The maximum is attained for

yielding the following value of as a function of p

For small p, the capacity is approximated by

as compared to the capacity of the binary symmetric channel with crossover probability p.

Read more about this topic:  Z-channel (information Theory)

Famous quotes containing the word capacity:

    “There seems almost a general wish of descrying the capacity and undervaluing the labour of the novelist, and of slighting the performances which have only genius, wit, and taste to recommend them.”
    —Jane Austen (1775–1817)

    “Lords and Commoners of England, consider what nation it is whereof ye are, and whereof ye are the governors; a nation not slow and dull, but of a quick, ingenious and piercing spirit, acute to invent, subtle and sinewy to discourse, not beneath the reach of any point the highest that human capacity can soar to.”
    —John Milton (1608–1674)

    “The desert is a natural extension of the inner silence of the body. If humanity’s language, technology, and buildings are an extension of its constructive faculties, the desert alone is an extension of its capacity for absence, the ideal schema of humanity’s disappearance.”
    —Jean Baudrillard (b. 1929)