Mathematical Statement
Theorem (Shannon, 1948):
- 1. For every discrete memoryless channel, the channel capacity
- has the following property. For any ε > 0 and R < C, for large enough N, there exists a code of length N and rate ≥ R and a decoding algorithm, such that the maximal probability of block error is ≤ ε.
- 2. If a probability of bit error pb is acceptable, rates up to R(pb) are achievable, where
- and is the binary entropy function
- 3. For any pb, rates greater than R(pb) are not achievable.
(MacKay (2003), p. 162; cf Gallager (1968), ch.5; Cover and Thomas (1991), p. 198; Shannon (1948) thm. 11)
Read more about this topic: Noisy-channel Coding Theorem
Famous quotes containing the words mathematical and/or statement:
“What he loved so much in the plant morphological structure of the tree was that given a fixed mathematical basis, the final evolution was so incalculable.”
—D.H. (David Herbert)
“The new statement will comprise the skepticisms, as well as the faiths of society, and out of unbeliefs a creed shall be formed. For, skepticisms are not gratuitous or lawless, but are limitations of the affirmative statement, and the new philosophy must take them in, and make affirmations outside of them, just as much as must include the oldest beliefs.”
—Ralph Waldo Emerson (1803–1882)