Strongly Typical Sequences (strong Typicality, Letter Typicality)
If a sequence x1, ..., xn is drawn from some specified joint distribution defined over a finite or an infinite alphabet, then the strongly typical set, Aε,strong(n) is defined as the set of sequences which satisfy
where is the number of occurrences of a specific symbol in the sequence.
It can be shown that strongly typical sequences are also weakly typical (with a different constant ε), and hence the name. The two forms, however, are not equivalent. Strong typicality is often easier to work with in proving theorems for memoryless channels. However, as is apparent from the definition, this form of typicality is only defined for random variables having finite support.
Read more about this topic: Typical Set
Famous quotes containing the words strongly, typical and/or letter:
“I feel that any form of so called psychotherapy is strongly contraindicated for addicts.... The question “Why did you start using narcotics in the first place?” should never be asked. It is quite as irrelevant to treatment as it would be to ask a malarial patient why he went to a malarial area.”
—William Burroughs (b. 1914)
“It was announced that the trouble was not “malignant.”... It was a typical triumph of modern science to find the only part of Randolph that was not malignant and remove it.”
—Evelyn Waugh (1903–1966)
“This at least should be a rule through the letter-writing world: that no angry letter be posted till four-and-twenty hours will have elapsed since it was written.”
—Anthony Trollope (1815–1882)