Strongly Typical Sequences (strong Typicality, Letter Typicality)
If a sequence x1, ..., xn is drawn from some specified joint distribution defined over a finite or an infinite alphabet, then the strongly typical set, Aε,strong(n) is defined as the set of sequences which satisfy
where is the number of occurrences of a specific symbol in the sequence.
It can be shown that strongly typical sequences are also weakly typical (with a different constant ε), and hence the name. The two forms, however, are not equivalent. Strong typicality is often easier to work with in proving theorems for memoryless channels. However, as is apparent from the definition, this form of typicality is only defined for random variables having finite support.
Read more about this topic: Typical Set
Famous quotes containing the words strongly, typical and/or letter:
“However strongly they resist it, our kids have to learn that as adults we need the companionship and love of other adults. The more direct we are about our needs, the easier it may be for our children to accept those needs. Their jealousy may come from a fear that if we adults love each other we might not have any left for them. We have to let them know that it’s a different kind of love.”
—Ruth Davidson Bell. Ourselves and Our Children, by Boston Women’s Health Book Collective, ch. 3 (1978)
“New York is the meeting place of the peoples, the only city where you can hardly find a typical American.”
—Djuna Barnes (1892–1982)
“Love is the hardest thing in the world to write about. So simple. You’ve got to catch it through details, like the early morning sunlight hitting the gray tin of the rain spout in front of her house. The ringing of a telephone that sounds like Beethoven’s “Pastoral.” A letter scribbled on her office stationery that you carry around in your pocket because it smells of all the lilacs in Ohio.”
—Billy Wilder (b. 1906)