Strongly Typical Sequences (strong Typicality, Letter Typicality)
If a sequence x1, ..., xn is drawn from some specified joint distribution defined over a finite or an infinite alphabet, then the strongly typical set, Aε,strong(n) is defined as the set of sequences which satisfy
where is the number of occurrences of a specific symbol in the sequence.
It can be shown that strongly typical sequences are also weakly typical (with a different constant ε), and hence the name. The two forms, however, are not equivalent. Strong typicality is often easier to work with in proving theorems for memoryless channels. However, as is apparent from the definition, this form of typicality is only defined for random variables having finite support.
Read more about this topic: Typical Set
Famous quotes containing the words strongly, typical and/or letter:
“Delicious essence! how refreshing art thou to nature! how strongly are all its powers and all its weaknesses on thy side! how sweetly dost thou mix with the blood, and help it through the most difficult and tortuous passages to the heart!”
—Laurence Sterne (1713–1768)
“It is not however, adulthood itself, but parenthood that forms the glass shroud of memory. For there is an interesting quirk in the memory of women. At 30, women see their adolescence quite clearly. At 30 a woman’s adolescence remains a facet fitting into her current self.... At 40, however, memories of adolescence are blurred. Women of this age look much more to their earlier childhood for memories of themselves and of their mothers. This links up to her typical parenting phase.”
—Terri Apter (20th century)
“The prince was getting tired.
He began to feel like a shoe salesman.
But he gave it one last try.
This time Cinderella fit into the shoe
like a love letter into its envelope.”
—Anne Sexton (1928–1974)