Strongly Typical Sequences (strong Typicality, Letter Typicality)
If a sequence x1, ..., xn is drawn from some specified joint distribution defined over a finite or an infinite alphabet, then the strongly typical set, Aε,strong(n) is defined as the set of sequences which satisfy
where is the number of occurrences of a specific symbol in the sequence.
It can be shown that strongly typical sequences are also weakly typical (with a different constant ε), and hence the name. The two forms, however, are not equivalent. Strong typicality is often easier to work with in proving theorems for memoryless channels. However, as is apparent from the definition, this form of typicality is only defined for random variables having finite support.
Read more about this topic: Typical Set
Famous quotes containing the words strongly, typical and/or letter:
“Let’s not quibble! I’m the foe of moderation, the champion of excess. If I may lift a line from a die-hard whose identity is lost in the shuffle, “I’d rather be strongly wrong than weakly right.””
—Tallulah Bankhead (1903–1968)
“A building is akin to dogma; it is insolent, like dogma. Whether or no it is permanent, it claims permanence, like a dogma. People ask why we have no typical architecture of the modern world, like impressionism in painting. Surely it is obviously because we have not enough dogmas; we cannot bear to see anything in the sky that is solid and enduring, anything in the sky that does not change like the clouds of the sky.”
—Gilbert Keith Chesterton (1874–1936)
“Your letter of excuses has arrived. I receive the letter but do not admit the excuses except in courtesy, as when a man treads on your toes and begs your pardon—the pardon is granted, but the joint aches, especially if there is a corn upon it.”
—George Gordon Noel Byron (1788–1824)