Typical Set - Jointly Typical Sequences

Jointly Typical Sequences

Two sequences and are jointly ε-typical if the pair is ε-typical with respect to the joint distribution and both and are ε-typical with respect to their marginal distributions and . The set of all such pairs of sequences is denoted by . Jointly ε-typical n-tuple sequences are defined similarly.

Let and be two independent sequences of random variables with the same marginal distributions and . Then the set of jointly typical sequences has the following properties:

Read more about this topic:  Typical Set

Famous quotes containing the words jointly and/or typical:

    For, truly speaking, whoever provokes me to a good act or thought has given me a pledge of his fidelity to virtue,—he has come under the bonds to adhere to that cause to which we are jointly attached.
    Ralph Waldo Emerson (1803–1882)

    A building is akin to dogma; it is insolent, like dogma. Whether or no it is permanent, it claims permanence, like a dogma. People ask why we have no typical architecture of the modern world, like impressionism in painting. Surely it is obviously because we have not enough dogmas; we cannot bear to see anything in the sky that is solid and enduring, anything in the sky that does not change like the clouds of the sky.
    Gilbert Keith Chesterton (1874–1936)