Markov Chain - General State Space

General State Space

Many results for Markov chains with finite state space can be generalized to chains with uncountable state space through Harris chains. The main idea is to see if there is a point in the state space that the chain hits with probability one. Generally, it is not true for continuous state space, however, we can define sets A and B along with a positive number ε and a probability measure ρ, such that

Then we could collapse the sets into an auxiliary point α, and a recurrent Harris chain can be modified to contain α. Lastly, the collection of Harris chains is a comfortable level of generality, which is broad enough to contain a large number of interesting examples, yet restrictive enough to allow for a rich theory.

Read more about this topic:  Markov Chain

Famous quotes containing the words general, state and/or space:

    It has been the struggle between privileged men who have managed to get hold of the levers of power and the people in general with their vague and changing aspirations for equality, for justice, for some kind of gentler brotherhood and peace, which has kept that balance of forces we call our system of government in equilibrium.
    John Dos Passos (1896–1970)

    Wherever the State touches the personal life of the infant, the child, the youth, or the aged, helpless, defective in mind, body or moral nature, there the State enters “woman’s peculiar sphere,” her sphere of motherly succor and training, her sphere of sympathetic and self-sacrificing ministration to individual lives.
    Anna Garlin Spencer (1851–1931)

    True spoiling is nothing to do with what a child owns or with amount of attention he gets. he can have the major part of your income, living space and attention and not be spoiled, or he can have very little and be spoiled. It is not what he gets that is at issue. It is how and why he gets it. Spoiling is to do with the family balance of power.
    Penelope Leach (20th century)