Markov Chain - Markov Chains - Steady-state Analysis and Limiting Distributions - Steady-state Analysis and The Time-inhomogeneous Markov Chain

Steady-state Analysis and The Time-inhomogeneous Markov Chain

A Markov chain need not necessarily be time-homogeneous to have an equilibrium distribution. If there is a probability distribution over states such that

for every state j and every time n then is an equilibrium distribution of the Markov chain. Such can occur in Markov chain Monte Carlo (MCMC) methods in situations where a number of different transition matrices are used, because each is efficient for a particular kind of mixing, but each matrix respects a shared equilibrium distribution.

Read more about this topic:  Markov Chain, Markov Chains, Steady-state Analysis and Limiting Distributions

Famous quotes containing the words chain and/or analysis:

    It could not have come down to us so far,
    Through the interstices of things ajar
    On the long bead chain of repeated birth,
    To be a bird while we are men on earth,
    Robert Frost (1874–1963)

    A commodity appears at first sight an extremely obvious, trivial thing. But its analysis brings out that it is a very strange thing, abounding in metaphysical subtleties and theological niceties.
    Karl Marx (1818–1883)