Finite State Space
If the state space is finite, the transition probability distribution can be represented by a matrix, called the transition matrix, with the (i, j)th element of P equal to
Since each row of P sums to one and all elements are non-negative, P is a right stochastic matrix.
Read more about this topic: Markov Chain
Famous quotes containing the words finite, state and/or space:
“Are not all finite beings better pleased with motions relative than absolute?”
—Henry David Thoreau (1817–1862)
“If the alternative is to keep all just men in prison, or give up war and slavery, the State will not hesitate which to choose.”
—Henry David Thoreau (1817–1862)
“Here in the U.S., culture is not that delicious panacea which we Europeans consume in a sacramental mental space and which has its own special columns in the newspapers—and in people’s minds. Culture is space, speed, cinema, technology. This culture is authentic, if anything can be said to be authentic.”
—Jean Baudrillard (b. 1929)