Finite State Space
If the state space is finite, the transition probability distribution can be represented by a matrix, called the transition matrix, with the (i, j)th element of P equal to
Since each row of P sums to one and all elements are non-negative, P is a right stochastic matrix.
Read more about this topic: Markov Chain
Famous quotes containing the words finite, state and/or space:
“God is a being of transcendent and unlimited perfections: his nature therefore is incomprehensible to finite spirits.”
—George Berkeley (1685–1753)
“Most of us are about as eager to be changed as we were to be born, and go through our changes in a similar state of shock.”
—James Baldwin (1924–1987)
“The limitless future of childhood shrinks to realistic proportions, to one of limited chances and goals; but, by the same token, the mastery of time and space and the conquest of helplessness afford a hitherto unknown promise of self- realization. This is the human condition of adolescence.”
—Peter Blos (20th century)