Finite State Space
If the state space is finite, the transition probability distribution can be represented by a matrix, called the transition matrix, with the (i, j)th element of P equal to
Since each row of P sums to one and all elements are non-negative, P is a right stochastic matrix.
Read more about this topic: Markov Chain
Famous quotes containing the words finite, state and/or space:
“God is a being of transcendent and unlimited perfections: his nature therefore is incomprehensible to finite spirits.”
—George Berkeley (1685–1753)
“It’s important to remember that feminism is no longer a group of organizations or leaders. It’s the expectations that parents have for their daughters, and their sons, too. It’s the way we talk about and treat one another. It’s who makes the money and who makes the compromises and who makes the dinner. It’s a state of mind. It’s the way we live now.”
—Anna Quindlen (20th century)
“True spoiling is nothing to do with what a child owns or with amount of attention he gets. he can have the major part of your income, living space and attention and not be spoiled, or he can have very little and be spoiled. It is not what he gets that is at issue. It is how and why he gets it. Spoiling is to do with the family balance of power.”
—Penelope Leach (20th century)