History
Andrey Markov produced the first results (1906) for these processes, purely theoretically. A generalization to countably infinite state spaces was given by Kolmogorov (1936). Markov chains are related to Brownian motion and the ergodic hypothesis, two topics in physics which were important in the early years of the twentieth century, but Markov appears to have pursued this out of a mathematical motivation, namely the extension of the law of large numbers to dependent events. In 1913, he applied his findings for the first time to the first 20,000 letters of Pushkin's Eugene Onegin.. By 1917, more practical application of his work was made by Erlang to obtain formulas for call loss and waiting time in telephone network.
Seneta provides an account of Markov's motivations and the theory's early development. The term "chain" was used by Markov (1906).
Read more about this topic: Markov Chain
Famous quotes containing the word history:
“In nature, all is useful, all is beautiful. It is therefore beautiful, because it is alive, moving, reproductive; it is therefore useful, because it is symmetrical and fair. Beauty will not come at the call of a legislature, nor will it repeat in England or America its history in Greece. It will come, as always, unannounced, and spring up between the feet of brave and earnest men.”
—Ralph Waldo Emerson (1803–1882)
“It is my conviction that women are the natural orators of the race.”
—Eliza Archard Connor, U.S. suffragist. As quoted in History of Woman Suffrage, vol. 4, ch. 9, by Susan B. Anthony and Ida Husted Harper (1902)
“Let us not underrate the value of a fact; it will one day flower in a truth. It is astonishing how few facts of importance are added in a century to the natural history of any animal. The natural history of man himself is still being gradually written.”
—Henry David Thoreau (1817–1862)