History
Andrey Markov produced the first results (1906) for these processes, purely theoretically. A generalization to countably infinite state spaces was given by Kolmogorov (1936). Markov chains are related to Brownian motion and the ergodic hypothesis, two topics in physics which were important in the early years of the twentieth century, but Markov appears to have pursued this out of a mathematical motivation, namely the extension of the law of large numbers to dependent events. In 1913, he applied his findings for the first time to the first 20,000 letters of Pushkin's Eugene Onegin.. By 1917, more practical application of his work was made by Erlang to obtain formulas for call loss and waiting time in telephone network.
Seneta provides an account of Markov's motivations and the theory's early development. The term "chain" was used by Markov (1906).
Read more about this topic: Markov Chain
Famous quotes containing the word history:
“The whole history of civilisation is strewn with creeds and institutions which were invaluable at first, and deadly afterwards.”
—Walter Bagehot (1826–1877)
“The thing that struck me forcefully was the feeling of great age about the place. Standing on that old parade ground, which is now a cricket field, I could feel the dead generations crowding me. Here was the oldest settlement of freedmen in the Western world, no doubt. Men who had thrown off the bands of slavery by their own courage and ingenuity. The courage and daring of the Maroons strike like a purple beam across the history of Jamaica.”
—Zora Neale Hurston (1891–1960)
“The history of work has been, in part, the history of the worker’s body. Production depended on what the body could accomplish with strength and skill. Techniques that improve output have been driven by a general desire to decrease the pain of labor as well as by employers’ intentions to escape dependency upon that knowledge which only the sentient laboring body could provide.”
—Shoshana Zuboff (b. 1951)