In discrete-time Markov Decision Processes, decisions are made at discrete time epoch. However, for Continuous-time Markov Decision Process, decisions can be made at any time when decision maker wants. Unlike discrete-time Markov Decision Process, Continuous-time Markov Decision Process could better model the decision making process when the interested system has continuous dynamics, i.e., the system dynamics is defined by partial differential equations (PDEs).
Read more about this topic: Markov Decision Process
Famous quotes containing the words decision and/or process:
“Our decision about energy will test the character of the American people and the ability of the President and the Congress to govern this nation. This difficult effort will be the “moral equivalent of war,” except that we will be uniting our efforts to build and not to destroy.”
—Jimmy Carter (James Earl Carter, Jr.)
“Science and art are only too often a superior kind of dope, possessing this advantage over booze and morphia: that they can be indulged in with a good conscience and with the conviction that, in the process of indulging, one is leading the “higher life.””
—Aldous Huxley (1894–1963)