In discrete-time Markov Decision Processes, decisions are made at discrete time epoch. However, for Continuous-time Markov Decision Process, decisions can be made at any time when decision maker wants. Unlike discrete-time Markov Decision Process, Continuous-time Markov Decision Process could better model the decision making process when the interested system has continuous dynamics, i.e., the system dynamics is defined by partial differential equations (PDEs).
Read more about this topic: Markov Decision Process
Famous quotes containing the words decision and/or process:
“How could a man be satisfied with a decision between such alternatives and under such circumstances? No more than he can be satisfied with his hat, which he’s chosen from among such shapes as the resources of the age offer him, wearing it at best with a resignation which is chiefly supported by comparison.”
—George Eliot [Mary Ann (or Marian)
“I wish to see, in process of disappearing, that only thing which ever could bring this nation to civil war.”
—Abraham Lincoln (1809–1865)