In discrete-time Markov Decision Processes, decisions are made at discrete time epoch. However, for Continuous-time Markov Decision Process, decisions can be made at any time when decision maker wants. Unlike discrete-time Markov Decision Process, Continuous-time Markov Decision Process could better model the decision making process when the interested system has continuous dynamics, i.e., the system dynamics is defined by partial differential equations (PDEs).
Read more about this topic: Markov Decision Process
Famous quotes containing the words decision and/or process:
“Once the decision has been reached, close your ears even to the best counter-argument: a sign of strong character. Thus an occasional will to stupidity.”
—Friedrich Nietzsche (1844–1900)
“Opinions are formed in a process of open discussion and public debate, and where no opportunity for the forming of opinions exists, there may be moods—moods of the masses and moods of individuals, the latter no less fickle and unreliable than the former—but no opinion.”
—Hannah Arendt (1906–1975)