In discrete-time Markov Decision Processes, decisions are made at discrete time epoch. However, for Continuous-time Markov Decision Process, decisions can be made at any time when decision maker wants. Unlike discrete-time Markov Decision Process, Continuous-time Markov Decision Process could better model the decision making process when the interested system has continuous dynamics, i.e., the system dynamics is defined by partial differential equations (PDEs).
Read more about this topic: Markov Decision Process
Famous quotes containing the words decision and/or process:
“Drug misuse is not a disease, it is a decision, like the decision to step out in front of a moving car. You would call that not a disease but an error of judgment.”
—Philip K. Dick (1928–1982)
“At last a vision has been vouchsafed to us of our life as a whole. We see the bad with the good.... With this vision we approach new affairs. Our duty is to cleanse, to reconsider, to restore, to correct the evil without impairing the good, to purify and humanize every process of our common life, without weakening or sentimentalizing it.”
—Woodrow Wilson (1856–1924)