Certainty Equivalence
An extremely well-studied formulation in stochastic control is that of linear quadratic Gaussian control. Here the model is linear, the objective function is the expected value of a quadratic form, and the disturbances are purely additive. A basic result for discrete-time centralized systems is the certainty equivalence property: that the optimal control solution in this case is the same as would be obtained in the absence of the additive disturbances. This property is applicable to all centralized systems with linear equations of evolution, quadratic cost function, and noise entering the model only additively; the quadratic assumption allows for the optimal control laws, which follow the certainty-equivalence property, to be linear functions of the observations of the controllers.
Any deviation from the above assumptions—a nonlinear state equation, a non-quadratic objective function, noise in the multiplicative parameters of the model, or decentralization of control—causes the certainty equivalence property not to hold. For example, its failure to hold for decentralized control was demonstrated in Witsenhausen's counterexample.
Read more about this topic: Stochastic Control
Famous quotes containing the word certainty:
“It takes twenty or so years before a mother can know with any certainty how effective her theories have been—and even then there are surprises. The daily newspapers raise the most frightening questions of all for a mother of sons: Could my once sweet babes ever become violent men? Are my sons really who I think they are?”
—Mary Kay Blakely (20th century)