Certainty Equivalence
An extremely well-studied formulation in stochastic control is that of linear quadratic Gaussian control. Here the model is linear, the objective function is the expected value of a quadratic form, and the disturbances are purely additive. A basic result for discrete-time centralized systems is the certainty equivalence property: that the optimal control solution in this case is the same as would be obtained in the absence of the additive disturbances. This property is applicable to all centralized systems with linear equations of evolution, quadratic cost function, and noise entering the model only additively; the quadratic assumption allows for the optimal control laws, which follow the certainty-equivalence property, to be linear functions of the observations of the controllers.
Any deviation from the above assumptions—a nonlinear state equation, a non-quadratic objective function, noise in the multiplicative parameters of the model, or decentralization of control—causes the certainty equivalence property not to hold. For example, its failure to hold for decentralized control was demonstrated in Witsenhausen's counterexample.
Read more about this topic: Stochastic Control
Famous quotes containing the word certainty:
“He had been a lad of whom something was expected. Beyond this all had been chaos. That he would be successful in an original way, or that he would go to the dogs in an original way, seemed equally probable. The only absolute certainty about him was that he would not stand still in the circumstances amid which he was born.”
—Thomas Hardy (18401928)