Pontryagin's Minimum Principle - Formal Statement of Necessary Conditions For Minimization Problem | Formal Statement Conditions Minimization Problem

Formal Statement of Necessary Conditions For Minimization Problem

Here the necessary conditions are shown for minimization of a functional. Take to be the state of the dynamical system with input, such that

$\dot{x}=f(x,u), \quad x(0)=x_0, \quad u(t) \in \mathcal{U}, \quad t \in$

where is the set of admissible controls and is the terminal (i.e., final) time of the system. The control must be chosen for all to minimize the objective functional which is defined by the application and can be abstracted as

$J=\Psi(x(T))+\int^T_0 L(x(t),u(t)) \,dt$

The constraints on the system dynamics can be adjoined to the Lagrangian by introducing time-varying Lagrange multiplier vector, whose elements are called the costates of the system. This motivates the construction of the Hamiltonian defined for all by:

$H(\lambda(t),x(t),u(t),t)=\lambda'(t)f(x(t),u(t))+L(x(t),u(t)) \,$

where is the transpose of .

Pontryagin's minimum principle states that the optimal state trajectory, optimal control, and corresponding Lagrange multiplier vector must minimize the Hamiltonian so that

$(1) \qquad H(x^*(t),u^*(t),\lambda^*(t),t)\leq H(x^*(t),u,\lambda^*(t),t) \,$

for all time and for all permissible control inputs . It must also be the case that

$(2) \qquad \Psi_T(x(T))+H(T)=0 \,$

Additionally, the costate equations

$(3) \qquad -\dot{\lambda}'(t)=H_x(x^*(t),u^*(t),\lambda(t),t)=\lambda'(t)f_x(x^*(t),u^*(t))+L_x(x^*(t),u^*(t))$

must be satisfied. If the final state is not fixed (i.e., its differential variation is not zero), it must also be that the terminal costates are such that

$(4) \qquad \lambda'(T)=\Psi_x(x(T)) \,$

These four conditions in (1)-(4) are the necessary conditions for an optimal control. Note that (4) only applies when is free. If it is fixed, then this condition is not necessary for an optimum.

Read more about this topic: Pontryagin's Minimum Principle

Famous quotes containing the words formal, statement, conditions and/or problem:

“The formal Washington dinner party has all the spontaneity of a Japanese imperial funeral.”
—Simon Hoggart (b. 1946)

“Truth is that concordance of an abstract statement with the ideal limit towards which endless investigation would tend to bring scientific belief, which concordance the abstract statement may possess by virtue of the confession of its inaccuracy and one-sidedness, and this confession is an essential ingredient of truth.”
—Charles Sanders Peirce (1839–1914)

“... we have every reason to rejoice when there are so many gains and when favorable conditions abound on every hand. The end is not yet in sight, but it can not be far away. The road before us is shorter than the road behind.”
—Lucy Stone (1818–1893)

“I don’t have any problem with a reporter or a news person who says the President is uninformed on this issue or that issue. I don’t think any of us would challenge that. I do have a problem with the singular focus on this, as if that’s the only standard by which we ought to judge a president. What we learned in the last administration was how little having an encyclopedic grasp of all the facts has to do with governing.”
—David R. Gergen (b. 1942)