Duality (optimization) - Duality Principle

In optimization theory, the duality principle states that optimization problems may be viewed from either of two perspectives, the primal problem or the dual problem.

In general given two dual pairs of separated locally convex spaces and . Then given the function, we can define the primal problem as finding such that

In other words, is the infimum (greatest lower bound) of the function .

If there are constraint conditions, these can be built in to the function by letting where is the indicator function. Then let be a perturbation function such that .

The duality gap is the difference of the right and left hand sides of the inequality

where is the convex conjugate in both variables and denotes the supremum (least upper bound).

Read more about this topic:  Duality (optimization)

Famous quotes containing the word principle:

    A certain secret jealousy of the British Minister is always lurking in the breast of every American Senator, if he is truly democratic; for democracy, rightly understood, is the government of the people, by the people, for the benefit of Senators, and there is always a danger that the British Minister may not understand this political principle as he should.
    Henry Brooks Adams (1838–1918)