Convex Optimization - Standard Form

Standard form is the usual and most intuitive form of describing a convex minimization problem. It consists of the following three parts:

A convex function to be minimized over the variable
Inequality constraints of the form, where the functions are convex
Equality constraints of the form, where the functions are affine. In practice, the terms "linear" and "affine" are often used interchangeably. Such constraints can be expressed in the form, where is a column-vector and a real number.

A convex minimization problem is thus written as

$\begin{align} &\underset{x}{\operatorname{minimize}}& & f(x) \\ &\operatorname{subject\;to} & &g_i(x) \leq 0, \quad i = 1,\dots,m \\ &&&h_i(x) = 0, \quad i = 1, \dots,p. \end{align}$

Note that every equality constraint can be equivalently replaced by a pair of inequality constraints and . Therefore, for theoretical purposes, equality constraints are redundant; however, it can be beneficial to treat them specially in practice.

Following from this fact, it is easy to understand why has to be affine as opposed to merely being convex. If is convex, is convex, but is concave. Therefore, the only way for to be convex is for to be affine.

Read more about this topic: Convex Optimization

Famous quotes containing the words standard and/or form:

“This unlettered man’s speaking and writing are standard English. Some words and phrases deemed vulgarisms and Americanisms before, he has made standard American; such as “It will pay.” It suggests that the one great rule of composition—and if I were a professor of rhetoric I should insist on this—is, to speak the truth. This first, this second, this third; pebbles in your mouth or not. This demands earnestness and manhood chiefly.”
—Henry David Thoreau (1817–1862)

“It is my contention that civil disobedients are nothing but the latest form of voluntary association, and that they are thus quite in tune with the oldest traditions of the country.”
—Hannah Arendt (1906–1975)