Solution of A Non-linear System
Gradient descent can also be used to solve a system of nonlinear equations. Below is an example that shows how to use the gradient descent to solve for three unknown variables, x1, x2, and x3. This example shows one iteration of the gradient descent.
Consider a nonlinear system of equations:
suppose we have the function
where
and the objective function
With initial guess
We know that
where
The Jacobian matrix
Then evaluating these terms at
and
So that
and
Now a suitable must be found such that . This can be done with any of a variety of line search algorithms. One might also simply guess which gives
evaluating at this value,
The decrease from to the next step's value of is a sizable decrease in the objective function. Further steps would reduce its value until a solution to the system was found.
Read more about this topic: Gradient Descent
Famous quotes containing the words solution of, solution and/or system:
“I herewith commission you to carry out all preparations with regard to ... a total solution of the Jewish question in those territories of Europe which are under German influence.... I furthermore charge you to submit to me as soon as possible a draft showing the ... measures already taken for the execution of the intended final solution of the Jewish question.”
—Hermann Goering (18931946)
“Any solution to a problem changes the problem.”
—R.W. (Richard William)
“Such is the remorseless progression of human society, shedding lives and souls as it goes on its way. It is an ocean into which men sink who have been cast out by the law and consigned, with help most cruelly withheld, to moral death. The sea is the pitiless social darkness into which the penal system casts those it has condemned, an unfathomable waste of misery. The human soul, lost in those depths, may become a corpse. Who shall revive it?”
—Victor Hugo (18021885)