Determination of The Tikhonov Factor
The optimal regularization parameter is usually unknown and often in practical problems is determined by an ad hoc method. A possible approach relies on the Bayesian interpretation described above. Other approaches include the discrepancy principle, cross-validation, L-curve method, restricted maximum likelihood and unbiased predictive risk estimator. Grace Wahba proved that the optimal parameter, in the sense of leave-one-out cross-validation minimizes:
where is the residual sum of squares and is the effective number of degrees of freedom.
Using the previous SVD decomposition, we can simplify the above expression:
and
Read more about this topic: Tikhonov Regularization
Famous quotes containing the words determination of and/or factor:
“No man is quite sane; each has a vein of folly in his composition, a slight determination of blood to the head, to make sure of holding him hard to some one point which nature has taken to heart.”
—Ralph Waldo Emerson (1803–1882)
“In his very rejection of art Walt Whitman is an artist. He tried to produce a certain effect by certain means and he succeeded.... He stands apart, and the chief value of his work is in its prophecy, not in its performance. He has begun a prelude to larger themes. He is the herald to a new era. As a man he is the precursor of a fresh type. He is a factor in the heroic and spiritual evolution of the human being. If Poetry has passed him by, Philosophy will take note of him.”
—Oscar Wilde (1854–1900)