Determination of The Tikhonov Factor
The optimal regularization parameter is usually unknown and often in practical problems is determined by an ad hoc method. A possible approach relies on the Bayesian interpretation described above. Other approaches include the discrepancy principle, cross-validation, L-curve method, restricted maximum likelihood and unbiased predictive risk estimator. Grace Wahba proved that the optimal parameter, in the sense of leave-one-out cross-validation minimizes:
where is the residual sum of squares and is the effective number of degrees of freedom.
Using the previous SVD decomposition, we can simplify the above expression:
and
Read more about this topic: Tikhonov Regularization
Famous quotes containing the words determination of and/or factor:
“If an opinion can eventually go to the determination of a practical belief, it, in so far, becomes itself a practical belief; and every proposition that is not pure metaphysical jargon and chatter must have some possible bearing upon practice.”
—Charles Sanders Peirce (18391914)
“You factor in racism as a reality and you keep moving.”
—Jewell Jackson McCabe (b. 1945)