Training
RBF networks are typically trained by a two-step algorithm. In the first step, the center vectors of the RBF functions in the hidden layer are chosen. This step can be performed in several ways; centers can be randomly sampled from some set of examples, or they can be determined using k-means clustering. Note that this step is unsupervised. A third backpropagation step can be performed to fine-tune all of the RBF net's parameters.
The second step simply fits a linear model with coefficients to the hidden layer's outputs with respect to some objective function. A common objective function, at least for regression/function estimation, is the least squares function:
where
- .
We have explicitly included the dependence on the weights. Minimization of the least squares objective function by optimal choice of weights optimizes accuracy of fit.
There are occasions in which multiple objectives, such as smoothness as well as accuracy, must be optimized. In that case it is useful to optimize a regularized objective function such as
where
and
where optimization of S maximizes smoothness and is known as a regularization parameter.
Read more about this topic: Radial Basis Function Network
Famous quotes containing the word training:
“Unfortunately, life may sometimes seem unfair to middle children, some of whom feel like an afterthought to a brilliant older sibling and unable to captivate the family’s attention like the darling baby. Yet the middle position offers great training for the real world of lowered expectations, negotiation, and compromise. Middle children who often must break the mold set by an older sibling may thereby learn to challenge family values and seek their own identity.”
—Marianne E. Neifert (20th century)
“In Washington, success is just a training course for failure.”
—Simon Hoggart (b. 1946)
“I am not a suffragist, nor do I believe in “careers” for women, especially a “career” in factory and mill where most working women have their “careers.” A great responsibility rests upon woman—the training of children. This is her most beautiful task.”
—Mother Jones (1830–1930)