Novelty Detection

Novelty detection is the identification of new or unknown data that a machine learning system has not been trained with and was not previously aware of, with the help of either statistical or neural network based approaches.

Novelty detection is one of the fundamental requirements of a good classification system. A machine learning system can never be trained with all the possible object classes and hence the performance of the network will be poor for those classes that are under-represented in the training set. A good classification system must have the ability to differentiate between known and unknown objects during testing. For this purpose, different models for novelty detection have been proposed.

It can be said that there is no single best model for novelty detection since the success depends not only on the method used but also on the statistical properties of the data handled. Novelty detection finds a variety of applications especially in signal processing, computer vision, pattern recognition, data mining and robotics. Another important application is the detection of a disease or potential fault whose class may be under-represented in the training set.

The statistical approaches to novelty detection may be classified into parametric and non-parametric approaches. Parametric approaches assume Gaussian distribution of data and statistical modelling based on data mean and covariance, whereas non-parametric approaches do not make any assumption on the statistical properties of data.