Random Naive Bayes - Naive Bayes Classifier

Naive Bayes Classifier

The naive Bayes classifier is a probabilistic classifier simplifying Bayes' theorem by naively assuming class conditional independence. Although this assumption leads to biased posterior probabilities, the ordered probabilities of Naive Bayes result in a classification performance comparable to that of classification trees and neural networks. Notwithstanding Naive Bayes' popularity due to its simplicity combined with high accuracy and speed, its conditional independence assumption rarely holds. There are mainly two approaches to alleviate this naivety:

1. Selecting attribute subsets in which attributes are conditionally independent (cf. Selective Bayesian Classifier ).
2. Extending the structure of Naive Bayes to represent attribute dependencies (cf. Averaged One-Dependence Estimators (AODE) ).