Basic Concept
Source: Fawcett (2006). |
A classification model (classifier or diagnosis) is a mapping of instances between certain classes/groups. The classifier or diagnosis result can be a real value (continuous output), in which case the classifier boundary between classes must be determined by a threshold value (for instance, to determine whether a person has hypertension based on a blood pressure measure). Or it can be a discrete class label, indicating one of the classes.
Let us consider a two-class prediction problem (binary classification), in which the outcomes are labeled either as positive (p) or negative (n). There are four possible outcomes from a binary classifier. If the outcome from a prediction is p and the actual value is also p, then it is called a true positive (TP); however if the actual value is n then it is said to be a false positive (FP). Conversely, a true negative (TN) has occurred when both the prediction outcome and the actual value are n, and false negative (FN) is when the prediction outcome is n while the actual value is p.
To get an appropriate example in a real-world problem, consider a diagnostic test that seeks to determine whether a person has a certain disease. A false positive in this case occurs when the person tests positive, but actually does not have the disease. A false negative, on the other hand, occurs when the person tests negative, suggesting they are healthy, when they actually do have the disease.
Let us define an experiment from P positive instances and N negative instances. The four outcomes can be formulated in a 2×2 contingency table or confusion matrix, as follows:
actual value | ||||
---|---|---|---|---|
p | n | total | ||
prediction outcome |
p' | True Positive |
False Positive |
P' |
n' | False Negative |
True Negative |
N' | |
total | P | N |
Read more about this topic: Receiver Operating Characteristic
Famous quotes containing the words basic and/or concept:
“A kiss can be a comma, a question mark or an exclamation point. Thats basic spelling that every woman ought to know.”
—Mistinguett (18741956)
“Behind the concept of womans strangeness is the idea that a woman may do anything: she is below society, not bound by its law, unpredictable; an attribute given to every member of the league of the unfortunate.”
—Christina Stead (19021983)