Full Text Search - The Precision Vs. Recall Tradeoff

The Precision Vs. Recall Tradeoff

Recall measures the quantity of relevant results returned by a search and precision is the measure of the quality of the results returned. Recall is the ratio of relevant results returned divided by all relevant results. Precision is the number of relevant results returned divided by the total number of results returned.

The diagram at right represents a low-precision, low-recall search. In the diagram the red and green dots represent the total population of potential search results for a given search. Red dots represent irrelevant results, and green dots represent relevant results. Relevancy is indicated by the proximity of search results to the center of the inner circle. Of all possible results shown, those that were actually returned by the search are shown on a light-blue background. In the example only one relevant result of three possible relevant results was returned, so the recall is a very low ratio of 1/3 or 33%. The precision for the example is a very low 1/4 or 25%, since only one of the four results returned was relevant.

Due to the ambiguities of natural language, full text search systems typically includes options like stop words to increase precision and stemming to increase recall. Controlled-vocabulary searching also helps alleviate low-precision issues by tagging documents in such a way that ambiguities are eliminated. The trade-off between precision and recall is simple: an increase in precision can lower overall recall while an increase in recall lowers precision.

See also: Precision and recall

Read more about this topic:  Full Text Search

Famous quotes containing the words precision and/or recall:

    We are often struck by the force and precision of style to which hard-working men, unpracticed in writing, easily attain when required to make the effort. As if plainness and vigor and sincerity, the ornaments of style, were better learned on the farm and in the workshop than in the schools. The sentences written by such rude hands are nervous and tough, like hardened thongs, the sinews of the deer, or the roots of the pine.
    Henry David Thoreau (1817–1862)

    That doctrine [of peace at any price] has done more mischief than any I can well recall that have been afloat in this country. It has occasioned more wars than any of the most ruthless conquerors. It has disturbed and nearly destroyed that political equilibrium so necessary to the liberties and the welfare of the world.
    Benjamin Disraeli (1804–1881)