Hapax Legomenon - Computer Science

Computer Science

In the fields of computational linguistics and natural language processing (NLP), esp. corpus linguistics and machine-learned NLP, it is common to disregard hapax legomena (and sometimes other infrequent words), as they are likely to have little value for computational techniques. This disregard has the added benefit of significantly reducing the memory use of an application, since, by Zipf's law, many words are hapaxes.

Read more about this topic:  Hapax Legomenon

Famous quotes containing the words computer and/or science:

    “The archetype of all humans, their ideal image, is the computer, once it has liberated itself from its creator, man. The computer is the essence of the human being. In the computer, man reaches his completion.”
    —Friedrich Dürrenmatt (1921–1990)

    “Hard times accounted in large part for the fact that the exposition was a financial disappointment in its first year, but Sally Rand and her fan dancers accomplished what applied science had failed to do, and the exposition closed in 1934 with a net profit, which was donated to participating cultural institutions, excluding Sally Rand.”
    —For the State of Illinois, U.S. public relief program (1935-1943)