Hapax Legomenon - Computer Science

Computer Science

In the fields of computational linguistics and natural language processing (NLP), esp. corpus linguistics and machine-learned NLP, it is common to disregard hapax legomena (and sometimes other infrequent words), as they are likely to have little value for computational techniques. This disregard has the added benefit of significantly reducing the memory use of an application, since, by Zipf's law, many words are hapaxes.

Read more about this topic:  Hapax Legomenon

Famous quotes containing the words computer and/or science:

    The computer takes up where psychoanalysis left off. It takes the ideas of a decentered self and makes it more concrete by modeling mind as a multiprocessing machine.
    Sherry Turkle (b. 1948)

    The negative cautions of science are never popular. If the experimentalist would not commit himself, the social philosopher, the preacher, and the pedagogue tried the harder to give a short- cut answer.
    Margaret Mead (1901–1978)