Hapax Legomenon - Computer Science

Computer Science

In the fields of computational linguistics and natural language processing (NLP), esp. corpus linguistics and machine-learned NLP, it is common to disregard hapax legomena (and sometimes other infrequent words), as they are likely to have little value for computational techniques. This disregard has the added benefit of significantly reducing the memory use of an application, since, by Zipf's law, many words are hapaxes.

Read more about this topic:  Hapax Legomenon

Famous quotes containing the word science:

    He who would do good to another must do it in Minute Particulars:
    General Good is the plea of the scoundrel, hypocrite, and flatterer,
    For Art and Science cannot exist but in minutely organized Particulars.
    William Blake (1757–1827)