Moby Project - Language

Moby Language II contains wordlists of five languages - French, German, Italian, Japanese, and Spanish:

Language Words Size (in bytes)
French 138,257 1,524,757
German 159,809 2,055,986
Italian 60,453 561,981
Japanese 115,523 934,783
Spanish 86,059 850,523
Total 560,101 5,928,030

However, some of the lists are contaminated, for example the Japanese list contains English words such as abnormal and non-words such as abcdefgh and m,./.

Read more about this topic:  Moby Project

Famous quotes containing the word language:

    Our goal as a parent is to give life to our children’s learning—to instruct, to teach, to help them develop self-discipline—an ordering of the self from the inside, not imposition from the outside. Any technique that does not give life to a child’s learning and leave a child’s dignity intact cannot be called discipline—it is punishment, no matter what language it is clothed in.
    Barbara Coloroso (20th century)

    What distinguished man from animals was the human capacity for symbolic thought, the capacity which was inseparable from the development of language in which words were not mere signals, but signifiers of something other than themselves. Yet the first symbols were animals. What distinguished men from animals was born of their relationship with them.
    John Berger (b. 1926)

    To write or even speak English is not a science but an art. There are no reliable words.... Whoever writes English is involved in a struggle that never lets up even for a sentence. He is struggling against vagueness, against obscurity, against the lure of the decorative adjective, against the encroachment of Latin and Greek, and, above all, against the worn-out phrases and dead metaphors with which the language is cluttered up.
    George Orwell (1903–1950)