Moby Project - Language

Moby Language II contains wordlists of five languages - French, German, Italian, Japanese, and Spanish:

Language Words Size (in bytes)
French 138,257 1,524,757
German 159,809 2,055,986
Italian 60,453 561,981
Japanese 115,523 934,783
Spanish 86,059 850,523
Total 560,101 5,928,030

However, some of the lists are contaminated, for example the Japanese list contains English words such as abnormal and non-words such as abcdefgh and m,./.

Read more about this topic:  Moby Project

Famous quotes containing the word language:

    The face of the water, in time, became a wonderful book—a book that was a dead language to the uneducated passenger, but which told its mind to me without reserve, delivering its most cherished secrets as clearly as if it uttered them with a voice. And it was not a book to be read once and thrown aside, for it had a new story to tell every day.
    Mark Twain [Samuel Langhorne Clemens] (1835–1910)

    He never doubts his genius; it is only he and his God in all the world. He uses language sometimes as greatly as Shakespeare; and though there is not much straight grain in him, there is plenty of tough, crooked timber.
    Henry David Thoreau (1817–1862)

    If fancy then
    Unequal fails beneath the pleasing task,
    Ah, what shall language do?
    James Thomson (1700–1748)