NER Evaluation Forums
Evaluation of NER systems is critical to scientific progress of this field.
Most evaluation of these systems has been performed at conferences or contests put on by government organizations, sometimes acting in concert with contractors or academics.
| Conference | Acronym | Language(s) | Year(s) | Sponsor | Archive Site |
|---|---|---|---|---|---|
| Message Understanding Conference | MUC | English | 1987–1999 | DARPA | |
| Multilingual Entity Task Conference | MET | Chinese and Japanese | 1998 | US | |
| Automatic Content Extraction Program | ACE | English | 2000–2008 | NIST | |
| Conference on Computational Natural Language Learning | CoNLL | Spanish and Dutch / German and English | 2002–2003 | ||
| Evaluation contest for named entity recognizers in Portuguese | HAREM | Portuguese | 2004–2008 | Linguateca | |
| Information Retrieval and Extraction Exercise | IREX | Japanese | 1998–1999 | ||
| ACL Special Interest Group in Chinese | SIGHan | Chinese | 2006 | ||
| TAC Knowledge Base Population Evaluation | TAC/KBP | English | 2009– | NIST | |
| Speech technology evaluation for the French language | ESTER/ETAPE | French | 2009, 2012 | AFCP/ISCA | |
| Evaluation of NLP and Speech Tools for Italian | EVALITA | Italian | 2007, 2009, 2011 | CELCT |
Read more about this topic: Named-entity Recognition
Famous quotes containing the word evaluation:
“Evaluation is creation: hear it, you creators! Evaluating is itself the most valuable treasure of all that we value. It is only through evaluation that value exists: and without evaluation the nut of existence would be hollow. Hear it, you creators!”
—Friedrich Nietzsche (1844–1900)