NER Evaluation Forums
Evaluation of NER systems is critical to scientific progress of this field.
Most evaluation of these systems has been performed at conferences or contests put on by government organizations, sometimes acting in concert with contractors or academics.
| Conference | Acronym | Language(s) | Year(s) | Sponsor | Archive Site |
|---|---|---|---|---|---|
| Message Understanding Conference | MUC | English | 1987–1999 | DARPA | |
| Multilingual Entity Task Conference | MET | Chinese and Japanese | 1998 | US | |
| Automatic Content Extraction Program | ACE | English | 2000–2008 | NIST | |
| Conference on Computational Natural Language Learning | CoNLL | Spanish and Dutch / German and English | 2002–2003 | ||
| Evaluation contest for named entity recognizers in Portuguese | HAREM | Portuguese | 2004–2008 | Linguateca | |
| Information Retrieval and Extraction Exercise | IREX | Japanese | 1998–1999 | ||
| ACL Special Interest Group in Chinese | SIGHan | Chinese | 2006 | ||
| TAC Knowledge Base Population Evaluation | TAC/KBP | English | 2009– | NIST | |
| Speech technology evaluation for the French language | ESTER/ETAPE | French | 2009, 2012 | AFCP/ISCA | |
| Evaluation of NLP and Speech Tools for Italian | EVALITA | Italian | 2007, 2009, 2011 | CELCT |
Read more about this topic: Named-entity Recognition
Famous quotes containing the word evaluation:
“Good critical writing is measured by the perception and evaluation of the subject; bad critical writing by the necessity of maintaining the professional standing of the critic.”
—Raymond Chandler (1888–1959)