Paper: Entity Extraction is a Boring Solved Problem---Or is it?

ACL ID N07-2046
Title Entity Extraction is a Boring Solved Problem---Or is it?
Venue Human Language Technologies
Session Short Paper
Year 2007
Authors

This paper presents empirical results that contradict the prevailing opinion that en- tity extraction is a boring solved problem. In particular, we consider data sets that resemble familiar MUC/ACE data, and re- port surprisingly por performance for both commercial and research systems. We then give an error analysis that sug- gests research challenges for entity ex- traction that are neither boring nor solved. 1 Background Entity extraction or named entity recognition, as it is sometimes called, is a known and familiar prob- lem. Named entity (NE) tagging has been the sub- ject of numerous shared-task evaluations, including the seminal MUC 6, MUC 7 and MET evaluations, the CoNL shared task, the SIGHAN bake-offs, and the ACE evaluations. With this track record, and with commercial vendors ...