Paper: Estimating Upper And Lower Bounds On The Performance Of Word-Sense Disambiguation Programs

ACL ID P92-1032
Title Estimating Upper And Lower Bounds On The Performance Of Word-Sense Disambiguation Programs
Venue Annual Meeting of the Association of Computational Linguistics
Session Main Conference
Year 1992
Authors

We have recently reported on two new word-sense disambiguation systems, one trained on bilingual material (the Canadian Hansards) and the other trained on monolingual material (Roget's Thesaurus and Grolier's Encyclopedia). After using both the monolingual and bilingual classifiers for a few months, we have convinced ourselves that the performance is remarkably good. Nevertheless, we would really like to be able to make a stronger statement, and therefore, we decided to try to develop some more objective evaluation measures. Although there has been a fair amount of literature on sense-disambiguation, the literature does not offer much guidance in how we might establish the success or failure of a proposed solution such as the two systems mentioned in the previous paragraph. Many papers avo...