Paper: Methods For The Qualitative Evaluation Of Lexical Association Measures

ACL ID P01-1025
Title Methods For The Qualitative Evaluation Of Lexical Association Measures
Venue Annual Meeting of the Association of Computational Linguistics
Session Main Conference
Year 2001
Authors
  • Stefan Evert (University of Stuttgart, Stuttgart Germany)
  • Brigitte Krenn (Austrian Research Institute for Artificial Intelligence, Vienna Austria)

This paper presents methods for a qual- itative, unbiased comparison of lexical association measures and the results we have obtained for adjective-noun pairs and preposition-noun-verb triples ex- tracted from German corpora. In our approach, we compare the entire list of candidates, sorted according to the particular measures, to a reference set of manually identified “true positives”. We also show how estimates for the very large number of hapaxlegomena and double occurrences can be inferred from random samples.