Paper: Automatic Evaluation Of Computer Generated Text: A Progress Report On The TEXTEVAL Project

ACL ID H94-1019
Title Automatic Evaluation Of Computer Generated Text: A Progress Report On The TEXTEVAL Project
Venue Human Language Technologies
Session Main Conference
Year 1994
Authors

We present results of experiments designed to assess the usefulness of a new technique for the evaluation of translation quality, comparing human rankings with automatic measures. The basis of our approach is the use of a standard set and the adoption of a statistical view of translation quality. This approach has the ability to provide evaluations which avoid dependence on any particular theory of translation, which are therefore potentially more objective than previous techniques. The work presented here was supported by the Science and Engineering and the Social and Economic Research Councils of Great Britain, and would not have been possible without the gracious assistance of Ian Mason of Heriot Watt University, Edinburgh.