Paper: Towards Better NLP System Evaluation

ACL ID H94-1018
Title Towards Better NLP System Evaluation
Venue Human Language Technologies
Session Main Conference
Year 1994

This paper considers key elements of evaluation methodol- ogy, indicating the many points involved and advocating an unpacking approach in specifying an evaluation remit and de- sign. Recognising the importance of both environment vari- ables and system parameters leads to a grid organisation for tests. The paper illustrates the application of these notions through two examples.