Paper: Is That Your Final Answer?

ACL ID H01-1042
Title Is That Your Final Answer?
Venue Human Language Technologies
Session Main Conference
Year 2001
  • Florence M. Reeder (George Mason University, Fairfax VA; The MITRE Corporation, McLean VA)

The purpose of this research is to test the efficacy of applying automated evaluation techniques, originally devised for the evaluation of human language learners, to the output of machine translation (MT) systems. We believe that these evaluation techniques will provide information about both the human language learning process, the translation process and the development of machine translation systems. This, the first experiment in a series of experiments, looks at the intelligibility of MT output. A language learning experiment showed that assessors can differentiate native from non-native language essays in less than 100 words. Even more illuminating was the factors on which the assessors made their decisions. We tested this to see if similar criteria could be elicited from duplicating...