Paper: A Web Application for the Diagnostic Evaluation of Machine Translation over Specific Linguistic Phenomena

ACL ID N13-3005
Title A Web Application for the Diagnostic Evaluation of Machine Translation over Specific Linguistic Phenomena
Venue Annual Conference of the North American Chapter of the Association for Computational Linguistics
Session System Demonstration
Year 2013
Authors

This paper presents a web application and a web service for the diagnostic evaluation of Machine Translation (MT). These web-based tools are built on top of DELiC4MT, an open- source software package that assesses the per- formance of MT systems over user-defined linguistic phenomena (lexical, morphological, syntactic and semantic). The advantage of the web-based scenario is clear; compared to the standalone tool, the user does not need to carry out any installation, configuration or mainte- nance of the tool. 1 Automatic Evaluation of Machine Translation beyond Overall Scores Machine translation (MT) output can be evaluated using different approaches, which can essentially be divided into human and automatic, both of which, however, present a number of shortcomings. Hu- man evaluation ten...