Paper: Comparative Parser Performance Analysis across Grammar Frameworks through Automatic Tree Conversion using Synchronous Grammars

ACL ID C08-1069
Title Comparative Parser Performance Analysis across Grammar Frameworks through Automatic Tree Conversion using Synchronous Grammars
Venue International Conference on Computational Linguistics
Session Main Conference
Year 2008
Authors
  • Takuya Matsuzaki (University of Tokyo, Tokyo Japan)
  • Jun'ichi Tsujii (University of Tokyo, Tokyo Japan; University of Manchester, Manchester UK; National Center for Text Mining, UK)

This paper presents a methodology for the comparative performance analysis of the parsers developed for different grammar frameworks. For such a comparison, we need a common representation format of the parsing results since the representation of the parsing results depends on the gram- mar frameworks; hence they are not di- rectly comparable to each other. We rst convert the parsing result to a shallow CFG analysis by using an automatic tree con- verter based on synchronous grammars. The use of such a shallow representation as a common format has the advantage of re- duced noise introduced by the conversion in comparison with the noise produced by the conversion to deeper representations. We compared an HPSG parser with sev- eral CFG parsers in our experiment and found that meaningful di...