Paper: Hierarchical Phrase-Based Translation with Weighted Finite State Transducers

ACL ID N09-1049
Title Hierarchical Phrase-Based Translation with Weighted Finite State Transducers
Venue Human Language Technologies
Session Main Conference
Year 2009
Authors

This paper describes a lattice-based decoder for hierarchical phrase-based translation. The decoder is implemented with standard WFST operations as an alternative to the well-known cube pruning procedure. We find that the use of WFSTs rather than k-best lists requires less pruning in translation search, resulting in fewer search errors, direct generation of translation lattices in the target language, better parameter optimization, and improved translation performance when rescoring with long-span language models and MBR decod- ing. We report translation experiments for the Arabic-to-English and Chinese-to-English NIST translation tasks and contrast the WFST- based hierarchical decoder with hierarchical translation under cube pruning.