Paper: Ranking Human and Machine Summarization Systems

ACL ID D11-1043
Title Ranking Human and Machine Summarization Systems
Venue Conference on Empirical Methods in Natural Language Processing
Session Main Conference
Year 2011
Authors

The Text Analysis Conference (TAC) ranks summarizationsystemsby theiraveragescore over a collection of document sets. We in- vestigate the statisticalappropriatenessof this score and propose an alternative that better distinguishes between human and machine evaluationsystems.