Paper: “cba to check the spelling”: Investigating Parser Performance on Discussion Forum Posts

ACL ID N10-1060
Title “cba to check the spelling”: Investigating Parser Performance on Discussion Forum Posts
Venue Human Language Technologies
Session Main Conference
Year 2010
Authors

We evaluate the Berkeley parser on text from an online discussion forum. We evaluate the parser output with and without gold tokens and spellings (using Sparseval and Parseval), and we compile a list of problematic phenom- ena for this domain. The Parseval f-score for a small development set is 77.56. This increases to 80.27 when we apply a set of simple trans- formations to the input sentences and to the Wall Street Journal (WSJ) training sections.