Paper: Rapid Development of a Corpus with Discourse Annotations using Two-stage Crowdsourcing

ACL ID C14-1027
Title Rapid Development of a Corpus with Discourse Annotations using Two-stage Crowdsourcing
Venue International Conference on Computational Linguistics
Session Main Conference
Year 2014
Authors

We present a novel approach for rapidly developing a corpus with discourse annotations using crowdsourcing. Although discourse annotations typically require much time and cost owing to their complex nature, we realize discourse annotations in an extremely short time while retaining good quality of the annotations by crowdsourcing two annotation subtasks. In fact, our experi- ment to create a corpus comprising 30,000 Japanese sentences took less than eight hours to run. Based on this corpus, we also develop a supervised discourse parser and evaluate its performance to verify the usefulness of the acquired corpus.