Paper: Improving Peer Feedback Prediction: The Sentence Level is Right

ACL ID W14-1812
Title Improving Peer Feedback Prediction: The Sentence Level is Right
Venue Innovative Use of NLP for Building Educational Applications
Session
Year 2014
Authors

Recent research aims to automatically pre- dict whether peer feedback is of high qual- ity, e.g. suggests solutions to identified problems. While prior studies have fo- cused on peer review of papers, simi- lar issues arise when reviewing diagrams and other artifacts. In addition, previous studies have not carefully examined how the level of prediction granularity impacts both accuracy and educational utility. In this paper we develop models for predict- ing the quality of peer feedback regard- ing argument diagrams. We propose to perform prediction at the sentence level, even though the educational task is to la- bel feedback at a multi-sentential com- ment level. We first introduce a corpus annotated at a sentence level granularity, then build comment prediction models us- ing this corpu...