Paper: Towards Using Structural Events To Assess Non-native Speech

ACL ID W10-1010
Title Towards Using Structural Events To Assess Non-native Speech
Venue Innovative Use of NLP for Building Educational Applications
Session
Year 2010
Authors

We investigated using structural events, e.g., clause and disfluency structure, from tran- scriptions of spontaneous non-native speech, to compute features for measuring speaking proficiency. Using a set of transcribed au- dio files collected from the TOEFL Practice Test Online (TPO), we conducted a sophisti- cated annotation of structural events, includ- ing clause boundaries and types, as well as disfluencies. Based on words and the anno- tated structural events, we extracted features related to syntactic complexity, e.g., the mean length of clause (MLC) and dependent clause frequency (DEPC), and a feature related to disfluencies, the interruption point frequency per clause (IPC). Among these features, the IPC shows the highest correlation with holis- tic scores (r =−0.344). Furthermor...