Paper: Simple Customization of Recursive Neural Networks for Semantic Relation Classification

ACL ID D13-1137
Title Simple Customization of Recursive Neural Networks for Semantic Relation Classification
Venue Conference on Empirical Methods in Natural Language Processing
Session Main Conference
Year 2013
Authors

In this paper, we present a recursive neural network (RNN) model that works on a syn- tactic tree. Our model differs from previous RNN models in that the model allows for an explicit weighting of important phrases for the target task. We also propose to average param- eters in training. Our experimental results on semantic relation classification show that both phrase categories and task-specific weighting significantly improve the prediction accuracy of the model. We also show that averaging the model parameters is effective in stabilizing the learning and improves generalization capacity. The proposed model marks scores competitive with state-of-the-art RNN-based models.