Paper: SemEval-2014 Task 1: Evaluation of Compositional Distributional Semantic Models on Full Sentences through Semantic Relatedness and Textual Entailment

ACL ID S14-2001
Title SemEval-2014 Task 1: Evaluation of Compositional Distributional Semantic Models on Full Sentences through Semantic Relatedness and Textual Entailment
Venue Joint Conference on Lexical and Computational Semantics
Session
Year 2014
Authors

This paper presents the task on the evalu- ation of Compositional Distributional Se- mantics Models on full sentences orga- nized for the first time within SemEval- 2014. Participation was open to systems based on any approach. Systems were pre- sented with pairs of sentences and were evaluated on their ability to predict hu- man judgments on (i) semantic relatedness and (ii) entailment. The task attracted 21 teams, most of which participated in both subtasks. We received 17 submissions in the relatedness subtask (for a total of 66 runs) and 18 in the entailment subtask (65 runs).