Paper: SemEval-2014 Task 3: Cross-Level Semantic Similarity

ACL ID S14-2003
Title SemEval-2014 Task 3: Cross-Level Semantic Similarity
Venue Joint Conference on Lexical and Computational Semantics
Year 2014

This paper introduces a new SemEval task on Cross-Level Semantic Similarity (CLSS), which measures the degree to which the meaning of a larger linguistic item, such as a paragraph, is captured by a smaller item, such as a sentence. High- quality data sets were constructed for four comparison types using multi-stage an- notation procedures with a graded scale of similarity. Nineteen teams submitted 38 systems. Most systems surpassed the baseline performance, with several attain- ing high performance for multiple com- parison types. Further, our results show that comparisons of semantic representa- tion increase performance beyond what is possible with text alone.