Paper: SemEval-2014 Task 10: Multilingual Semantic Textual Similarity

ACL ID S14-2010
Title SemEval-2014 Task 10: Multilingual Semantic Textual Similarity
Venue Joint Conference on Lexical and Computational Semantics
Year 2014

In Semantic Textual Similarity, systems rate the degree of semantic equivalence between two text snippets. This year, the participants were challenged with new data sets for English, as well as the in- troduction of Spanish, as a new language in which to assess semantic similarity. For the English subtask, we exposed the systems to a diversity of testing scenar- ios, by preparing additional OntoNotes- WordNet sense mappings and news head- lines, as well as introducing new gen- res, including image descriptions, DEFT discussion forums, DEFT newswire, and tweet-newswire headline mappings. For Spanish, since, to our knowledge, this is the first time that official evaluations are conducted, we used well-formed text, by featuring sentences extracted from ency- clopedic content and newswire. The...