Paper: A New Set of Norms for Semantic Relatedness Measures

ACL ID P13-2154
Title A New Set of Norms for Semantic Relatedness Measures
Venue Annual Meeting of the Association of Computational Linguistics
Session Short Paper
Year 2013
Authors

We have elicited human quantitative judg- ments of semantic relatedness for 122 pairs of nouns and compiled them into a new set of relatedness norms that we call Rel-122. Judgments from individual sub- jects in our study exhibit high average cor- relation to the resulting relatedness means (r = 0.77, ? = 0.09, N = 73), although not as high as Resnik?s (1995) upper bound for expected average human correlation to similarity means (r = 0.90). This suggests that human perceptions of relatedness are less strictly constrained than perceptions of similarity and establishes a clearer ex- pectation for what constitutes human-like performance by a computational measure of semantic relatedness. We compare the results of several WordNet-based similarity and relatedness measures to our Rel-122 norms an...