Paper: Semantic Evaluation For Spoken-Language Systems

ACL ID H94-1022
Title Semantic Evaluation For Spoken-Language Systems
Venue Human Language Technologies
Session Main Conference
Year 1994

Development has begun on a semantic evaluation (Se- mEval) methodology and infrastructure for the ARPA Spo- ken Language Program. SemEval is an attempt to define a task-independent technology-based evaluation for language- understanding systems consisting of three parts: word-sense identification, predicate-argument structure determination, and identification of coreference relations. An initial spoken- language SemEval on ATIS data is planned for Novem- ber/December 1994, concurrent with the next ATIS CAS (database answer) evaluation.