Paper: Towards Data and Goal Oriented Analysis: Tool Inter-operability and Combinatorial Comparison

ACL ID I08-2122
Title Towards Data and Goal Oriented Analysis: Tool Inter-operability and Combinatorial Comparison
Venue International Joint Conference on Natural Language Processing
Session Main Conference
Year 2008
Authors

Recently, NLP researches have advanced using F-scores, precisions, and recalls with gold standard data as evaluation measures. However, such evaluations cannot capture the different behaviors of varying NLP tools or the different behaviors of a NLP tool that depends on the data and domain in which it works. Because an increasing number of tools are available nowadays, it has become increasingly important to grasp these behavioral differences, in order to select a suitable set of tools, which forms a complex workflow for a specific purpose. In order to observe such differences, we need to integrate available combinations of tools into a workflow and to compare the combinatorial results. Although generic frameworks like UIMA (Unstructured Information Management Architectur...