TY - GEN
T1 - SemEval-2014 Task 2
T2 - 8th International Workshop on Semantic Evaluation, SemEval 2014
AU - Klasinas, Ioannis
AU - Iosif, Elias
AU - Louka, Katerina
AU - Potamianos, Alexandros
N1 - Publisher Copyright:
© 8th International Workshop on Semantic Evaluation, SemEval 2014 - co-located with the 25th International Conference on Computational Linguistics, COLING 2014, Proceedings. All rights reserved.
PY - 2014
Y1 - 2014
N2 - In this paper we present the SemEval-2014 Task 2 on spoken dialogue grammar induction. The task is to classify a lexical fragment to the appropriate semantic category (grammar rule) in order to construct a grammar for spoken dialogue systems. We describe four subtasks covering two languages, English and Greek, and three speech application domains, travel reservation, tourism and finance. The classification results are compared against the groundtruth. Weighted and unweighted precision, recall and f-measure are reported. Three sites participated in the task with five systems, employing a variety of features and in some cases using external resources for training. The submissions manage to significantly beat the baseline, achieving a f-measure of 0.69 in comparison to 0.56 for the baseline, averaged across all subtasks.
AB - In this paper we present the SemEval-2014 Task 2 on spoken dialogue grammar induction. The task is to classify a lexical fragment to the appropriate semantic category (grammar rule) in order to construct a grammar for spoken dialogue systems. We describe four subtasks covering two languages, English and Greek, and three speech application domains, travel reservation, tourism and finance. The classification results are compared against the groundtruth. Weighted and unweighted precision, recall and f-measure are reported. Three sites participated in the task with five systems, employing a variety of features and in some cases using external resources for training. The submissions manage to significantly beat the baseline, achieving a f-measure of 0.69 in comparison to 0.56 for the baseline, averaged across all subtasks.
UR - http://www.scopus.com/inward/record.url?scp=85122014611&partnerID=8YFLogxK
M3 - Conference contribution
AN - SCOPUS:85122014611
T3 - 8th International Workshop on Semantic Evaluation, SemEval 2014 - co-located with the 25th International Conference on Computational Linguistics, COLING 2014, Proceedings
SP - 9
EP - 16
BT - 8th International Workshop on Semantic Evaluation, SemEval 2014 - co-located with the 25th International Conference on Computational Linguistics, COLING 2014, Proceedings
A2 - Nakov, Preslav
A2 - Zesch, Torsten
PB - Association for Computational Linguistics (ACL)
Y2 - 23 August 2014 through 24 August 2014
ER -