SemEval-2014 Task 2: Grammar Induction for Spoken Dialogue Systems

Ioannis Klasinas, Elias Iosif, Katerina Louka, Alexandros Potamianos

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

In this paper we present the SemEval-2014 Task 2 on spoken dialogue grammar induction. The task is to classify a lexical fragment to the appropriate semantic category (grammar rule) in order to construct a grammar for spoken dialogue systems. We describe four subtasks covering two languages, English and Greek, and three speech application domains, travel reservation, tourism and finance. The classification results are compared against the groundtruth. Weighted and unweighted precision, recall and f-measure are reported. Three sites participated in the task with five systems, employing a variety of features and in some cases using external resources for training. The submissions manage to significantly beat the baseline, achieving a f-measure of 0.69 in comparison to 0.56 for the baseline, averaged across all subtasks.

Original languageEnglish
Title of host publication8th International Workshop on Semantic Evaluation, SemEval 2014 - co-located with the 25th International Conference on Computational Linguistics, COLING 2014, Proceedings
EditorsPreslav Nakov, Torsten Zesch
PublisherAssociation for Computational Linguistics (ACL)
Pages9-16
Number of pages8
ISBN (Electronic)9781941643242
Publication statusPublished - 2014
Externally publishedYes
Event8th International Workshop on Semantic Evaluation, SemEval 2014 - Dublin, Ireland
Duration: 23 Aug 201424 Aug 2014

Publication series

Name8th International Workshop on Semantic Evaluation, SemEval 2014 - co-located with the 25th International Conference on Computational Linguistics, COLING 2014, Proceedings

Conference

Conference8th International Workshop on Semantic Evaluation, SemEval 2014
Country/TerritoryIreland
CityDublin
Period23/08/1424/08/14

Fingerprint

Dive into the research topics of 'SemEval-2014 Task 2: Grammar Induction for Spoken Dialogue Systems'. Together they form a unique fingerprint.

Cite this