SemEval-2016 task 10: Detecting minimal semantic units and their meanings (DiMSUM).

Nathan Schneider; Dirk Hovy; Anders Trærup Johannsen; Marine Carpuat

SemEval-2016 task 10: Detecting minimal semantic units and their meanings (DiMSUM).

Nathan Schneider, Dirk Hovy, Anders Trærup Johannsen, Marine Carpuat

Department of Nordic Studies and Linguistics

Abstract

This task combines the labeling of multiword expressions and supersenses (coarse-grained classes) in an explicit, yet broad-coverage paradigm for lexical semantics. Nine systems participated; the best scored 57.7% F1 in a multi-domain evaluation setting, indicating that the task remains largely unresolved. An error analysis reveals that a large number of instances in the data set are either hard cases, which no systems get right, or easy cases, which all systems correctly solve.

Original language	English
Title of host publication	Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016)
Number of pages	14
Publisher	Association for Computational Linguistics
Publication date	2016
Pages	546-559
ISBN (Print)	978-1-941643-95-2
Publication status	Published - 2016
Event	10th International Workshop on Semantic Evaluation - San Diego, United States Duration: 16 Jun 2016 → 17 Jun 2016 Conference number: 10

Conference

Conference	10th International Workshop on Semantic Evaluation
Number	10
Country/Territory	United States
City	San Diego
Period	16/06/2016 → 17/06/2016

Access to Document

http://aclweb.org/anthology/S/S16/S16-1084.pdf

Cite this

SemEval-2016 task 10 : Detecting minimal semantic units and their meanings (DiMSUM). / Schneider, Nathan; Hovy, Dirk; Johannsen, Anders Trærup et al.

Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016). Association for Computational Linguistics, 2016. p. 546-559.

Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review

Schneider, N, Hovy, D, Johannsen, AT & Carpuat, M 2016, SemEval-2016 task 10: Detecting minimal semantic units and their meanings (DiMSUM). in Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016). Association for Computational Linguistics, pp. 546-559, 10th International Workshop on Semantic Evaluation, San Diego, United States, 16/06/2016. <http://aclweb.org/anthology/S/S16/S16-1084.pdf>

@inproceedings{3c708030cf674d119a90d3b44269ae26,

title = "SemEval-2016 task 10: Detecting minimal semantic units and their meanings (DiMSUM).",

abstract = "This task combines the labeling of multiword expressions and supersenses (coarse-grained classes) in an explicit, yet broad-coverage paradigm for lexical semantics. Nine systems participated; the best scored 57.7% F1 in a multi-domain evaluation setting, indicating that the task remains largely unresolved. An error analysis reveals that a large number of instances in the data set are either hard cases, which no systems get right, or easy cases, which all systems correctly solve.",

author = "Nathan Schneider and Dirk Hovy and Johannsen, {Anders Tr{\ae}rup} and Marine Carpuat",

year = "2016",

language = "English",

isbn = "978-1-941643-95-2",

pages = "546--559",

booktitle = "Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016)",

publisher = "Association for Computational Linguistics",

note = "10th International Workshop on Semantic Evaluation ; Conference date: 16-06-2016 Through 17-06-2016",

}

TY - GEN

T1 - SemEval-2016 task 10

T2 - 10th International Workshop on Semantic Evaluation

AU - Schneider, Nathan

AU - Hovy, Dirk

AU - Johannsen, Anders Trærup

AU - Carpuat, Marine

N1 - Conference code: 10

PY - 2016

Y1 - 2016

N2 - This task combines the labeling of multiword expressions and supersenses (coarse-grained classes) in an explicit, yet broad-coverage paradigm for lexical semantics. Nine systems participated; the best scored 57.7% F1 in a multi-domain evaluation setting, indicating that the task remains largely unresolved. An error analysis reveals that a large number of instances in the data set are either hard cases, which no systems get right, or easy cases, which all systems correctly solve.

AB - This task combines the labeling of multiword expressions and supersenses (coarse-grained classes) in an explicit, yet broad-coverage paradigm for lexical semantics. Nine systems participated; the best scored 57.7% F1 in a multi-domain evaluation setting, indicating that the task remains largely unresolved. An error analysis reveals that a large number of instances in the data set are either hard cases, which no systems get right, or easy cases, which all systems correctly solve.

M3 - Article in proceedings

SN - 978-1-941643-95-2

SP - 546

EP - 559

BT - Proceedings of the 10th International Workshop on Semantic Evaluation (SemEval-2016)

PB - Association for Computational Linguistics

Y2 - 16 June 2016 through 17 June 2016

ER -

SemEval-2016 task 10: Detecting minimal semantic units and their meanings (DiMSUM).

Abstract

Conference

Access to Document

Fingerprint

Cite this