Cross-lingual tagger evaluation without test data

Zeljko Agic; Barbara  Plank; Anders Søgaard

Cross-lingual tagger evaluation without test data

Zeljko Agic, Barbara Plank, Anders Søgaard

Department of Computer Science

4 Citations (Scopus)

Abstract

We address the challenge of cross-lingual POS tagger evaluation in absence of manually annotated test data. We put forth and evaluate two dictionary-based metrics. On the tasks of accuracy prediction and system ranking, we reveal that these metrics are reliable enough to approximate test set-based evaluation, and at the same time lean enough to support assessment for truly low-resource languages.

Original language	English
Title of host publication	Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics : short papers
Number of pages	6
Volume	2
Publisher	Association for Computational Linguistics
Publication date	2017
Pages	248-253
ISBN (Electronic)	9781510838604
Publication status	Published - 2017
Event	15th Conference of the European Chapter of the Association for Computational Linguistics - Valencia, Spain Duration: 3 Apr 2017 → 7 Apr 2017 Conference number: 15

Conference

Conference	15th Conference of the European Chapter of the Association for Computational Linguistics
Number	15
Country/Territory	Spain
City	Valencia
Period	03/04/2017 → 07/04/2017

Access to Document

https://aclweb.org/anthology/E/E17/E17-2040.pdf

Cite this

Cross-lingual tagger evaluation without test data. / Agic, Zeljko; Plank, Barbara ; Søgaard, Anders.

Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: short papers. Vol. 2 Association for Computational Linguistics, 2017. p. 248-253.

Research output: Chapter in Book/Report/Conference proceeding › Article in proceedings › Research › peer-review

Agic, Z, Plank, B & Søgaard, A 2017, Cross-lingual tagger evaluation without test data. in Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics: short papers. vol. 2, Association for Computational Linguistics, pp. 248-253, 15th Conference of the European Chapter of the Association for Computational Linguistics, Valencia, Spain, 03/04/2017. <https://aclweb.org/anthology/E/E17/E17-2040.pdf>

@inproceedings{5fa60f123e98457eb2cfc38d95b47b55,

title = "Cross-lingual tagger evaluation without test data",

abstract = "We address the challenge of cross-lingual POS tagger evaluation in absence of manually annotated test data. We put forth and evaluate two dictionary-based metrics. On the tasks of accuracy prediction and system ranking, we reveal that these metrics are reliable enough to approximate test set-based evaluation, and at the same time lean enough to support assessment for truly low-resource languages.",

author = "Zeljko Agic and Barbara Plank and Anders S{\o}gaard",

year = "2017",

language = "English",

volume = "2",

pages = "248--253",

booktitle = "Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics",

publisher = "Association for Computational Linguistics",

note = "15th Conference of the European Chapter of the Association for Computational Linguistics ; Conference date: 03-04-2017 Through 07-04-2017",

}

TY - GEN

T1 - Cross-lingual tagger evaluation without test data

AU - Agic, Zeljko

AU - Plank, Barbara

AU - Søgaard, Anders

N1 - Conference code: 15

PY - 2017

Y1 - 2017

N2 - We address the challenge of cross-lingual POS tagger evaluation in absence of manually annotated test data. We put forth and evaluate two dictionary-based metrics. On the tasks of accuracy prediction and system ranking, we reveal that these metrics are reliable enough to approximate test set-based evaluation, and at the same time lean enough to support assessment for truly low-resource languages.

AB - We address the challenge of cross-lingual POS tagger evaluation in absence of manually annotated test data. We put forth and evaluate two dictionary-based metrics. On the tasks of accuracy prediction and system ranking, we reveal that these metrics are reliable enough to approximate test set-based evaluation, and at the same time lean enough to support assessment for truly low-resource languages.

M3 - Article in proceedings

VL - 2

SP - 248

EP - 253

BT - Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics

PB - Association for Computational Linguistics

T2 - 15th Conference of the European Chapter of the Association for Computational Linguistics

Y2 - 3 April 2017 through 7 April 2017

ER -

Cross-lingual tagger evaluation without test data

Abstract

Conference

Access to Document

Fingerprint

Cite this