Cross-lingual tagger evaluation without test data

TY - GEN

T1 - Cross-lingual tagger evaluation without test data

AU - Agic, Zeljko

AU - Plank, Barbara

AU - Søgaard, Anders

N1 - Conference code: 15

PY - 2017

Y1 - 2017

N2 - We address the challenge of cross-lingual POS tagger evaluation in absence of manually annotated test data. We put forth and evaluate two dictionary-based metrics. On the tasks of accuracy prediction and system ranking, we reveal that these metrics are reliable enough to approximate test set-based evaluation, and at the same time lean enough to support assessment for truly low-resource languages.

AB - We address the challenge of cross-lingual POS tagger evaluation in absence of manually annotated test data. We put forth and evaluate two dictionary-based metrics. On the tasks of accuracy prediction and system ranking, we reveal that these metrics are reliable enough to approximate test set-based evaluation, and at the same time lean enough to support assessment for truly low-resource languages.

M3 - Article in proceedings

VL - 2

SP - 248

EP - 253

BT - Proceedings of the 15th Conference of the European Chapter of the Association for Computational Linguistics

PB - Association for Computational Linguistics

T2 - 15th Conference of the European Chapter of the Association for Computational Linguistics

Y2 - 3 April 2017 through 7 April 2017

ER -