Danish parallel corpus for text simplification

TY - GEN

T1 - Danish parallel corpus for text simplification

AU - Klerke, Sigrid

AU - Søgaard, Anders

N1 - Conference code: 8

PY - 2012

Y1 - 2012

N2 - We present DSim, a new sentence aligned Danish monolingual parallel corpus extracted from 3701 pairs of news telegrams and corresponding professionally simplified short news articles. The corpus is intended for building automatic text simplification for adult readers. We compare DSim to different examples of monolingual parallel corpora, and we argue that this corpus is a promising basis for future development of automatic data-driven text simplification systems in Danish. The corpus contains both the collection of paired articles and a sentence aligned bitext, and we show that sentence alignment using simple tf∗Idf weighted cosine similarity scoring is on line with state-of-the-art when evaluated against a hand-aligned sample. The alignment results are compared to state of the art for English sentence alignment. We finally compare the source and simplified sides of the corpus in terms of lexical and syntactic characteristics and readability, and find that the one-to-many sentence aligned corpus is representative of the sentence simplifications observed in the unaligned collection of article pairs.

AB - We present DSim, a new sentence aligned Danish monolingual parallel corpus extracted from 3701 pairs of news telegrams and corresponding professionally simplified short news articles. The corpus is intended for building automatic text simplification for adult readers. We compare DSim to different examples of monolingual parallel corpora, and we argue that this corpus is a promising basis for future development of automatic data-driven text simplification systems in Danish. The corpus contains both the collection of paired articles and a sentence aligned bitext, and we show that sentence alignment using simple tf∗Idf weighted cosine similarity scoring is on line with state-of-the-art when evaluated against a hand-aligned sample. The alignment results are compared to state of the art for English sentence alignment. We finally compare the source and simplified sides of the corpus in terms of lexical and syntactic characteristics and readability, and find that the one-to-many sentence aligned corpus is representative of the sentence simplifications observed in the unaligned collection of article pairs.

M3 - Article in proceedings

BT - Proceedings of the eighth International Conference on Language Resources and Evaluation

PB - European Language Resources Association

T2 - International Conference on Language Resources and Evaluation

Y2 - 23 May 2012 through 25 May 2012

ER -