Assessing multilingual multimodal image description: Studies of native speaker preferences and translator choices

TY - JOUR

T1 - Assessing multilingual multimodal image description: Studies of native speaker preferences and translator choices

AU - Frank, Stella

AU - Elliott, Desmond

AU - Specia, Lucia

PY - 2018/5/1

Y1 - 2018/5/1

N2 - Two studies on multilingual multimodal image description provide empirical evidence towards two questions at the core of the task: (i) whether target language speakers prefer descriptions generated directly in their native language, as compared to descriptions translated from a different language; (ii) whether images improve human translation of descriptions. These results provide guidance for future work in multimodal natural language processing by first showing that on the whole, translations are not distinguished from native language descriptions, and second delineating and quantifying the information gained from the image during the human translation task.

AB - Two studies on multilingual multimodal image description provide empirical evidence towards two questions at the core of the task: (i) whether target language speakers prefer descriptions generated directly in their native language, as compared to descriptions translated from a different language; (ii) whether images improve human translation of descriptions. These results provide guidance for future work in multimodal natural language processing by first showing that on the whole, translations are not distinguished from native language descriptions, and second delineating and quantifying the information gained from the image during the human translation task.

M3 - Journal article

VL - 24

SP - 393

EP - 413

JO - Journal of Natural Language Engineering

JF - Journal of Natural Language Engineering

IS - 3

ER -