Limitations of cross-lingual learning from image search

Mareike Hartmann; Anders Søgaard

Limitations of cross-lingual learning from image search

Abstract

Cross-lingual representation learning is animportant step in making NLP scale to allthe world’s languages. Previous work onbilingual lexicon induction suggests that itis possible to learn cross-lingual representationsof words based on similarities betweenimages associated with these words.However, that work focused (almost exclusively)on the translation of nouns only.Here, we investigate whether the meaningof other parts-of-speech (POS), in particularadjectives and verbs, can be learned inthe same way. Our experiments across fivelanguage pairs indicate that previous workdoes not scale to the problem of learningcross-lingual representations beyond simplenouns.

Original language	English
Title of host publication	Proceedings of the 3rd Workshop on Representation Learning for NLP
Publication date	2018
Pages	59–163
Publication status	Published - 2018
Event	3rd Workshop on Representation Learning for NLP - Melbourne, Australia Duration: 20 Jul 2018 → 20 Jul 2018

Workshop

Workshop	3rd Workshop on Representation Learning for NLP
Country/Territory	Australia
City	Melbourne
Period	20/07/2018 → 20/07/2018

Cite this

@inproceedings{7aafe63dd9234d01a305d3b649a12d1e,

title = "Limitations of cross-lingual learning from image search",

abstract = "Cross-lingual representation learning is animportant step in making NLP scale to allthe world{\textquoteright}s languages. Previous work onbilingual lexicon induction suggests that itis possible to learn cross-lingual representationsof words based on similarities betweenimages associated with these words.However, that work focused (almost exclusively)on the translation of nouns only.Here, we investigate whether the meaningof other parts-of-speech (POS), in particularadjectives and verbs, can be learned inthe same way. Our experiments across fivelanguage pairs indicate that previous workdoes not scale to the problem of learningcross-lingual representations beyond simplenouns.",

author = "Mareike Hartmann and Anders S{\o}gaard",

year = "2018",

language = "English",

pages = "59–163",

booktitle = "Proceedings of the 3rd Workshop on Representation Learning for NLP",

note = "3rd Workshop on Representation Learning for NLP ; Conference date: 20-07-2018 Through 20-07-2018",

}

TY - GEN

T1 - Limitations of cross-lingual learning from image search

AU - Hartmann, Mareike

AU - Søgaard, Anders

PY - 2018

Y1 - 2018

N2 - Cross-lingual representation learning is animportant step in making NLP scale to allthe world’s languages. Previous work onbilingual lexicon induction suggests that itis possible to learn cross-lingual representationsof words based on similarities betweenimages associated with these words.However, that work focused (almost exclusively)on the translation of nouns only.Here, we investigate whether the meaningof other parts-of-speech (POS), in particularadjectives and verbs, can be learned inthe same way. Our experiments across fivelanguage pairs indicate that previous workdoes not scale to the problem of learningcross-lingual representations beyond simplenouns.

AB - Cross-lingual representation learning is animportant step in making NLP scale to allthe world’s languages. Previous work onbilingual lexicon induction suggests that itis possible to learn cross-lingual representationsof words based on similarities betweenimages associated with these words.However, that work focused (almost exclusively)on the translation of nouns only.Here, we investigate whether the meaningof other parts-of-speech (POS), in particularadjectives and verbs, can be learned inthe same way. Our experiments across fivelanguage pairs indicate that previous workdoes not scale to the problem of learningcross-lingual representations beyond simplenouns.

M3 - Article in proceedings

SP - 59

EP - 163

BT - Proceedings of the 3rd Workshop on Representation Learning for NLP

T2 - 3rd Workshop on Representation Learning for NLP

Y2 - 20 July 2018 through 20 July 2018

ER -