Evaluating word embeddings with fMRI and eye-tracking

TY - GEN

T1 - Evaluating word embeddings with fMRI and eye-tracking

AU - Søgaard, Anders

N1 - Conference code: 1

PY - 2016

Y1 - 2016

N2 - The workshop CfP assumes that downstream evaluation of word embeddings is impractical, and that a valid evaluation metric for pairs of word embeddings can be found. I argue below that if so, the only meaningful evaluation procedure is comparison with measures of human word processing in the wild. Such evaluation is non-trivial, but I present a practical procedure here, evaluating word embeddings as features in a multi-dimensional regression model predicting brain imaging or eyetracking word-level aggregate statistics.

AB - The workshop CfP assumes that downstream evaluation of word embeddings is impractical, and that a valid evaluation metric for pairs of word embeddings can be found. I argue below that if so, the only meaningful evaluation procedure is comparison with measures of human word processing in the wild. Such evaluation is non-trivial, but I present a practical procedure here, evaluating word embeddings as features in a multi-dimensional regression model predicting brain imaging or eyetracking word-level aggregate statistics.

M3 - Article in proceedings

SN - 978-1-5108-2770-7

SP - 116

EP - 121

BT - Proceedings of the 1st Workshop on Evaluating Vector Space Representations for NLP

PB - Association for Computational Linguistics

T2 - 1st Workshop on Evaluating Vector-Space Representations for NLP

Y2 - 7 August 2016 through 12 August 2016

ER -