Transfer learning of feedback head expressions in Danish and Polish comparable multimodal corpora

Costanza Navarretta, Magdalena Lis

2 Citations (Scopus)

Abstract

The paper is an investigation of the reusability of the annotations of head movements in a corpus in a language to predict the feedback functions of head movements in a comparable corpus in another language. The two corpora consist of naturally occurring triadic conversations in Danish and Polish, which were annotated according to the same scheme. The intersection of common annotation features was used in the experiments. A Naïve Bayes classifier was trained on the annotations of a corpus and tested on the annotations of the other corpus. Training and test datasets were then reversed and the experiments repeated. The results show that the classifier identifies more feedback behaviours than the majority baseline in both cases and the improvements are significant. The performance of the classifier decreases significantly compared with the results obtained when training and test data belong to the same corpus. Annotating multimodal data is resource consuming, thus the results are promising. However, they also confirm preceding studies that have identified both similarities and differences in the use of feedback head movements in different languages. Since our datasets are small and only regard a communicative behaviour in two languages, the experiments should be tested on more data types.

Original languageEnglish
Title of host publicationProceedings of the 9th International Conference on Language Resources and Evaluation : LREC2014
Place of PublicationReykjavik, Iceland
PublisherEuropean Language Resources Association
Publication date2014
Pages3597-3603
ISBN (Electronic)978-2-9517408-8-4
Publication statusPublished - 2014

Fingerprint

Dive into the research topics of 'Transfer learning of feedback head expressions in Danish and Polish comparable multimodal corpora'. Together they form a unique fingerprint.

Cite this