Influencing gestural representation of eventualities: insights from ontology

Magdalena Lis

doi:10.1145/2388676.2388733

Influencing gestural representation of eventualities: insights from ontology

Magdalena Lis

LUKKET: Center for Sprogteknologi

1 Citationer (Scopus)

Abstract

In the present paper we report results of a pilot study on the verbal and gestural representation of eventualities. We investigate the relationship between eventuality characteristics, as reflected in linguistic categorizations of verbs denoting the eventuality referred to, and physical form of cospeech gesture. Most importantly we look at whether referent's ontological type, information about which we derive from plWordNet 1.5, correlates to the viewpoint adopted in co-occuring gesture. Our results indicate a strong correlation between eventuality type and gestural viewpoint and are the first step towards a model of gestural behaviour planning driven by referents' types as reflected in speech and categorized in linguistic ontologies.

Originalsprog	Engelsk
Titel	Proceedings of the 14th ACM International Conference on Multimodal Interaction
Antal sider	7
Forlag	ACM New York
Publikationsdato	okt. 2012
Sider	281-288
ISBN (Elektronisk)	978-1-4503-1467-1
DOI	https://doi.org/10.1145/2388676.2388733
Status	Udgivet - okt. 2012
Begivenhed	14th ACM International Conference on Multimodal Interaction: ICMI 12. Santa Monica, Ca - Santa Monica, CA, USA Varighed: 22 okt. 2012 → 26 okt. 2012

Konference

Konference	14th ACM International Conference on Multimodal Interaction: ICMI 12. Santa Monica, Ca
Land/Område	USA
By	Santa Monica, CA
Periode	22/10/2012 → 26/10/2012

Adgang til dokumentet

10.1145/2388676.2388733

http://dl.acm.org/citation.cfm?id=2388733

Citationsformater

@inproceedings{574ba33f0d45444095f45be0a1f4143a,

title = "Influencing gestural representation of eventualities: insights from ontology",

abstract = "In the present paper we report results of a pilot study on the verbal and gestural representation of eventualities. We investigate the relationship between eventuality characteristics, as reflected in linguistic categorizations of verbs denoting the eventuality referred to, and physical form of cospeech gesture. Most importantly we look at whether referent's ontological type, information about which we derive from plWordNet 1.5, correlates to the viewpoint adopted in co-occuring gesture. Our results indicate a strong correlation between eventuality type and gestural viewpoint and are the first step towards a model of gestural behaviour planning driven by referents' types as reflected in speech and categorized in linguistic ontologies.",

author = "Magdalena Lis",

year = "2012",

month = oct,

doi = "10.1145/2388676.2388733",

language = "English",

pages = "281--288",

booktitle = "Proceedings of the 14th ACM International Conference on Multimodal Interaction",

publisher = "ACM New York",

note = "14th ACM International Conference on Multimodal Interaction: ICMI 12. Santa Monica, Ca, ICMI '12 ; Conference date: 22-10-2012 Through 26-10-2012",

}

TY - GEN

T1 - Influencing gestural representation of eventualities: insights from ontology

AU - Lis, Magdalena

PY - 2012/10

Y1 - 2012/10

N2 - In the present paper we report results of a pilot study on the verbal and gestural representation of eventualities. We investigate the relationship between eventuality characteristics, as reflected in linguistic categorizations of verbs denoting the eventuality referred to, and physical form of cospeech gesture. Most importantly we look at whether referent's ontological type, information about which we derive from plWordNet 1.5, correlates to the viewpoint adopted in co-occuring gesture. Our results indicate a strong correlation between eventuality type and gestural viewpoint and are the first step towards a model of gestural behaviour planning driven by referents' types as reflected in speech and categorized in linguistic ontologies.

AB - In the present paper we report results of a pilot study on the verbal and gestural representation of eventualities. We investigate the relationship between eventuality characteristics, as reflected in linguistic categorizations of verbs denoting the eventuality referred to, and physical form of cospeech gesture. Most importantly we look at whether referent's ontological type, information about which we derive from plWordNet 1.5, correlates to the viewpoint adopted in co-occuring gesture. Our results indicate a strong correlation between eventuality type and gestural viewpoint and are the first step towards a model of gestural behaviour planning driven by referents' types as reflected in speech and categorized in linguistic ontologies.

U2 - 10.1145/2388676.2388733

DO - 10.1145/2388676.2388733

M3 - Article in proceedings

SP - 281

EP - 288

BT - Proceedings of the 14th ACM International Conference on Multimodal Interaction

PB - ACM New York

T2 - 14th ACM International Conference on Multimodal Interaction: ICMI 12. Santa Monica, Ca

Y2 - 22 October 2012 through 26 October 2012

ER -

Influencing gestural representation of eventualities: insights from ontology

Abstract

Konference

Adgang til dokumentet

Fingeraftryk

Citationsformater