Gamification for IR: The query aspects game

Giorgio Maria Di Nunzio; Maria Maistro; Daniel Zilio

Gamification for IR: The query aspects game

Giorgio Maria Di Nunzio, Maria Maistro, Daniel Zilio

Abstract

The creation of a labelled dataset for Information Retrieval (IR) purposes is a costly process. For this reason, a mix of crowdsourcing and active learning approaches have been proposed in the literature in order to assess the relevance of documents of a collection given a particular query at an affordable cost. In this paper, we present the design of the gamification of this interactive process that draws inspiration from recent works in the area of gamification for IR. In particular, we focus on three main points: i) we want to create a set of relevance judgements with the least effort by human assessors, ii) we use interactive search interfaces that use game mechanics, iii) we use Natural Language Processing (NLP) to collect different aspects of a query.

Originalsprog	Engelsk
Tidsskrift	CEUR Workshop Proceedings
Vol/bind	1749
ISSN	1613-0073
Status	Udgivet - 1 jan. 2016
Udgivet eksternt	Ja
Begivenhed	3rd Italian Conference on Computational Linguistics, CLiC-it 2016 and 5th Evaluation Campaign of Natural Language Processing and Speech Tools for Italian, EVALITA 2016 - Napoli, Italien Varighed: 5 dec. 2016 → 7 dec. 2016

Konference

Konference	3rd Italian Conference on Computational Linguistics, CLiC-it 2016 and 5th Evaluation Campaign of Natural Language Processing and Speech Tools for Italian, EVALITA 2016
Land/Område	Italien
By	Napoli
Periode	05/12/2016 → 07/12/2016

Andre filer og links

Link to publication in Scopus

Citationsformater

@inproceedings{56beddc5c15349a08172e2f3f593414b,

title = "Gamification for IR: The query aspects game",

abstract = "The creation of a labelled dataset for Information Retrieval (IR) purposes is a costly process. For this reason, a mix of crowdsourcing and active learning approaches have been proposed in the literature in order to assess the relevance of documents of a collection given a particular query at an affordable cost. In this paper, we present the design of the gamification of this interactive process that draws inspiration from recent works in the area of gamification for IR. In particular, we focus on three main points: i) we want to create a set of relevance judgements with the least effort by human assessors, ii) we use interactive search interfaces that use game mechanics, iii) we use Natural Language Processing (NLP) to collect different aspects of a query.",

author = "{Di Nunzio}, {Giorgio Maria} and Maria Maistro and Daniel Zilio",

year = "2016",

month = jan,

day = "1",

language = "English",

volume = "1749",

journal = "CEUR Workshop Proceedings",

issn = "1613-0073",

publisher = "ceur workshop proceedings",

note = "3rd Italian Conference on Computational Linguistics, CLiC-it 2016 and 5th Evaluation Campaign of Natural Language Processing and Speech Tools for Italian, EVALITA 2016 ; Conference date: 05-12-2016 Through 07-12-2016",

}

TY - GEN

T1 - Gamification for IR

T2 - 3rd Italian Conference on Computational Linguistics, CLiC-it 2016 and 5th Evaluation Campaign of Natural Language Processing and Speech Tools for Italian, EVALITA 2016

AU - Di Nunzio, Giorgio Maria

AU - Maistro, Maria

AU - Zilio, Daniel

PY - 2016/1/1

Y1 - 2016/1/1

N2 - The creation of a labelled dataset for Information Retrieval (IR) purposes is a costly process. For this reason, a mix of crowdsourcing and active learning approaches have been proposed in the literature in order to assess the relevance of documents of a collection given a particular query at an affordable cost. In this paper, we present the design of the gamification of this interactive process that draws inspiration from recent works in the area of gamification for IR. In particular, we focus on three main points: i) we want to create a set of relevance judgements with the least effort by human assessors, ii) we use interactive search interfaces that use game mechanics, iii) we use Natural Language Processing (NLP) to collect different aspects of a query.

AB - The creation of a labelled dataset for Information Retrieval (IR) purposes is a costly process. For this reason, a mix of crowdsourcing and active learning approaches have been proposed in the literature in order to assess the relevance of documents of a collection given a particular query at an affordable cost. In this paper, we present the design of the gamification of this interactive process that draws inspiration from recent works in the area of gamification for IR. In particular, we focus on three main points: i) we want to create a set of relevance judgements with the least effort by human assessors, ii) we use interactive search interfaces that use game mechanics, iii) we use Natural Language Processing (NLP) to collect different aspects of a query.

UR - http://www.scopus.com/inward/record.url?scp=85009236662&partnerID=8YFLogxK

M3 - Conference article

AN - SCOPUS:85009236662

SN - 1613-0073

VL - 1749

JO - CEUR Workshop Proceedings

JF - CEUR Workshop Proceedings

Y2 - 5 December 2016 through 7 December 2016

ER -

Gamification for IR: The query aspects game

Abstract

Konference

Andre filer og links

Fingeraftryk

Citationsformater