Gamification for IR: The query aspects game

Giorgio Maria Di Nunzio; Maria Maistro; Daniel Zilio

Gamification for IR: The query aspects game

Giorgio Maria Di Nunzio, Maria Maistro, Daniel Zilio

Abstract

The creation of a labelled dataset for Information Retrieval (IR) purposes is a costly process. For this reason, a mix of crowdsourcing and active learning approaches have been proposed in the literature in order to assess the relevance of documents of a collection given a particular query at an affordable cost. In this paper, we present the design of the gamification of this interactive process that draws inspiration from recent works in the area of gamification for IR. In particular, we focus on three main points: i) we want to create a set of relevance judgements with the least effort by human assessors, ii) we use interactive search interfaces that use game mechanics, iii) we use Natural Language Processing (NLP) to collect different aspects of a query.

Original language	English
Journal	CEUR Workshop Proceedings
Volume	1749
ISSN	1613-0073
Publication status	Published - 1 Jan 2016
Externally published	Yes
Event	3rd Italian Conference on Computational Linguistics, CLiC-it 2016 and 5th Evaluation Campaign of Natural Language Processing and Speech Tools for Italian, EVALITA 2016 - Napoli, Italy Duration: 5 Dec 2016 → 7 Dec 2016

Conference

Conference	3rd Italian Conference on Computational Linguistics, CLiC-it 2016 and 5th Evaluation Campaign of Natural Language Processing and Speech Tools for Italian, EVALITA 2016
Country/Territory	Italy
City	Napoli
Period	05/12/2016 → 07/12/2016

Cite this

@inproceedings{56beddc5c15349a08172e2f3f593414b,

title = "Gamification for IR: The query aspects game",

abstract = "The creation of a labelled dataset for Information Retrieval (IR) purposes is a costly process. For this reason, a mix of crowdsourcing and active learning approaches have been proposed in the literature in order to assess the relevance of documents of a collection given a particular query at an affordable cost. In this paper, we present the design of the gamification of this interactive process that draws inspiration from recent works in the area of gamification for IR. In particular, we focus on three main points: i) we want to create a set of relevance judgements with the least effort by human assessors, ii) we use interactive search interfaces that use game mechanics, iii) we use Natural Language Processing (NLP) to collect different aspects of a query.",

author = "{Di Nunzio}, {Giorgio Maria} and Maria Maistro and Daniel Zilio",

year = "2016",

month = jan,

day = "1",

language = "English",

volume = "1749",

journal = "CEUR Workshop Proceedings",

issn = "1613-0073",

publisher = "ceur workshop proceedings",

note = "3rd Italian Conference on Computational Linguistics, CLiC-it 2016 and 5th Evaluation Campaign of Natural Language Processing and Speech Tools for Italian, EVALITA 2016 ; Conference date: 05-12-2016 Through 07-12-2016",

}

TY - GEN

T1 - Gamification for IR

T2 - 3rd Italian Conference on Computational Linguistics, CLiC-it 2016 and 5th Evaluation Campaign of Natural Language Processing and Speech Tools for Italian, EVALITA 2016

AU - Di Nunzio, Giorgio Maria

AU - Maistro, Maria

AU - Zilio, Daniel

PY - 2016/1/1

Y1 - 2016/1/1

N2 - The creation of a labelled dataset for Information Retrieval (IR) purposes is a costly process. For this reason, a mix of crowdsourcing and active learning approaches have been proposed in the literature in order to assess the relevance of documents of a collection given a particular query at an affordable cost. In this paper, we present the design of the gamification of this interactive process that draws inspiration from recent works in the area of gamification for IR. In particular, we focus on three main points: i) we want to create a set of relevance judgements with the least effort by human assessors, ii) we use interactive search interfaces that use game mechanics, iii) we use Natural Language Processing (NLP) to collect different aspects of a query.

AB - The creation of a labelled dataset for Information Retrieval (IR) purposes is a costly process. For this reason, a mix of crowdsourcing and active learning approaches have been proposed in the literature in order to assess the relevance of documents of a collection given a particular query at an affordable cost. In this paper, we present the design of the gamification of this interactive process that draws inspiration from recent works in the area of gamification for IR. In particular, we focus on three main points: i) we want to create a set of relevance judgements with the least effort by human assessors, ii) we use interactive search interfaces that use game mechanics, iii) we use Natural Language Processing (NLP) to collect different aspects of a query.

UR - http://www.scopus.com/inward/record.url?scp=85009236662&partnerID=8YFLogxK

M3 - Conference article

AN - SCOPUS:85009236662

SN - 1613-0073

VL - 1749

JO - CEUR Workshop Proceedings

JF - CEUR Workshop Proceedings

Y2 - 5 December 2016 through 7 December 2016

ER -

Gamification for IR: The query aspects game

Abstract

Conference

Other files and links

Fingerprint

Cite this