Gamification for machine learning: The classification game

Giorgio Maria Di Nunzio; Maria Maistro; Daniel Zilio

Gamification for machine learning: The classification game

Giorgio Maria Di Nunzio, Maria Maistro, Daniel Zilio

9 Citations (Scopus)

Abstract

The creation of a labelled dataset for machine learning purposes is a costly process. In recent works, it has been shown that a mix of crowdsourcing and active learning approaches can be used to annotate objects at an affordable cost. In this paper, we study the gamification of machine learning techniques; in particular, the problem of classification of objects. In this first pilot study, we designed a simple game, based on a visual interpretation of probabilistic classifiers, that consists in separating two sets of coloured points on a two-dimensional plane by means of a straight line. We present the current results of this first experiment that we used to collect the requirements for the next version of the game and to analyze i) what is the 'price' to build a reasonably accurate classifier with a small amount of labelled objects, ii) and compare the accuracy of the player to the state-of-the-art classification algorithms.

Original language	English
Journal	CEUR Workshop Proceedings
Volume	1642
Pages (from-to)	45-52
Number of pages	8
ISSN	1613-0073
Publication status	Published - 1 Jan 2016
Externally published	Yes
Event	3rd International Workshop on Gamification for Information Retrieval, GamifIR 2016 - Pisa, Italy Duration: 21 Jul 2016 → …

Conference

Conference	3rd International Workshop on Gamification for Information Retrieval, GamifIR 2016
Country/Territory	Italy
City	Pisa
Period	21/07/2016 → …

Cite this

@inproceedings{c6331472164a41909908b5a1ccb36e98,

title = "Gamification for machine learning: The classification game",

abstract = "The creation of a labelled dataset for machine learning purposes is a costly process. In recent works, it has been shown that a mix of crowdsourcing and active learning approaches can be used to annotate objects at an affordable cost. In this paper, we study the gamification of machine learning techniques; in particular, the problem of classification of objects. In this first pilot study, we designed a simple game, based on a visual interpretation of probabilistic classifiers, that consists in separating two sets of coloured points on a two-dimensional plane by means of a straight line. We present the current results of this first experiment that we used to collect the requirements for the next version of the game and to analyze i) what is the 'price' to build a reasonably accurate classifier with a small amount of labelled objects, ii) and compare the accuracy of the player to the state-of-the-art classification algorithms.",

author = "Nunzio, {Giorgio Maria Di} and Maria Maistro and Daniel Zilio",

year = "2016",

month = jan,

day = "1",

language = "English",

volume = "1642",

pages = "45--52",

journal = "CEUR Workshop Proceedings",

issn = "1613-0073",

publisher = "ceur workshop proceedings",

note = "3rd International Workshop on Gamification for Information Retrieval, GamifIR 2016 ; Conference date: 21-07-2016",

}

TY - GEN

T1 - Gamification for machine learning

T2 - 3rd International Workshop on Gamification for Information Retrieval, GamifIR 2016

AU - Nunzio, Giorgio Maria Di

AU - Maistro, Maria

AU - Zilio, Daniel

PY - 2016/1/1

Y1 - 2016/1/1

N2 - The creation of a labelled dataset for machine learning purposes is a costly process. In recent works, it has been shown that a mix of crowdsourcing and active learning approaches can be used to annotate objects at an affordable cost. In this paper, we study the gamification of machine learning techniques; in particular, the problem of classification of objects. In this first pilot study, we designed a simple game, based on a visual interpretation of probabilistic classifiers, that consists in separating two sets of coloured points on a two-dimensional plane by means of a straight line. We present the current results of this first experiment that we used to collect the requirements for the next version of the game and to analyze i) what is the 'price' to build a reasonably accurate classifier with a small amount of labelled objects, ii) and compare the accuracy of the player to the state-of-the-art classification algorithms.

AB - The creation of a labelled dataset for machine learning purposes is a costly process. In recent works, it has been shown that a mix of crowdsourcing and active learning approaches can be used to annotate objects at an affordable cost. In this paper, we study the gamification of machine learning techniques; in particular, the problem of classification of objects. In this first pilot study, we designed a simple game, based on a visual interpretation of probabilistic classifiers, that consists in separating two sets of coloured points on a two-dimensional plane by means of a straight line. We present the current results of this first experiment that we used to collect the requirements for the next version of the game and to analyze i) what is the 'price' to build a reasonably accurate classifier with a small amount of labelled objects, ii) and compare the accuracy of the player to the state-of-the-art classification algorithms.

UR - http://www.scopus.com/inward/record.url?scp=84985919823&partnerID=8YFLogxK

M3 - Conference article

AN - SCOPUS:84985919823

SN - 1613-0073

VL - 1642

SP - 45

EP - 52

JO - CEUR Workshop Proceedings

JF - CEUR Workshop Proceedings

Y2 - 21 July 2016

ER -

Gamification for machine learning: The classification game

Abstract

Conference

Other files and links

Fingerprint

Cite this