CENTRE@CLEF2018: Overview of the replicability task

Nicola Ferro; Maria Maistro; Tetsuya Sakai; Ian Soboroff

CENTRE@CLEF2018: Overview of the replicability task

Nicola Ferro, Maria Maistro, Tetsuya Sakai, Ian Soboroff

Abstract

Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our first attempt to propose a lab on reproducibility named CENTRE and held during CLEF 2018. The aim of CENTRE is to run a reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the first edition of CENTRE@CLEF 2018, as well as some suggestions for future editions.

Originalsprog	Engelsk
Tidsskrift	CEUR Workshop Proceedings
Vol/bind	2125
ISSN	1613-0073
Status	Udgivet - 1 jan. 2018
Udgivet eksternt	Ja
Begivenhed	19th Working Notes of CLEF Conference and Labs of the Evaluation Forum, CLEF 2018 - Avignon, Frankrig Varighed: 10 sep. 2018 → 14 sep. 2018

Konference

Konference	19th Working Notes of CLEF Conference and Labs of the Evaluation Forum, CLEF 2018
Land/Område	Frankrig
By	Avignon
Periode	10/09/2018 → 14/09/2018

Andre filer og links

Link to publication in Scopus

Citationsformater

@inproceedings{b1342b6dd8f54b4ab90b2dff849291bc,

title = "CENTRE@CLEF2018: Overview of the replicability task",

abstract = "Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our first attempt to propose a lab on reproducibility named CENTRE and held during CLEF 2018. The aim of CENTRE is to run a reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the first edition of CENTRE@CLEF 2018, as well as some suggestions for future editions.",

author = "Nicola Ferro and Maria Maistro and Tetsuya Sakai and Ian Soboroff",

year = "2018",

month = jan,

day = "1",

language = "English",

volume = "2125",

journal = "CEUR Workshop Proceedings",

issn = "1613-0073",

publisher = "ceur workshop proceedings",

note = "19th Working Notes of CLEF Conference and Labs of the Evaluation Forum, CLEF 2018 ; Conference date: 10-09-2018 Through 14-09-2018",

}

TY - GEN

T1 - CENTRE@CLEF2018

T2 - 19th Working Notes of CLEF Conference and Labs of the Evaluation Forum, CLEF 2018

AU - Ferro, Nicola

AU - Maistro, Maria

AU - Sakai, Tetsuya

AU - Soboroff, Ian

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our first attempt to propose a lab on reproducibility named CENTRE and held during CLEF 2018. The aim of CENTRE is to run a reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the first edition of CENTRE@CLEF 2018, as well as some suggestions for future editions.

AB - Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our first attempt to propose a lab on reproducibility named CENTRE and held during CLEF 2018. The aim of CENTRE is to run a reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the first edition of CENTRE@CLEF 2018, as well as some suggestions for future editions.

UR - http://www.scopus.com/inward/record.url?scp=85051055402&partnerID=8YFLogxK

M3 - Conference article

AN - SCOPUS:85051055402

SN - 1613-0073

VL - 2125

JO - CEUR Workshop Proceedings

JF - CEUR Workshop Proceedings

Y2 - 10 September 2018 through 14 September 2018

ER -