CENTRE@CLEF2018: Overview of the replicability task

TY - GEN

T1 - CENTRE@CLEF2018

T2 - 19th Working Notes of CLEF Conference and Labs of the Evaluation Forum, CLEF 2018

AU - Ferro, Nicola

AU - Maistro, Maria

AU - Sakai, Tetsuya

AU - Soboroff, Ian

PY - 2018/1/1

Y1 - 2018/1/1

N2 - Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our first attempt to propose a lab on reproducibility named CENTRE and held during CLEF 2018. The aim of CENTRE is to run a reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the first edition of CENTRE@CLEF 2018, as well as some suggestions for future editions.

AB - Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our first attempt to propose a lab on reproducibility named CENTRE and held during CLEF 2018. The aim of CENTRE is to run a reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the first edition of CENTRE@CLEF 2018, as well as some suggestions for future editions.

UR - http://www.scopus.com/inward/record.url?scp=85051055402&partnerID=8YFLogxK

M3 - Conference article

AN - SCOPUS:85051055402

SN - 1613-0073

VL - 2125

JO - CEUR Workshop Proceedings

JF - CEUR Workshop Proceedings

Y2 - 10 September 2018 through 14 September 2018

ER -