Centre@clef2019: Overview of the replicability and reproducibility tasks

Nicola Ferro; Norbert Fuhr; Maria Maistro; Tetsuya Sakai; Ian Soboroff

Centre@clef2019: Overview of the replicability and reproducibility tasks

Nicola Ferro, Norbert Fuhr, Maria Maistro, Tetsuya Sakai, Ian Soboroff

School of Fundamental Science and Engineering

Research output: Contribution to journal › Conference article › peer-review

Abstract

Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our second attempt to propose a lab on reproducibility named CENTRE, held during CLEF 2019. The aim of CENTRE is to run both a replicability and reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the second edition of CENTRE@CLEF 2019.

Original language	English
Journal	CEUR Workshop Proceedings
Volume	2380
Publication status	Published - 2019 Jan 1
Event	20th Working Notes of CLEF Conference and Labs of the Evaluation Forum, CLEF 2019 - Lugano, Switzerland Duration: 2019 Sept 9 → 2019 Sept 12

ASJC Scopus subject areas

Computer Science(all)

Cite this

@article{db00b73b733549eaaa84925b5429750a,

title = "Centre@clef2019: Overview of the replicability and reproducibility tasks",

abstract = "Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our second attempt to propose a lab on reproducibility named CENTRE, held during CLEF 2019. The aim of CENTRE is to run both a replicability and reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the second edition of CENTRE@CLEF 2019.",

author = "Nicola Ferro and Norbert Fuhr and Maria Maistro and Tetsuya Sakai and Ian Soboroff",

year = "2019",

month = jan,

day = "1",

language = "English",

volume = "2380",

journal = "CEUR Workshop Proceedings",

issn = "1613-0073",

publisher = "CEUR-WS",

note = "20th Working Notes of CLEF Conference and Labs of the Evaluation Forum, CLEF 2019 ; Conference date: 09-09-2019 Through 12-09-2019",

}

TY - JOUR

T1 - Centre@clef2019

T2 - 20th Working Notes of CLEF Conference and Labs of the Evaluation Forum, CLEF 2019

AU - Ferro, Nicola

AU - Fuhr, Norbert

AU - Maistro, Maria

AU - Sakai, Tetsuya

AU - Soboroff, Ian

PY - 2019/1/1

Y1 - 2019/1/1

N2 - Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our second attempt to propose a lab on reproducibility named CENTRE, held during CLEF 2019. The aim of CENTRE is to run both a replicability and reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the second edition of CENTRE@CLEF 2019.

AB - Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our second attempt to propose a lab on reproducibility named CENTRE, held during CLEF 2019. The aim of CENTRE is to run both a replicability and reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the second edition of CENTRE@CLEF 2019.

UR - http://www.scopus.com/inward/record.url?scp=85070529496&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85070529496&partnerID=8YFLogxK

M3 - Conference article

AN - SCOPUS:85070529496

SN - 1613-0073

VL - 2380

JO - CEUR Workshop Proceedings

JF - CEUR Workshop Proceedings

Y2 - 9 September 2019 through 12 September 2019

ER -

Centre@clef2019: Overview of the replicability and reproducibility tasks

Abstract

ASJC Scopus subject areas

Other files and links

Cite this