CENTRE@CLEF2018: Overview of the replicability task

Nicola Ferro, Maria Maistro, Tetsuya Sakai, Ian Soboroff

    Research output: Contribution to journalConference articlepeer-review

    Abstract

    Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our first attempt to propose a lab on reproducibility named CENTRE and held during CLEF 2018. The aim of CENTRE is to run a reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the first edition of CENTRE@CLEF 2018, as well as some suggestions for future editions.

    Original languageEnglish
    JournalCEUR Workshop Proceedings
    Volume2125
    Publication statusPublished - 2018 Jan 1
    Event19th Working Notes of CLEF Conference and Labs of the Evaluation Forum, CLEF 2018 - Avignon, France
    Duration: 2018 Sept 102018 Sept 14

    ASJC Scopus subject areas

    • Computer Science(all)

    Cite this