CENTRE@CLEF2018: Overview of the replicability task

Nicola Ferro, Maria Maistro, Tetsuya Sakai, Ian Soboroff

    研究成果: Conference article査読


    Reproducibility has become increasingly important for many research areas, among those IR is not an exception and has started to be concerned with reproducibility and its impact on research results. This paper describes our first attempt to propose a lab on reproducibility named CENTRE and held during CLEF 2018. The aim of CENTRE is to run a reproducibility challenge across all the major IR evaluation campaigns and to provide the IR community with a venue where previous research results can be explored and discussed. This paper reports the participant results and preliminary considerations on the first edition of CENTRE@CLEF 2018, as well as some suggestions for future editions.

    ジャーナルCEUR Workshop Proceedings
    出版ステータスPublished - 2018 1月 1
    イベント19th Working Notes of CLEF Conference and Labs of the Evaluation Forum, CLEF 2018 - Avignon, France
    継続期間: 2018 9月 102018 9月 14

    ASJC Scopus subject areas

    • コンピュータ サイエンス(全般)