SogouQ: The First Large-Scale Test Collection with Click Streams Used in a Shared-Task Evaluation

Ruihua Song; Min Zhang; Cheng Luo; Tetsuya Sakai; Yiqun Liu; Zhicheng Dou

doi:10.1007/978-981-15-5554-1_10

SogouQ: The First Large-Scale Test Collection with Click Streams Used in a Shared-Task Evaluation

Ruihua Song^*, Min Zhang, Cheng Luo, Tetsuya Sakai, Yiqun Liu, Zhicheng Dou

^*Corresponding author for this work

School of Fundamental Science and Engineering

Research output: Chapter in Book/Report/Conference proceeding › Chapter

Abstract

Search logs are very precious for information retrieval studies. In this chapter, we will introduce a real Chinese query log dataset, SogouQ, which was released by SogouQ corporation in 2010 for the NTCIR-9 Intent task. SogouQ contains more than 30 million clicks collected in 2008. It is the first large-scale query logs used in a shared-task evaluation (i.e., the NTCIR tasks). SogouQ has been adopted in a number of follow-up evaluation tasks, NTCIR-10 Intent-2, NTCIR-11 IMine, NTCIR-12 IMine-2, as well as in several Chinese domestic tasks. Moreover, SogouQ has a broader impact on other research areas, such as natural language processing and social science. It has been acquired by more than 200 institutions.

Original language	English
Title of host publication	Information Retrieval Series
Publisher	Springer Nature
Pages	143-150
Number of pages	8
DOIs	https://doi.org/10.1007/978-981-15-5554-1_10
Publication status	Published - 2021

Publication series

Name	Information Retrieval Series
Volume	43
ISSN (Print)	1871-7500

ASJC Scopus subject areas

Information Systems
Library and Information Sciences

Access to Document

10.1007/978-981-15-5554-1_10

Cite this

@inbook{d97c3d8c966044958921bd73db1c88b8,

title = "SogouQ: The First Large-Scale Test Collection with Click Streams Used in a Shared-Task Evaluation",

abstract = "Search logs are very precious for information retrieval studies. In this chapter, we will introduce a real Chinese query log dataset, SogouQ, which was released by SogouQ corporation in 2010 for the NTCIR-9 Intent task. SogouQ contains more than 30 million clicks collected in 2008. It is the first large-scale query logs used in a shared-task evaluation (i.e., the NTCIR tasks). SogouQ has been adopted in a number of follow-up evaluation tasks, NTCIR-10 Intent-2, NTCIR-11 IMine, NTCIR-12 IMine-2, as well as in several Chinese domestic tasks. Moreover, SogouQ has a broader impact on other research areas, such as natural language processing and social science. It has been acquired by more than 200 institutions.",

author = "Ruihua Song and Min Zhang and Cheng Luo and Tetsuya Sakai and Yiqun Liu and Zhicheng Dou",

note = "Publisher Copyright: {\textcopyright} 2021, The Author(s).",

year = "2021",

doi = "10.1007/978-981-15-5554-1_10",

language = "English",

series = "Information Retrieval Series",

publisher = "Springer Nature",

pages = "143--150",

booktitle = "Information Retrieval Series",

address = "United States",

}

TY - CHAP

T1 - SogouQ

T2 - The First Large-Scale Test Collection with Click Streams Used in a Shared-Task Evaluation

AU - Song, Ruihua

AU - Zhang, Min

AU - Luo, Cheng

AU - Sakai, Tetsuya

AU - Liu, Yiqun

AU - Dou, Zhicheng

PY - 2021

Y1 - 2021

N2 - Search logs are very precious for information retrieval studies. In this chapter, we will introduce a real Chinese query log dataset, SogouQ, which was released by SogouQ corporation in 2010 for the NTCIR-9 Intent task. SogouQ contains more than 30 million clicks collected in 2008. It is the first large-scale query logs used in a shared-task evaluation (i.e., the NTCIR tasks). SogouQ has been adopted in a number of follow-up evaluation tasks, NTCIR-10 Intent-2, NTCIR-11 IMine, NTCIR-12 IMine-2, as well as in several Chinese domestic tasks. Moreover, SogouQ has a broader impact on other research areas, such as natural language processing and social science. It has been acquired by more than 200 institutions.

AB - Search logs are very precious for information retrieval studies. In this chapter, we will introduce a real Chinese query log dataset, SogouQ, which was released by SogouQ corporation in 2010 for the NTCIR-9 Intent task. SogouQ contains more than 30 million clicks collected in 2008. It is the first large-scale query logs used in a shared-task evaluation (i.e., the NTCIR tasks). SogouQ has been adopted in a number of follow-up evaluation tasks, NTCIR-10 Intent-2, NTCIR-11 IMine, NTCIR-12 IMine-2, as well as in several Chinese domestic tasks. Moreover, SogouQ has a broader impact on other research areas, such as natural language processing and social science. It has been acquired by more than 200 institutions.

UR - http://www.scopus.com/inward/record.url?scp=85106062209&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85106062209&partnerID=8YFLogxK

U2 - 10.1007/978-981-15-5554-1_10

DO - 10.1007/978-981-15-5554-1_10

M3 - Chapter

AN - SCOPUS:85106062209

T3 - Information Retrieval Series

SP - 143

EP - 150

BT - Information Retrieval Series

PB - Springer Nature

ER -

SogouQ: The First Large-Scale Test Collection with Click Streams Used in a Shared-Task Evaluation

Abstract

Publication series

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this