A large-scale Web data collection as a natural language processing infrastructure

Keiji Shinzato; Daisuke Kawahara; Chikara Hashimoto; Sadao Kurohashi

A large-scale Web data collection as a natural language processing infrastructure

Keiji Shinzato, Daisuke Kawahara, Chikara Hashimoto, Sadao Kurohashi

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

In recent years, language resources acquired from the Web are released, and these data improve the performance of applications in several NLP tasks. Although the language resources based on the web page unit are useful in NLP tasks and applications such as knowledge acquisition, document retrieval and document summarization, such language resources are not released so far. In this paper, we propose a data format for results of web page processing, and a search engine infrastructure which makes it possible to share approximately 100 million Japanese web data. By obtaining the web data, NLP researchers are enabled to begin their own processing immediately without analyzing web pages by themselves.

Original language	English
Title of host publication	Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2008
Publisher	European Language Resources Association (ELRA)
Pages	2236-2241
Number of pages	6
ISBN (Electronic)	2951740840, 9782951740846
Publication status	Published - 2008
Externally published	Yes
Event	6th International Conference on Language Resources and Evaluation, LREC 2008 - Marrakech, Morocco Duration: 2008 May 28 → 2008 May 30

Publication series

Name	Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2008

Other

Other	6th International Conference on Language Resources and Evaluation, LREC 2008
Country/Territory	Morocco
City	Marrakech
Period	08/5/28 → 08/5/30

ASJC Scopus subject areas

Library and Information Sciences
Linguistics and Language
Language and Linguistics
Education

Cite this

Shinzato, K., Kawahara, D., Hashimoto, C., & Kurohashi, S. (2008). A large-scale Web data collection as a natural language processing infrastructure. In Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2008 (pp. 2236-2241). (Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2008). European Language Resources Association (ELRA).

A large-scale Web data collection as a natural language processing infrastructure. / Shinzato, Keiji; Kawahara, Daisuke; Hashimoto, Chikara et al.
Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2008. European Language Resources Association (ELRA), 2008. p. 2236-2241 (Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2008).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Shinzato, K, Kawahara, D, Hashimoto, C & Kurohashi, S 2008, A large-scale Web data collection as a natural language processing infrastructure. in Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2008. Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2008, European Language Resources Association (ELRA), pp. 2236-2241, 6th International Conference on Language Resources and Evaluation, LREC 2008, Marrakech, Morocco, 08/5/28.

Shinzato K, Kawahara D, Hashimoto C, Kurohashi S. A large-scale Web data collection as a natural language processing infrastructure. In Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2008. European Language Resources Association (ELRA). 2008. p. 2236-2241. (Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2008).

Shinzato, Keiji ; Kawahara, Daisuke ; Hashimoto, Chikara et al. / A large-scale Web data collection as a natural language processing infrastructure. Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2008. European Language Resources Association (ELRA), 2008. pp. 2236-2241 (Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2008).

@inproceedings{55976668910f4768b6dfb1284022125b,

title = "A large-scale Web data collection as a natural language processing infrastructure",

abstract = "In recent years, language resources acquired from the Web are released, and these data improve the performance of applications in several NLP tasks. Although the language resources based on the web page unit are useful in NLP tasks and applications such as knowledge acquisition, document retrieval and document summarization, such language resources are not released so far. In this paper, we propose a data format for results of web page processing, and a search engine infrastructure which makes it possible to share approximately 100 million Japanese web data. By obtaining the web data, NLP researchers are enabled to begin their own processing immediately without analyzing web pages by themselves.",

author = "Keiji Shinzato and Daisuke Kawahara and Chikara Hashimoto and Sadao Kurohashi",

year = "2008",

language = "English",

series = "Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2008",

publisher = "European Language Resources Association (ELRA)",

pages = "2236--2241",

booktitle = "Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2008",

note = "6th International Conference on Language Resources and Evaluation, LREC 2008 ; Conference date: 28-05-2008 Through 30-05-2008",

}

TY - GEN

T1 - A large-scale Web data collection as a natural language processing infrastructure

AU - Shinzato, Keiji

AU - Kawahara, Daisuke

AU - Hashimoto, Chikara

AU - Kurohashi, Sadao

PY - 2008

Y1 - 2008

N2 - In recent years, language resources acquired from the Web are released, and these data improve the performance of applications in several NLP tasks. Although the language resources based on the web page unit are useful in NLP tasks and applications such as knowledge acquisition, document retrieval and document summarization, such language resources are not released so far. In this paper, we propose a data format for results of web page processing, and a search engine infrastructure which makes it possible to share approximately 100 million Japanese web data. By obtaining the web data, NLP researchers are enabled to begin their own processing immediately without analyzing web pages by themselves.

AB - In recent years, language resources acquired from the Web are released, and these data improve the performance of applications in several NLP tasks. Although the language resources based on the web page unit are useful in NLP tasks and applications such as knowledge acquisition, document retrieval and document summarization, such language resources are not released so far. In this paper, we propose a data format for results of web page processing, and a search engine infrastructure which makes it possible to share approximately 100 million Japanese web data. By obtaining the web data, NLP researchers are enabled to begin their own processing immediately without analyzing web pages by themselves.

UR - http://www.scopus.com/inward/record.url?scp=80053421799&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=80053421799&partnerID=8YFLogxK

M3 - Conference contribution

AN - SCOPUS:80053421799

T3 - Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2008

SP - 2236

EP - 2241

BT - Proceedings of the 6th International Conference on Language Resources and Evaluation, LREC 2008

PB - European Language Resources Association (ELRA)

T2 - 6th International Conference on Language Resources and Evaluation, LREC 2008

Y2 - 28 May 2008 through 30 May 2008

ER -

A large-scale Web data collection as a natural language processing infrastructure

Abstract

Publication series

Other

ASJC Scopus subject areas

Other files and links

Fingerprint

Cite this