Ad-hoc Video Search Improved by the Word Sense Filtering of Query Terms

Koji Hirakawa; Kotaro Kikuchi; Kazuya Ueki; Tetsunori Kobayashi; Yoshihiko Hayashi

doi:10.1007/978-3-030-03520-4_15

Ad-hoc Video Search Improved by the Word Sense Filtering of Query Terms

Koji Hirakawa, Kotaro Kikuchi, Kazuya Ueki, Tetsunori Kobayashi, Yoshihiko Hayashi^*

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

The performances of an ad-hoc video search (AVS) task can only be improved when the video processing for analyzing video contents and the linguistic processing for interpreting natural language queries are nicely combined. Among the several issues associated with this challenging task, this paper particularly focuses on the sense disambiguation/filtering (WSD/WSF) of the terms contained in a search query. We propose WSD/WSF methods which employ distributed sense representations, and discuss their efficacy in improving the performance of an AVS system which makes full use of a large bank of visual concept classifiers. The application of a WSD/WSF method is crucial, as each visual concept classifier is linked with the lexical concept denoted by a word sense. The results are generally promising, outperforming not only a baseline query processing method that only considers the polysemy of a query term but also a strong WSD baseline method.

Original language	English
Title of host publication	Information Retrieval Technology - 14th Asia Information Retrieval Societies Conference, AIRS 2018, Proceedings
Editors	Lun-Wei Ku, Jui-Feng Yeh, Liang-Chih Yu, Yuen-Hsien Tseng, Zhi-Hong Chen, Tetsuya Sakai, Jing Jiang, Lung-Hao Lee, Dae Hoon Park
Publisher	Springer Verlag
Pages	157-163
Number of pages	7
ISBN (Print)	9783030035198
DOIs	https://doi.org/10.1007/978-3-030-03520-4_15
Publication status	Published - 2018
Event	14th Asia Information Retrieval Societies conference, AIRS 2018 - Taipei, Taiwan, Province of China Duration: 2018 Nov 28 → 2018 Nov 30

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	11292 LNCS
ISSN (Print)	0302-9743
ISSN (Electronic)	1611-3349

Other

Other	14th Asia Information Retrieval Societies conference, AIRS 2018
Country/Territory	Taiwan, Province of China
City	Taipei
Period	18/11/28 → 18/11/30

Keywords

Ad-hoc video search
Query processing
TRECVID AVS
Visual concepts
Word sense disambiguation

ASJC Scopus subject areas

Theoretical Computer Science
Computer Science(all)

Access to Document

10.1007/978-3-030-03520-4_15

Cite this

Hirakawa, K., Kikuchi, K., Ueki, K., Kobayashi, T., & Hayashi, Y. (2018). Ad-hoc Video Search Improved by the Word Sense Filtering of Query Terms. In L-W. Ku, J-F. Yeh, L-C. Yu, Y-H. Tseng, Z-H. Chen, T. Sakai, J. Jiang, L-H. Lee, & D. H. Park (Eds.), Information Retrieval Technology - 14th Asia Information Retrieval Societies Conference, AIRS 2018, Proceedings (pp. 157-163). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11292 LNCS). Springer Verlag. https://doi.org/10.1007/978-3-030-03520-4_15

Ad-hoc Video Search Improved by the Word Sense Filtering of Query Terms. / Hirakawa, Koji; Kikuchi, Kotaro; Ueki, Kazuya et al.
Information Retrieval Technology - 14th Asia Information Retrieval Societies Conference, AIRS 2018, Proceedings. ed. / Lun-Wei Ku; Jui-Feng Yeh; Liang-Chih Yu; Yuen-Hsien Tseng; Zhi-Hong Chen; Tetsuya Sakai; Jing Jiang; Lung-Hao Lee; Dae Hoon Park. Springer Verlag, 2018. p. 157-163 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 11292 LNCS).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Hirakawa, K, Kikuchi, K, Ueki, K, Kobayashi, T & Hayashi, Y 2018, Ad-hoc Video Search Improved by the Word Sense Filtering of Query Terms. in L-W Ku, J-F Yeh, L-C Yu, Y-H Tseng, Z-H Chen, T Sakai, J Jiang, L-H Lee & DH Park (eds), Information Retrieval Technology - 14th Asia Information Retrieval Societies Conference, AIRS 2018, Proceedings. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 11292 LNCS, Springer Verlag, pp. 157-163, 14th Asia Information Retrieval Societies conference, AIRS 2018, Taipei, Taiwan, Province of China, 18/11/28. https://doi.org/10.1007/978-3-030-03520-4_15

Hirakawa K, Kikuchi K, Ueki K, Kobayashi T, Hayashi Y. Ad-hoc Video Search Improved by the Word Sense Filtering of Query Terms. In Ku L-W, Yeh J-F, Yu L-C, Tseng Y-H, Chen Z-H, Sakai T, Jiang J, Lee L-H, Park DH, editors, Information Retrieval Technology - 14th Asia Information Retrieval Societies Conference, AIRS 2018, Proceedings. Springer Verlag. 2018. p. 157-163. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-030-03520-4_15

Hirakawa, Koji ; Kikuchi, Kotaro ; Ueki, Kazuya et al. / Ad-hoc Video Search Improved by the Word Sense Filtering of Query Terms. Information Retrieval Technology - 14th Asia Information Retrieval Societies Conference, AIRS 2018, Proceedings. editor / Lun-Wei Ku ; Jui-Feng Yeh ; Liang-Chih Yu ; Yuen-Hsien Tseng ; Zhi-Hong Chen ; Tetsuya Sakai ; Jing Jiang ; Lung-Hao Lee ; Dae Hoon Park. Springer Verlag, 2018. pp. 157-163 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{d506c7dc3aee471bb0e241c242fcd378,

title = "Ad-hoc Video Search Improved by the Word Sense Filtering of Query Terms",

abstract = "The performances of an ad-hoc video search (AVS) task can only be improved when the video processing for analyzing video contents and the linguistic processing for interpreting natural language queries are nicely combined. Among the several issues associated with this challenging task, this paper particularly focuses on the sense disambiguation/filtering (WSD/WSF) of the terms contained in a search query. We propose WSD/WSF methods which employ distributed sense representations, and discuss their efficacy in improving the performance of an AVS system which makes full use of a large bank of visual concept classifiers. The application of a WSD/WSF method is crucial, as each visual concept classifier is linked with the lexical concept denoted by a word sense. The results are generally promising, outperforming not only a baseline query processing method that only considers the polysemy of a query term but also a strong WSD baseline method.",

keywords = "Ad-hoc video search, Query processing, TRECVID AVS, Visual concepts, Word sense disambiguation",

author = "Koji Hirakawa and Kotaro Kikuchi and Kazuya Ueki and Tetsunori Kobayashi and Yoshihiko Hayashi",

note = "Funding Information: Acknowledgment. The present work was partially supported by JSPS KAKENHI Grants numbers 15K00249, 17H01831, and 18K11362, and the Kayamori Foundation of Informational Science Advancement. Publisher Copyright: {\textcopyright} 2018, Springer Nature Switzerland AG.; 14th Asia Information Retrieval Societies conference, AIRS 2018 ; Conference date: 28-11-2018 Through 30-11-2018",

year = "2018",

doi = "10.1007/978-3-030-03520-4_15",

language = "English",

isbn = "9783030035198",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

publisher = "Springer Verlag",

pages = "157--163",

editor = "Lun-Wei Ku and Jui-Feng Yeh and Liang-Chih Yu and Yuen-Hsien Tseng and Zhi-Hong Chen and Tetsuya Sakai and Jing Jiang and Lung-Hao Lee and Park, {Dae Hoon}",

booktitle = "Information Retrieval Technology - 14th Asia Information Retrieval Societies Conference, AIRS 2018, Proceedings",

}

TY - GEN

T1 - Ad-hoc Video Search Improved by the Word Sense Filtering of Query Terms

AU - Hirakawa, Koji

AU - Kikuchi, Kotaro

AU - Ueki, Kazuya

AU - Kobayashi, Tetsunori

AU - Hayashi, Yoshihiko

N1 - Funding Information: Acknowledgment. The present work was partially supported by JSPS KAKENHI Grants numbers 15K00249, 17H01831, and 18K11362, and the Kayamori Foundation of Informational Science Advancement. Publisher Copyright: © 2018, Springer Nature Switzerland AG.

PY - 2018

Y1 - 2018

N2 - The performances of an ad-hoc video search (AVS) task can only be improved when the video processing for analyzing video contents and the linguistic processing for interpreting natural language queries are nicely combined. Among the several issues associated with this challenging task, this paper particularly focuses on the sense disambiguation/filtering (WSD/WSF) of the terms contained in a search query. We propose WSD/WSF methods which employ distributed sense representations, and discuss their efficacy in improving the performance of an AVS system which makes full use of a large bank of visual concept classifiers. The application of a WSD/WSF method is crucial, as each visual concept classifier is linked with the lexical concept denoted by a word sense. The results are generally promising, outperforming not only a baseline query processing method that only considers the polysemy of a query term but also a strong WSD baseline method.

AB - The performances of an ad-hoc video search (AVS) task can only be improved when the video processing for analyzing video contents and the linguistic processing for interpreting natural language queries are nicely combined. Among the several issues associated with this challenging task, this paper particularly focuses on the sense disambiguation/filtering (WSD/WSF) of the terms contained in a search query. We propose WSD/WSF methods which employ distributed sense representations, and discuss their efficacy in improving the performance of an AVS system which makes full use of a large bank of visual concept classifiers. The application of a WSD/WSF method is crucial, as each visual concept classifier is linked with the lexical concept denoted by a word sense. The results are generally promising, outperforming not only a baseline query processing method that only considers the polysemy of a query term but also a strong WSD baseline method.

KW - Ad-hoc video search

KW - Query processing

KW - TRECVID AVS

KW - Visual concepts

KW - Word sense disambiguation

UR - http://www.scopus.com/inward/record.url?scp=85057250392&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85057250392&partnerID=8YFLogxK

U2 - 10.1007/978-3-030-03520-4_15

DO - 10.1007/978-3-030-03520-4_15

M3 - Conference contribution

AN - SCOPUS:85057250392

SN - 9783030035198

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 157

EP - 163

BT - Information Retrieval Technology - 14th Asia Information Retrieval Societies Conference, AIRS 2018, Proceedings

A2 - Ku, Lun-Wei

A2 - Yeh, Jui-Feng

A2 - Yu, Liang-Chih

A2 - Tseng, Yuen-Hsien

A2 - Chen, Zhi-Hong

A2 - Sakai, Tetsuya

A2 - Jiang, Jing

A2 - Lee, Lung-Hao

A2 - Park, Dae Hoon

PB - Springer Verlag

T2 - 14th Asia Information Retrieval Societies conference, AIRS 2018

Y2 - 28 November 2018 through 30 November 2018

ER -

Ad-hoc Video Search Improved by the Word Sense Filtering of Query Terms

Abstract

Publication series

Other

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this