Show Something: Intelligent Shopping Assistant Supporting Quick Scene Understanding and Immersive Preview

Hao Dou*, Zhinan Li, Minghao Cai, Kelvin Cheng, Soh Masuko, Jiro Tanaka

*この研究の対応する著者

研究成果: Conference contribution

1 被引用数 (Scopus)

抄録

In this paper, we introduce an intelligent shopping assistant system supported by quick scene understanding and augmented-reality 3D preview. By understanding the scene that users are looking at, and using the detected scene information, our system recommends related products that are not in the current scene and which could potentially interest users. With the help of existing speech recognition techniques, our system extracts users’ voice command and keywords, and provides responses in real-time, which allows users to search and filter specific products just by using voice. After finding the potential target products, our system provides users with an augmented-reality preview experience. It automatically brings products to the suitable space in front of the users by using life-size three-dimensional virtual products and spatial understanding. Users can also use two-hand gestural manipulation to operate the virtual products. Through our system, users can obtain products that are strongly related to the current environment, and intuitively preview the products in the current scene by automatic placement and two-hand manipulation to make shopping decisions.

本文言語English
ホスト出版物のタイトルHuman Interface and the Management of Information. Information in Intelligent Systems - Thematic Area, HIMI 2019, Held as Part of the 21st HCI International Conference, HCII 2019, Proceedings
編集者Sakae Yamamoto, Hirohiko Mori
出版社Springer Verlag
ページ205-218
ページ数14
ISBN(印刷版)9783030226480
DOI
出版ステータスPublished - 2019
イベントThematic Area on Human Interface and the Management of Information, HIMI 2019, held as part of the 21st International Conference on Human-Computer Interaction, HCI International 2019 - Orlando, United States
継続期間: 2019 7月 262019 7月 31

出版物シリーズ

名前Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
11570 LNCS
ISSN(印刷版)0302-9743
ISSN(電子版)1611-3349

Conference

ConferenceThematic Area on Human Interface and the Management of Information, HIMI 2019, held as part of the 21st International Conference on Human-Computer Interaction, HCI International 2019
国/地域United States
CityOrlando
Period19/7/2619/7/31

ASJC Scopus subject areas

  • 理論的コンピュータサイエンス
  • コンピュータ サイエンス(全般)

フィンガープリント

「Show Something: Intelligent Shopping Assistant Supporting Quick Scene Understanding and Immersive Preview」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。

引用スタイル