Gaze pattern analysis in multi-display systems for teleoperated disaster response robots

Ryuya Sato; Mitsuhiro Kamezaki; Shigeki Sugano; Hiroyasu Iwata

doi:10.1109/SMC.2016.7844780

Gaze pattern analysis in multi-display systems for teleoperated disaster response robots

Ryuya Sato, Mitsuhiro Kamezaki, Shigeki Sugano, Hiroyasu Iwata

Waseda Research Institute for Science and Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

7 Citations (Scopus)

Abstract

In unmanned construction, work efficiency is lower than that in manned construction due to lack of visual information. Thus, we previously developed an autonomous camera control system to provide various visual information suited to work states through multiple displays. However, that system increased the cognitive load on operators, and required them to have much experience to choose appropriate views for various situations. Next, we should investigate the degree of effectiveness for each view in a certain state. Thus, in this study, we analyzed gaze patterns to clarify which are the displays that operators often watch in work states, i.e., moving, grasping, transport, and releasing. We then derived which gaze patterns have higher work performance, including time efficiency and safeness. We clustered gaze patterns using Ward's method, which is a criterion applied in hierarchical clustering. To evaluate the objective of this study, we conducted experiments involving debris transport tasks, using a virtual reality simulator. The results indicated that gaze patterns differed in operators and we found that better time efficiency related to specific gaze patterns for each work state.

Original language	English
Title of host publication	2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016 - Conference Proceedings
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	3534-3539
Number of pages	6
ISBN (Electronic)	9781509018970
DOIs	https://doi.org/10.1109/SMC.2016.7844780
Publication status	Published - 2017 Feb 6
Event	2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016 - Budapest, Hungary Duration: 2016 Oct 9 → 2016 Oct 12

Other

Other	2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016
Country/Territory	Hungary
City	Budapest
Period	16/10/9 → 16/10/12

ASJC Scopus subject areas

Computer Vision and Pattern Recognition
Artificial Intelligence
Control and Optimization
Human-Computer Interaction

Access to Document

10.1109/SMC.2016.7844780

Cite this

Sato, R., Kamezaki, M., Sugano, S., & Iwata, H. (2017). Gaze pattern analysis in multi-display systems for teleoperated disaster response robots. In 2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016 - Conference Proceedings (pp. 3534-3539). Article 7844780 Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/SMC.2016.7844780

Gaze pattern analysis in multi-display systems for teleoperated disaster response robots. / Sato, Ryuya; Kamezaki, Mitsuhiro; Sugano, Shigeki et al.
2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016 - Conference Proceedings. Institute of Electrical and Electronics Engineers Inc., 2017. p. 3534-3539 7844780.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Sato, R, Kamezaki, M, Sugano, S & Iwata, H 2017, Gaze pattern analysis in multi-display systems for teleoperated disaster response robots. in 2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016 - Conference Proceedings., 7844780, Institute of Electrical and Electronics Engineers Inc., pp. 3534-3539, 2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016, Budapest, Hungary, 16/10/9. https://doi.org/10.1109/SMC.2016.7844780

@inproceedings{3980b9916639480594fc474618e36737,

title = "Gaze pattern analysis in multi-display systems for teleoperated disaster response robots",

abstract = "In unmanned construction, work efficiency is lower than that in manned construction due to lack of visual information. Thus, we previously developed an autonomous camera control system to provide various visual information suited to work states through multiple displays. However, that system increased the cognitive load on operators, and required them to have much experience to choose appropriate views for various situations. Next, we should investigate the degree of effectiveness for each view in a certain state. Thus, in this study, we analyzed gaze patterns to clarify which are the displays that operators often watch in work states, i.e., moving, grasping, transport, and releasing. We then derived which gaze patterns have higher work performance, including time efficiency and safeness. We clustered gaze patterns using Ward's method, which is a criterion applied in hierarchical clustering. To evaluate the objective of this study, we conducted experiments involving debris transport tasks, using a virtual reality simulator. The results indicated that gaze patterns differed in operators and we found that better time efficiency related to specific gaze patterns for each work state.",

author = "Ryuya Sato and Mitsuhiro Kamezaki and Shigeki Sugano and Hiroyasu Iwata",

year = "2017",

month = feb,

day = "6",

doi = "10.1109/SMC.2016.7844780",

language = "English",

pages = "3534--3539",

booktitle = "2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016 - Conference Proceedings",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

address = "United States",

note = "2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016 ; Conference date: 09-10-2016 Through 12-10-2016",

}

TY - GEN

T1 - Gaze pattern analysis in multi-display systems for teleoperated disaster response robots

AU - Sato, Ryuya

AU - Kamezaki, Mitsuhiro

AU - Sugano, Shigeki

AU - Iwata, Hiroyasu

PY - 2017/2/6

Y1 - 2017/2/6

N2 - In unmanned construction, work efficiency is lower than that in manned construction due to lack of visual information. Thus, we previously developed an autonomous camera control system to provide various visual information suited to work states through multiple displays. However, that system increased the cognitive load on operators, and required them to have much experience to choose appropriate views for various situations. Next, we should investigate the degree of effectiveness for each view in a certain state. Thus, in this study, we analyzed gaze patterns to clarify which are the displays that operators often watch in work states, i.e., moving, grasping, transport, and releasing. We then derived which gaze patterns have higher work performance, including time efficiency and safeness. We clustered gaze patterns using Ward's method, which is a criterion applied in hierarchical clustering. To evaluate the objective of this study, we conducted experiments involving debris transport tasks, using a virtual reality simulator. The results indicated that gaze patterns differed in operators and we found that better time efficiency related to specific gaze patterns for each work state.

AB - In unmanned construction, work efficiency is lower than that in manned construction due to lack of visual information. Thus, we previously developed an autonomous camera control system to provide various visual information suited to work states through multiple displays. However, that system increased the cognitive load on operators, and required them to have much experience to choose appropriate views for various situations. Next, we should investigate the degree of effectiveness for each view in a certain state. Thus, in this study, we analyzed gaze patterns to clarify which are the displays that operators often watch in work states, i.e., moving, grasping, transport, and releasing. We then derived which gaze patterns have higher work performance, including time efficiency and safeness. We clustered gaze patterns using Ward's method, which is a criterion applied in hierarchical clustering. To evaluate the objective of this study, we conducted experiments involving debris transport tasks, using a virtual reality simulator. The results indicated that gaze patterns differed in operators and we found that better time efficiency related to specific gaze patterns for each work state.

UR - http://www.scopus.com/inward/record.url?scp=85015790393&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=85015790393&partnerID=8YFLogxK

U2 - 10.1109/SMC.2016.7844780

DO - 10.1109/SMC.2016.7844780

M3 - Conference contribution

AN - SCOPUS:85015790393

SP - 3534

EP - 3539

BT - 2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016 - Conference Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2016 IEEE International Conference on Systems, Man, and Cybernetics, SMC 2016

Y2 - 9 October 2016 through 12 October 2016

ER -

Gaze pattern analysis in multi-display systems for teleoperated disaster response robots

Abstract

Other

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this