Facial tracking-assisted hand pointing technique for wall-sized displays

Haokan Cheng*, Takahashi Shin, Jiro Tanaka

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contribution


In this paper we propose a novel pointing technique leveraging the user’s body motion to achieve smooth, efficient user experiences on wall-sized displays. Our proposal substantially consists of two parts: a graphical cursor controlled by the user’s hand motions, and mechanisms to assist the cursor manipulation by tracking the user’s face orientation. By interaction design associating the user’s face and hand motions to different aspects of the cursor’s movement, we aimed to bring swiftness to the interaction in large-display environments with necessary precision. A prototype was built to instantiate the concept, and two comparative experiments were conducted to evaluate the effectiveness of the proposal.

Original languageEnglish
Title of host publicationDistributed, Ambient and Pervasive Interactions - 4th International Conference, DAPI 2016 and Held as Part of HCI International 2016 Toronto, ON, Canada, July 17–22, 2016, Proceedings
PublisherSpringer Verlag
Number of pages11
ISBN (Print)9783319398617
Publication statusPublished - 2016
Externally publishedYes
Event18th International Conference on Human-Computer Interaction, HCI International 2016 - Toronto, Canada
Duration: 2016 Jul 172016 Jul 22

Publication series

NameLecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
ISSN (Print)03029743
ISSN (Electronic)16113349


Other18th International Conference on Human-Computer Interaction, HCI International 2016


  • Facial tracking
  • Input method
  • Pointing technique
  • Wall-sized display

ASJC Scopus subject areas

  • Computer Science(all)
  • Theoretical Computer Science


Dive into the research topics of 'Facial tracking-assisted hand pointing technique for wall-sized displays'. Together they form a unique fingerprint.

Cite this