Real-time gesture recognition with finger naming by RGB camera and IR depth sensor

Phonpatchara Chochai; Thanapat Mekrungroj; Takafumi Matsumaru

doi:10.1109/ROBIO.2014.7090452

Real-time gesture recognition with finger naming by RGB camera and IR depth sensor

Phonpatchara Chochai, Thanapat Mekrungroj, Takafumi Matsumaru

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

2 Citations (Scopus)

Abstract

This paper introduces the real-time fingers naming method then illustrates how hand languages could be recognized by hand gesture and relation between fingertips. Moreover, this paper provides information on how to calculate and name each finger then using arm for dynamically adjust and improve the stability while the hand is moving. Supported by the study of relation between fingertips, palms, and arms, this proposed method can recognize hand gesture and translate these signs into numbers according to the standard sign language. The approach using in this paper relies on the image depth and the RGB image to identify hands, arms and fingertips. Then, the relation between each part is used to recognize a finger name regardless of the different direction of movement. Also, this report describes how to implement the proposed method into the ASUS Xtion as a sensor.

Original language	English
Title of host publication	2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	931-936
Number of pages	6
ISBN (Print)	9781479973965
DOIs	https://doi.org/10.1109/ROBIO.2014.7090452
Publication status	Published - 2014 Apr 20
Externally published	Yes
Event	2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014 - Bali, Indonesia Duration: 2014 Dec 5 → 2014 Dec 10

Other

Other	2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014
Country/Territory	Indonesia
City	Bali
Period	14/12/5 → 14/12/10

ASJC Scopus subject areas

Biotechnology
Artificial Intelligence
Human-Computer Interaction

Access to Document

10.1109/ROBIO.2014.7090452

Cite this

Real-time gesture recognition with finger naming by RGB camera and IR depth sensor. / Chochai, Phonpatchara; Mekrungroj, Thanapat; Matsumaru, Takafumi.
2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014. Institute of Electrical and Electronics Engineers Inc., 2014. p. 931-936 7090452.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Chochai, P, Mekrungroj, T & Matsumaru, T 2014, Real-time gesture recognition with finger naming by RGB camera and IR depth sensor. in 2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014., 7090452, Institute of Electrical and Electronics Engineers Inc., pp. 931-936, 2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014, Bali, Indonesia, 14/12/5. https://doi.org/10.1109/ROBIO.2014.7090452

@inproceedings{098d735c2d0f44a2a65c713cb67469ba,

title = "Real-time gesture recognition with finger naming by RGB camera and IR depth sensor",

abstract = "This paper introduces the real-time fingers naming method then illustrates how hand languages could be recognized by hand gesture and relation between fingertips. Moreover, this paper provides information on how to calculate and name each finger then using arm for dynamically adjust and improve the stability while the hand is moving. Supported by the study of relation between fingertips, palms, and arms, this proposed method can recognize hand gesture and translate these signs into numbers according to the standard sign language. The approach using in this paper relies on the image depth and the RGB image to identify hands, arms and fingertips. Then, the relation between each part is used to recognize a finger name regardless of the different direction of movement. Also, this report describes how to implement the proposed method into the ASUS Xtion as a sensor.",

author = "Phonpatchara Chochai and Thanapat Mekrungroj and Takafumi Matsumaru",

year = "2014",

month = apr,

day = "20",

doi = "10.1109/ROBIO.2014.7090452",

language = "English",

isbn = "9781479973965",

pages = "931--936",

booktitle = "2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

note = "2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014 ; Conference date: 05-12-2014 Through 10-12-2014",

}

TY - GEN

T1 - Real-time gesture recognition with finger naming by RGB camera and IR depth sensor

AU - Chochai, Phonpatchara

AU - Mekrungroj, Thanapat

AU - Matsumaru, Takafumi

PY - 2014/4/20

Y1 - 2014/4/20

N2 - This paper introduces the real-time fingers naming method then illustrates how hand languages could be recognized by hand gesture and relation between fingertips. Moreover, this paper provides information on how to calculate and name each finger then using arm for dynamically adjust and improve the stability while the hand is moving. Supported by the study of relation between fingertips, palms, and arms, this proposed method can recognize hand gesture and translate these signs into numbers according to the standard sign language. The approach using in this paper relies on the image depth and the RGB image to identify hands, arms and fingertips. Then, the relation between each part is used to recognize a finger name regardless of the different direction of movement. Also, this report describes how to implement the proposed method into the ASUS Xtion as a sensor.

AB - This paper introduces the real-time fingers naming method then illustrates how hand languages could be recognized by hand gesture and relation between fingertips. Moreover, this paper provides information on how to calculate and name each finger then using arm for dynamically adjust and improve the stability while the hand is moving. Supported by the study of relation between fingertips, palms, and arms, this proposed method can recognize hand gesture and translate these signs into numbers according to the standard sign language. The approach using in this paper relies on the image depth and the RGB image to identify hands, arms and fingertips. Then, the relation between each part is used to recognize a finger name regardless of the different direction of movement. Also, this report describes how to implement the proposed method into the ASUS Xtion as a sensor.

UR - http://www.scopus.com/inward/record.url?scp=84949928476&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84949928476&partnerID=8YFLogxK

U2 - 10.1109/ROBIO.2014.7090452

DO - 10.1109/ROBIO.2014.7090452

M3 - Conference contribution

AN - SCOPUS:84949928476

SN - 9781479973965

SP - 931

EP - 936

BT - 2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 2014 IEEE International Conference on Robotics and Biomimetics, IEEE ROBIO 2014

Y2 - 5 December 2014 through 10 December 2014

ER -

Real-time gesture recognition with finger naming by RGB camera and IR depth sensor

Abstract

Other

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this