TY - GEN
T1 - A depth camera-based system to enable touch-less interaction using hand gestures
AU - Damindarov, R.
AU - Fam, C. A.
AU - Boby, R. A.
AU - Fahim, M.
AU - Klimchik, A.
AU - Matsumaru, T.
N1 - Publisher Copyright:
© 2021 IEEE.
PY - 2021
Y1 - 2021
N2 - Touch-less interaction is an active area of research due to its numerous applications ranging from medical systems to gaming. In this paper we propose a novel interactive system based on RealSense camera to track the pose of hand and to recognize gestures. Our approach is based on MediaPipe model introduced by Google to detect the landmarks of the hand. The system utilizes the camera calibration information and user actions to get the geometry of the deployed environment, which shows high accuracy in measurement of hand position. The touch-less interaction is demonstrated using a graphical user interface for painting.
AB - Touch-less interaction is an active area of research due to its numerous applications ranging from medical systems to gaming. In this paper we propose a novel interactive system based on RealSense camera to track the pose of hand and to recognize gestures. Our approach is based on MediaPipe model introduced by Google to detect the landmarks of the hand. The system utilizes the camera calibration information and user actions to get the geometry of the deployed environment, which shows high accuracy in measurement of hand position. The touch-less interaction is demonstrated using a graphical user interface for painting.
UR - http://www.scopus.com/inward/record.url?scp=85123538675&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85123538675&partnerID=8YFLogxK
U2 - 10.1109/NIR52917.2021.9666090
DO - 10.1109/NIR52917.2021.9666090
M3 - Conference contribution
AN - SCOPUS:85123538675
T3 - 2021 International Conference "Nonlinearity, Information and Robotics", NIR 2021
BT - 2021 International Conference "Nonlinearity, Information and Robotics", NIR 2021
PB - Institute of Electrical and Electronics Engineers Inc.
T2 - 2021 International Conference "Nonlinearity, Information and Robotics", NIR 2021
Y2 - 26 August 2021 through 29 August 2021
ER -