Projectable interactive surface using microsoft kinect V2: Recovering information from coarse data to detect touch

P. Sharma, R. P. Joshi, R. A. Boby, S. K. Saha, T. Matsumaru

Research output: Chapter in Book/Report/Conference proceedingConference contribution

10 Citations (Scopus)

Abstract

An Image-projective Desktop Varnamala Trainer (IDVT) called SAKSHAR has been designed to improve the learning by children through an interactive audio visual feedback system. This device uses a projector to render a virtual display, which permits production of large interactive displays with minimal cost. The user's hand is recognized with the help of a Microsoft Kinect Version 2. The entire system is portable, i.e., it can be projected on any planar surface. Since the Kinect does not give precise 3D coordinates of points for detecting a touch, a model of recognition of a touch purely based on the contact of the user's hand with the surface would not yield accurate results. We have instead modeled the touch action by using multiple points along the trajectory of the tracked point of the user's hand while hand makes contact with the surface. Fitting a curve through these points and analyzing the errors is used to make the detection of touch accurate.

Original languageEnglish
Title of host publication2015 IEEE/SICE International Symposium on System Integration, SII 2015
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages795-800
Number of pages6
ISBN (Electronic)9781467372428
DOIs
Publication statusPublished - 2016 Feb 10
Event8th Annual IEEE/SICE International Symposium on System Integration, SII 2015 - Nagoya, Japan
Duration: 2015 Dec 112015 Dec 13

Publication series

Name2015 IEEE/SICE International Symposium on System Integration, SII 2015

Other

Other8th Annual IEEE/SICE International Symposium on System Integration, SII 2015
Country/TerritoryJapan
CityNagoya
Period15/12/1115/12/13

ASJC Scopus subject areas

  • Artificial Intelligence
  • Control and Systems Engineering

Fingerprint

Dive into the research topics of 'Projectable interactive surface using microsoft kinect V2: Recovering information from coarse data to detect touch'. Together they form a unique fingerprint.

Cite this