Virtual extensible tool interface for three-dimensional interaction with remote objects

Many shared-space communication systems have been proposed which support bodily actions, such as eye gaze and instruction, among remote people. However, the method to share a three-dimensional bodily action in physical space with remote people has not been explored sufficiently. In this paper, we propose a novel method of a shared-space communication to support to bridge over remote two tabletops visually and to share bodily action among remote people. To achieve this aim, a video image of remote tabletop is required to be shared with each other. A display and an interface are also needed for reflecting a remote bodily action in a local space consistently. Consequently, the front screen, on which a video image of a remote space including a tabletop is projected to connect tableside visually, is installed aslope on a table. We developed also a Virtual Extensible Tool Interface which supports visual interactions including pointing to and touching a physical object in remote space by representing virtual extensive tool to a remote space. Experiments on bodily interactions between local and remote people demonstrated that the extensible tool interface can support bodily interactions with a remote partner including instructing to a remote physical object in three dimensions. Moreover, the results indicate clearly that the participants felt as if they were touching the remote table. Thus, our system possesses a potential to support a remote co-creative communication including a physical interaction through tools, and it is promising.