WithYou - A communication system to provide out together feeling

In this paper, we present a video-based communication system that provides an Out Together Feeling. In other words, it makes a pair of users, one outdoors and the other indoors, feel as if they are going outside together. To achieve this, it is important that both users (1) can freely peruse the outdoor user's surroundings, (2) can see what the outdoor user is looking at, and (3) can focus together on the same point. To realize these features, we have designed and implemented a system called WithYou. It consists of two subsystems: a wearable system for the outdoor user and an immersive space for the indoor user. The indoor user wears an HMD and watches video from a Pan/Tilt/Zoom camera mounted on the outdoor user's chest. Thus, the indoor user can look around by simply turning his/her head to the left or right. The orientation of the outdoor user's face is also displayed on the HMD screen to indicate where he/she is looking. In the preliminary test, both users experienced the Out Together Feeling to some extent.