Real-time synthesis of a humanlike agent in response to the user's moving image

Osamu Hasegawa*, Chil Woo Lee, Wiwat Wongwarawipat, Mitsuru Ishizuka

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

1 Citation (Scopus)


This paper describes a parallel computing system and a software algorithm for real-time interaction between a human user and a synthesized, humanlike, moving image. The realistic humanlike agent on a monitor can recognize the palm position and finger motion (finger sign) of the user. She/he then tracks and gazes at the hand position to change her/his facial expression in response to the finger sign in real time. This visual software agent (VSA) is expected to play an important role in building an advanced human interface. We regard this type of interactive agent as a visual software robot. To achieve real-time image recognition and image synthesis, we have developed a parallel visual computer system the transputer network with visual interface to transputers (TN-VIT). The imagesynthesis speed of the TN-VIT is about 24 frames/s, including finger-sign recognition. Some samples of synthesized images and experimental results are shown.

Original languageEnglish
Pages (from-to)122-130
Number of pages9
JournalMachine Vision and Applications
Issue number2
Publication statusPublished - 1995 Mar
Externally publishedYes


  • Fingersign recognition
  • Human interface
  • Moving image synthesis
  • Parallel computer
  • Real-time image recognition
  • Software robot
  • Transputer

ASJC Scopus subject areas

  • Electrical and Electronic Engineering
  • Control and Systems Engineering
  • Human-Computer Interaction
  • Computer Vision and Pattern Recognition
  • Artificial Intelligence


Dive into the research topics of 'Real-time synthesis of a humanlike agent in response to the user's moving image'. Together they form a unique fingerprint.

Cite this