Face analysis and synthesis for interactive entertainment

Shoichiro Iwasawa, Tatsuo Yotsukura, Shigeo Morishima

Research output: Chapter in Book/Report/Conference proceedingConference contribution


A stand-in is a common technique for movies and TV programs in foreign languages. The current stand-in that only substitutes the voice channel results awkward matching to the mouth motion. Videophone with automatic voice translation are expected to be widely used in the near future, which may face the same problem without lip-synchronized speaking face image translation. In this paper, we propose a method to track motion of the face from the video image and then replace the face part or only mouth part with synthesized one which is synchronized with synthetic voice or spoken voice. This is one of the key technologies not only for speaking image translation and communication system, but also for an interactive entertainment system. Finally, an interactive movie system is introduced as an application of entertainment system.

Original languageEnglish
Title of host publicationEntertainment Computing
Subtitle of host publicationTechnologies and Applications - IFlP 1st International Workshop on Entertainment Computing, IWEC 2002
PublisherSpringer New York LLC
Number of pages8
ISBN (Print)9781475751536
Publication statusPublished - 2003 Jan 1
Externally publishedYes
EventIFIP 1st International Workshop on Entertainment Computing, IWEC 2002 - Makuhari, Japan
Duration: 2002 May 142002 May 17

Publication series

NameIFIP Advances in Information and Communication Technology
ISSN (Print)1868-4238


ConferenceIFIP 1st International Workshop on Entertainment Computing, IWEC 2002


  • Face image synthesis
  • Face tracking
  • Interactive movie
  • Lip synchronization

ASJC Scopus subject areas

  • Information Systems
  • Computer Networks and Communications
  • Information Systems and Management


Dive into the research topics of 'Face analysis and synthesis for interactive entertainment'. Together they form a unique fingerprint.

Cite this