Face analysis and synthesis for interactive entertainment

Shoichiro Iwasawa; Tatsuo Yotsukura; Shigeo Morishima

doi:10.1007/978-0-387-35660-0_19

Face analysis and synthesis for interactive entertainment

Shoichiro Iwasawa, Tatsuo Yotsukura, Shigeo Morishima

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Abstract

A stand-in is a common technique for movies and TV programs in foreign languages. The current stand-in that only substitutes the voice channel results awkward matching to the mouth motion. Videophone with automatic voice translation are expected to be widely used in the near future, which may face the same problem without lip-synchronized speaking face image translation. In this paper, we propose a method to track motion of the face from the video image and then replace the face part or only mouth part with synthesized one which is synchronized with synthetic voice or spoken voice. This is one of the key technologies not only for speaking image translation and communication system, but also for an interactive entertainment system. Finally, an interactive movie system is introduced as an application of entertainment system.

Original language	English
Title of host publication	Entertainment Computing
Subtitle of host publication	Technologies and Applications - IFlP 1st International Workshop on Entertainment Computing, IWEC 2002
Publisher	Springer New York LLC
Pages	157-164
Number of pages	8
ISBN (Print)	9781475751536
DOIs	https://doi.org/10.1007/978-0-387-35660-0_19
Publication status	Published - 2003 Jan 1
Externally published	Yes
Event	IFIP 1st International Workshop on Entertainment Computing, IWEC 2002 - Makuhari, Japan Duration: 2002 May 14 → 2002 May 17

Publication series

Name	IFIP Advances in Information and Communication Technology
Volume	112
ISSN (Print)	1868-4238

Conference

Conference	IFIP 1st International Workshop on Entertainment Computing, IWEC 2002
Country/Territory	Japan
City	Makuhari
Period	02/5/14 → 02/5/17

Keywords

Face image synthesis
Face tracking
Interactive movie
Lip synchronization

ASJC Scopus subject areas

Information Systems
Computer Networks and Communications
Information Systems and Management

Access to Document

10.1007/978-0-387-35660-0_19

Cite this

Iwasawa, S., Yotsukura, T., & Morishima, S. (2003). Face analysis and synthesis for interactive entertainment. In Entertainment Computing: Technologies and Applications - IFlP 1st International Workshop on Entertainment Computing, IWEC 2002 (pp. 157-164). (IFIP Advances in Information and Communication Technology; Vol. 112). Springer New York LLC. https://doi.org/10.1007/978-0-387-35660-0_19

Face analysis and synthesis for interactive entertainment. / Iwasawa, Shoichiro; Yotsukura, Tatsuo; Morishima, Shigeo.
Entertainment Computing: Technologies and Applications - IFlP 1st International Workshop on Entertainment Computing, IWEC 2002. Springer New York LLC, 2003. p. 157-164 (IFIP Advances in Information and Communication Technology; Vol. 112).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Iwasawa, S, Yotsukura, T & Morishima, S 2003, Face analysis and synthesis for interactive entertainment. in Entertainment Computing: Technologies and Applications - IFlP 1st International Workshop on Entertainment Computing, IWEC 2002. IFIP Advances in Information and Communication Technology, vol. 112, Springer New York LLC, pp. 157-164, IFIP 1st International Workshop on Entertainment Computing, IWEC 2002, Makuhari, Japan, 02/5/14. https://doi.org/10.1007/978-0-387-35660-0_19

@inproceedings{11fc4b1d58f34616b921ed40bd2a6c77,

title = "Face analysis and synthesis for interactive entertainment",

abstract = "A stand-in is a common technique for movies and TV programs in foreign languages. The current stand-in that only substitutes the voice channel results awkward matching to the mouth motion. Videophone with automatic voice translation are expected to be widely used in the near future, which may face the same problem without lip-synchronized speaking face image translation. In this paper, we propose a method to track motion of the face from the video image and then replace the face part or only mouth part with synthesized one which is synchronized with synthetic voice or spoken voice. This is one of the key technologies not only for speaking image translation and communication system, but also for an interactive entertainment system. Finally, an interactive movie system is introduced as an application of entertainment system.",

keywords = "Face image synthesis, Face tracking, Interactive movie, Lip synchronization",

author = "Shoichiro Iwasawa and Tatsuo Yotsukura and Shigeo Morishima",

year = "2003",

month = jan,

day = "1",

doi = "10.1007/978-0-387-35660-0_19",

language = "English",

isbn = "9781475751536",

series = "IFIP Advances in Information and Communication Technology",

publisher = "Springer New York LLC",

pages = "157--164",

booktitle = "Entertainment Computing",

note = "IFIP 1st International Workshop on Entertainment Computing, IWEC 2002 ; Conference date: 14-05-2002 Through 17-05-2002",

}

TY - GEN

T1 - Face analysis and synthesis for interactive entertainment

AU - Iwasawa, Shoichiro

AU - Yotsukura, Tatsuo

AU - Morishima, Shigeo

PY - 2003/1/1

Y1 - 2003/1/1

N2 - A stand-in is a common technique for movies and TV programs in foreign languages. The current stand-in that only substitutes the voice channel results awkward matching to the mouth motion. Videophone with automatic voice translation are expected to be widely used in the near future, which may face the same problem without lip-synchronized speaking face image translation. In this paper, we propose a method to track motion of the face from the video image and then replace the face part or only mouth part with synthesized one which is synchronized with synthetic voice or spoken voice. This is one of the key technologies not only for speaking image translation and communication system, but also for an interactive entertainment system. Finally, an interactive movie system is introduced as an application of entertainment system.

AB - A stand-in is a common technique for movies and TV programs in foreign languages. The current stand-in that only substitutes the voice channel results awkward matching to the mouth motion. Videophone with automatic voice translation are expected to be widely used in the near future, which may face the same problem without lip-synchronized speaking face image translation. In this paper, we propose a method to track motion of the face from the video image and then replace the face part or only mouth part with synthesized one which is synchronized with synthetic voice or spoken voice. This is one of the key technologies not only for speaking image translation and communication system, but also for an interactive entertainment system. Finally, an interactive movie system is introduced as an application of entertainment system.

KW - Face image synthesis

KW - Face tracking

KW - Interactive movie

KW - Lip synchronization

UR - http://www.scopus.com/inward/record.url?scp=84904339272&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84904339272&partnerID=8YFLogxK

U2 - 10.1007/978-0-387-35660-0_19

DO - 10.1007/978-0-387-35660-0_19

M3 - Conference contribution

AN - SCOPUS:84904339272

SN - 9781475751536

T3 - IFIP Advances in Information and Communication Technology

SP - 157

EP - 164

BT - Entertainment Computing

PB - Springer New York LLC

T2 - IFIP 1st International Workshop on Entertainment Computing, IWEC 2002

Y2 - 14 May 2002 through 17 May 2002

ER -

Face analysis and synthesis for interactive entertainment

Abstract

Publication series

Conference

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this