Communication over the Internet using a 3D agent with real-time facial expression analysis, synthesis and text to speech capabilities

N. P. Chandrasiri; I. Barakonyi; T. Naemura; M. Ishizuka; H. Harashima

doi:10.1109/ICCS.2002.1182522

Communication over the Internet using a 3D agent with real-time facial expression analysis, synthesis and text to speech capabilities

N. P. Chandrasiri, I. Barakonyi, T. Naemura, M. Ishizuka, H. Harashima

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

3 Citations (Scopus)

Abstract

We present a system for Internet communication that enhances traditional text-based chatting with real-time analysis and synthesis of the chat parties' facial expressions. It is composed of three main modules: a real-time facial expression analysis component, a 3D agent with facial expression synthesis and text-to-speech capabilities - a talking head, and a communication module. So far we have realized a prototype to find out attractive ways of communication on the Internet and are currently experimenting on how to utilize this new type of modalities in chat communication.

Original language	English
Title of host publication	8th International Conference on Communication Systems, ICCS 2002 - Proceedings
Publisher	Institute of Electrical and Electronics Engineers Inc.
Pages	480-484
Number of pages	5
ISBN (Print)	0780375106, 9780780375109
DOIs	https://doi.org/10.1109/ICCS.2002.1182522
Publication status	Published - 2002
Externally published	Yes
Event	8th International Conference on Communication Systems, ICCS 2002 - Singapore, Singapore Duration: 2002 Nov 25 → 2002 Nov 28

Other

Other	8th International Conference on Communication Systems, ICCS 2002
Country/Territory	Singapore
City	Singapore
Period	02/11/25 → 02/11/28

Keywords

3D agent
chat
facial expression
MPEG-4 FAP

ASJC Scopus subject areas

Electrical and Electronic Engineering
Computer Networks and Communications

Access to Document

10.1109/ICCS.2002.1182522

Cite this

Chandrasiri, N. P., Barakonyi, I., Naemura, T., Ishizuka, M., & Harashima, H. (2002). Communication over the Internet using a 3D agent with real-time facial expression analysis, synthesis and text to speech capabilities. In 8th International Conference on Communication Systems, ICCS 2002 - Proceedings (pp. 480-484). Article 1182522 Institute of Electrical and Electronics Engineers Inc.. https://doi.org/10.1109/ICCS.2002.1182522

Communication over the Internet using a 3D agent with real-time facial expression analysis, synthesis and text to speech capabilities. / Chandrasiri, N. P.; Barakonyi, I.; Naemura, T. et al.
8th International Conference on Communication Systems, ICCS 2002 - Proceedings. Institute of Electrical and Electronics Engineers Inc., 2002. p. 480-484 1182522.

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Chandrasiri, NP, Barakonyi, I, Naemura, T, Ishizuka, M & Harashima, H 2002, Communication over the Internet using a 3D agent with real-time facial expression analysis, synthesis and text to speech capabilities. in 8th International Conference on Communication Systems, ICCS 2002 - Proceedings., 1182522, Institute of Electrical and Electronics Engineers Inc., pp. 480-484, 8th International Conference on Communication Systems, ICCS 2002, Singapore, Singapore, 02/11/25. https://doi.org/10.1109/ICCS.2002.1182522

Chandrasiri NP, Barakonyi I, Naemura T, Ishizuka M, Harashima H. Communication over the Internet using a 3D agent with real-time facial expression analysis, synthesis and text to speech capabilities. In 8th International Conference on Communication Systems, ICCS 2002 - Proceedings. Institute of Electrical and Electronics Engineers Inc. 2002. p. 480-484. 1182522 doi: 10.1109/ICCS.2002.1182522

@inproceedings{76a151a45d1b42adb7dbeae4951d22c5,

title = "Communication over the Internet using a 3D agent with real-time facial expression analysis, synthesis and text to speech capabilities",

abstract = "We present a system for Internet communication that enhances traditional text-based chatting with real-time analysis and synthesis of the chat parties' facial expressions. It is composed of three main modules: a real-time facial expression analysis component, a 3D agent with facial expression synthesis and text-to-speech capabilities - a talking head, and a communication module. So far we have realized a prototype to find out attractive ways of communication on the Internet and are currently experimenting on how to utilize this new type of modalities in chat communication.",

keywords = "3D agent, chat, facial expression, MPEG-4 FAP",

author = "Chandrasiri, {N. P.} and I. Barakonyi and T. Naemura and M. Ishizuka and H. Harashima",

year = "2002",

doi = "10.1109/ICCS.2002.1182522",

language = "English",

isbn = "0780375106",

pages = "480--484",

booktitle = "8th International Conference on Communication Systems, ICCS 2002 - Proceedings",

publisher = "Institute of Electrical and Electronics Engineers Inc.",

note = "8th International Conference on Communication Systems, ICCS 2002 ; Conference date: 25-11-2002 Through 28-11-2002",

}

TY - GEN

T1 - Communication over the Internet using a 3D agent with real-time facial expression analysis, synthesis and text to speech capabilities

AU - Chandrasiri, N. P.

AU - Barakonyi, I.

AU - Naemura, T.

AU - Ishizuka, M.

AU - Harashima, H.

PY - 2002

Y1 - 2002

N2 - We present a system for Internet communication that enhances traditional text-based chatting with real-time analysis and synthesis of the chat parties' facial expressions. It is composed of three main modules: a real-time facial expression analysis component, a 3D agent with facial expression synthesis and text-to-speech capabilities - a talking head, and a communication module. So far we have realized a prototype to find out attractive ways of communication on the Internet and are currently experimenting on how to utilize this new type of modalities in chat communication.

AB - We present a system for Internet communication that enhances traditional text-based chatting with real-time analysis and synthesis of the chat parties' facial expressions. It is composed of three main modules: a real-time facial expression analysis component, a 3D agent with facial expression synthesis and text-to-speech capabilities - a talking head, and a communication module. So far we have realized a prototype to find out attractive ways of communication on the Internet and are currently experimenting on how to utilize this new type of modalities in chat communication.

KW - 3D agent

KW - chat

KW - facial expression

KW - MPEG-4 FAP

UR - http://www.scopus.com/inward/record.url?scp=84961695960&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84961695960&partnerID=8YFLogxK

U2 - 10.1109/ICCS.2002.1182522

DO - 10.1109/ICCS.2002.1182522

M3 - Conference contribution

AN - SCOPUS:84961695960

SN - 0780375106

SN - 9780780375109

SP - 480

EP - 484

BT - 8th International Conference on Communication Systems, ICCS 2002 - Proceedings

PB - Institute of Electrical and Electronics Engineers Inc.

T2 - 8th International Conference on Communication Systems, ICCS 2002

Y2 - 25 November 2002 through 28 November 2002

ER -

Communication over the Internet using a 3D agent with real-time facial expression analysis, synthesis and text to speech capabilities

Abstract

Other

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this