Abstract
In this paper we introduce a system that automatically adds different types of non-verbal behavior to a given dialogue script between two virtual embodied agents. It allows us to transform a dialogue in text format into an agent behavior script enriched by eye gaze and conversational gesture behavior. The agents' gaze behavior is informed by theories of human face-to-face gaze behavior. Gestures are generated based on the analysis of linguistic and contextual information of the input text. The resulting annotated dialogue script is then transformed into the Multimodal Presentation Markup Language for 3D agents (MPML3D), which controls the multi-modal behavior of animated life-like agents, including facial and body animation and synthetic speech. Using our system makes it very easy to add appropriate non-verbal behavior to a given dialogue text, a task that would otherwise be very cumbersome and time consuming.
| Original language | English |
|---|---|
| Title of host publication | Proceedings of the 9th International Conference on Multimodal Interfaces, ICMI'07 |
| Pages | 319-322 |
| Number of pages | 4 |
| DOIs | |
| Publication status | Published - 2007 |
| Externally published | Yes |
| Event | 9th International Conference on Multimodal Interfaces, ICMI 2007 - Nagoya Duration: 2007 Nov 12 → 2007 Nov 15 |
Other
| Other | 9th International Conference on Multimodal Interfaces, ICMI 2007 |
|---|---|
| City | Nagoya |
| Period | 07/11/12 → 07/11/15 |
Keywords
- Animation agent systems
- Multi-modal presentation
- Multimodal input and output interfaces
- Processing of language and action patterns
ASJC Scopus subject areas
- Artificial Intelligence
- Computer Graphics and Computer-Aided Design
- Computer Vision and Pattern Recognition
- Human-Computer Interaction