Evaluating an algorithm for the generation of multimodal referring expressions in a virtual world: A pilot study

Werner Breitfuss; Ielka Van Der Sluis; Saturnino Luz; Helmut Prendinger; Mitsuru Ishizuka

doi:10.1007/978-3-642-04380-2_22

Evaluating an algorithm for the generation of multimodal referring expressions in a virtual world: A pilot study

Werner Breitfuss^*, Ielka Van Der Sluis, Saturnino Luz, Helmut Prendinger, Mitsuru Ishizuka

^*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

1 Citation (Scopus)

Abstract

This paper presents a quest for the most suitable setting and method to assess the naturalness of the output of an existing algorithm for the generation of multimodal referring expressions. For the evaluation of this algorithm a setting in Second Life was built. This paper reports on a pilot study that aimed to assess (1) the suitability of the setting and (2) the design of our evaluation method. Results show that subjects are able to discriminate between different types of referring expressions the algorithm produces. Lessons learnt in designing questionnaires are also reported.

Original language	English
Title of host publication	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Pages	181-187
Number of pages	7
Volume	5773 LNAI
DOIs	https://doi.org/10.1007/978-3-642-04380-2_22
Publication status	Published - 2009
Externally published	Yes
Event	9th International Conference on Intelligent Virtual Agents, IVA 2009 - Amsterdam Duration: 2009 Sept 14 → 2009 Sept 16

Publication series

Name	Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume	5773 LNAI
ISSN (Print)	03029743
ISSN (Electronic)	16113349

Other

Other	9th International Conference on Intelligent Virtual Agents, IVA 2009
City	Amsterdam
Period	09/9/14 → 09/9/16

Keywords

Automatic Behavior Generation
Embodied Conversational Agents
Generation of Multimodal Referring Expressions
Virtual Worlds

ASJC Scopus subject areas

Computer Science(all)
Theoretical Computer Science

Access to Document

10.1007/978-3-642-04380-2_22

Cite this

Breitfuss, W., Van Der Sluis, I., Luz, S., Prendinger, H., & Ishizuka, M. (2009). Evaluating an algorithm for the generation of multimodal referring expressions in a virtual world: A pilot study. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics) (Vol. 5773 LNAI, pp. 181-187). (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5773 LNAI). https://doi.org/10.1007/978-3-642-04380-2_22

Evaluating an algorithm for the generation of multimodal referring expressions in a virtual world: A pilot study. / Breitfuss, Werner; Van Der Sluis, Ielka; Luz, Saturnino et al.
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 5773 LNAI 2009. p. 181-187 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); Vol. 5773 LNAI).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

Breitfuss, W, Van Der Sluis, I, Luz, S, Prendinger, H & Ishizuka, M 2009, Evaluating an algorithm for the generation of multimodal referring expressions in a virtual world: A pilot study. in Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). vol. 5773 LNAI, Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics), vol. 5773 LNAI, pp. 181-187, 9th International Conference on Intelligent Virtual Agents, IVA 2009, Amsterdam, 09/9/14. https://doi.org/10.1007/978-3-642-04380-2_22

Breitfuss W, Van Der Sluis I, Luz S, Prendinger H, Ishizuka M. Evaluating an algorithm for the generation of multimodal referring expressions in a virtual world: A pilot study. In Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 5773 LNAI. 2009. p. 181-187. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)). doi: 10.1007/978-3-642-04380-2_22

Breitfuss, Werner ; Van Der Sluis, Ielka ; Luz, Saturnino et al. / Evaluating an algorithm for the generation of multimodal referring expressions in a virtual world : A pilot study. Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics). Vol. 5773 LNAI 2009. pp. 181-187 (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)).

@inproceedings{bd2e7693b30246f5bf8f2116dae4b93d,

title = "Evaluating an algorithm for the generation of multimodal referring expressions in a virtual world: A pilot study",

abstract = "This paper presents a quest for the most suitable setting and method to assess the naturalness of the output of an existing algorithm for the generation of multimodal referring expressions. For the evaluation of this algorithm a setting in Second Life was built. This paper reports on a pilot study that aimed to assess (1) the suitability of the setting and (2) the design of our evaluation method. Results show that subjects are able to discriminate between different types of referring expressions the algorithm produces. Lessons learnt in designing questionnaires are also reported.",

keywords = "Automatic Behavior Generation, Embodied Conversational Agents, Generation of Multimodal Referring Expressions, Virtual Worlds",

author = "Werner Breitfuss and {Van Der Sluis}, Ielka and Saturnino Luz and Helmut Prendinger and Mitsuru Ishizuka",

year = "2009",

doi = "10.1007/978-3-642-04380-2_22",

language = "English",

isbn = "3642043798",

volume = "5773 LNAI",

series = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

pages = "181--187",

booktitle = "Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)",

note = "9th International Conference on Intelligent Virtual Agents, IVA 2009 ; Conference date: 14-09-2009 Through 16-09-2009",

}

TY - GEN

T1 - Evaluating an algorithm for the generation of multimodal referring expressions in a virtual world

T2 - 9th International Conference on Intelligent Virtual Agents, IVA 2009

AU - Breitfuss, Werner

AU - Van Der Sluis, Ielka

AU - Luz, Saturnino

AU - Prendinger, Helmut

AU - Ishizuka, Mitsuru

PY - 2009

Y1 - 2009

N2 - This paper presents a quest for the most suitable setting and method to assess the naturalness of the output of an existing algorithm for the generation of multimodal referring expressions. For the evaluation of this algorithm a setting in Second Life was built. This paper reports on a pilot study that aimed to assess (1) the suitability of the setting and (2) the design of our evaluation method. Results show that subjects are able to discriminate between different types of referring expressions the algorithm produces. Lessons learnt in designing questionnaires are also reported.

AB - This paper presents a quest for the most suitable setting and method to assess the naturalness of the output of an existing algorithm for the generation of multimodal referring expressions. For the evaluation of this algorithm a setting in Second Life was built. This paper reports on a pilot study that aimed to assess (1) the suitability of the setting and (2) the design of our evaluation method. Results show that subjects are able to discriminate between different types of referring expressions the algorithm produces. Lessons learnt in designing questionnaires are also reported.

KW - Automatic Behavior Generation

KW - Embodied Conversational Agents

KW - Generation of Multimodal Referring Expressions

KW - Virtual Worlds

UR - http://www.scopus.com/inward/record.url?scp=70350409675&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=70350409675&partnerID=8YFLogxK

U2 - 10.1007/978-3-642-04380-2_22

DO - 10.1007/978-3-642-04380-2_22

M3 - Conference contribution

AN - SCOPUS:70350409675

SN - 3642043798

SN - 9783642043796

VL - 5773 LNAI

T3 - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

SP - 181

EP - 187

BT - Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)

Y2 - 14 September 2009 through 16 September 2009

ER -

Evaluating an algorithm for the generation of multimodal referring expressions in a virtual world: A pilot study

Abstract

Publication series

Other

Keywords

ASJC Scopus subject areas

Access to Document

Other files and links

Fingerprint

Cite this