A crowdsourcing based mobile image translation and knowledge sharing service

Yefeng Liu, Vili Lehdonvirta, Mieke Kleppe, Todorka Alexandrova, Hiroaki Kimura, Tatsuo Nakajima

Research output: Chapter in Book/Report/Conference proceedingConference contribution

16 Citations (Scopus)

Abstract

Travelers in countries that use an unfamiliar script cannot use pocket translators or online translation services to understand menus, maps, signs and other important information, because they are unable to write the text they see. Solutions based on optical character recognition provide very limited performance in real-world situations and for complex scripts such as Chinese and Japanese. In this paper, we propose an alternative image translation solution based on crowdsourcing. A large number of human workers on mobile terminals are used to carry out the tasks of image recognition, translation and quality assurance. Compared to purely technical solutions, this human computation approach is also able to account for context and non-Textual cues, and provide higher level information to the end-user. In this paper, we describe a preliminary user study to create a model of end-user requirements.

Original languageEnglish
Title of host publicationMUM 2010 - Proceedings of the 9th International Conference on Mobile and Ubiquitous Multimedia
PublisherAssociation for Computing Machinery
ISBN (Electronic)9781450304245
DOIs
Publication statusPublished - 2010 Dec 1
Externally publishedYes
Event9h International Conference on Mobile and Ubiquitous Multimedia, MUM 2010 - Limassol, Cyprus
Duration: 2010 Dec 12010 Dec 3

Publication series

NameACM International Conference Proceeding Series

Conference

Conference9h International Conference on Mobile and Ubiquitous Multimedia, MUM 2010
Country/TerritoryCyprus
CityLimassol
Period10/12/110/12/3

Keywords

  • crowdsourcing
  • human computation
  • image-Text recognition
  • knowledge sharing
  • mobile image translation

ASJC Scopus subject areas

  • Software
  • Human-Computer Interaction
  • Computer Vision and Pattern Recognition
  • Computer Networks and Communications

Fingerprint

Dive into the research topics of 'A crowdsourcing based mobile image translation and knowledge sharing service'. Together they form a unique fingerprint.

Cite this