A multimodal human-machine interface enabling situation-Adaptive control inputs for highly automated vehicles

Udara E. Manawadu, Mitsuhiro Kamezaki, Masaaki Ishikawa, Takahiro Kawano, Shigeki Sugano

研究成果: Conference contribution

15 被引用数 (Scopus)


Intelligent vehicles operating in different levels of automation require the driver to fully or partially conduct the dynamic driving task (DDT) and to conduct fallback performance of the DDT, during a trip. Such vehicles create the need for novel human-machine interfaces (HMIs) designed to conduct high-level vehicle control tasks. Multimodal interfaces (MMIs) have advantages such as improved recognition, faster interaction, and situation-Adaptability, over unimodal interfaces. In this study, we developed and evaluated a MMI system with three input modalities; touchscreen, hand-gesture, and haptic to input tactical-level control commands (e.g. lane-changing, overtaking, and parking). We conducted driving experiments in a driving simulator to evaluate the effectiveness of the MMI system. The results show that multimodal HMI significantly reduced the driver workload, improved the efficiency of interaction, and minimized input errors compared with unimodal interfaces. Moreover, we discovered relationships between input types and modalities: location-based inputs-Touchscreen interface, time-critical inputs-haptic interface. The results proved the functional advantages and effectiveness of multimodal interface system over its unimodal components for conducting tactical-level driving tasks.

ホスト出版物のタイトルIV 2017 - 28th IEEE Intelligent Vehicles Symposium
出版社Institute of Electrical and Electronics Engineers Inc.
出版ステータスPublished - 2017 7月 28
イベント28th IEEE Intelligent Vehicles Symposium, IV 2017 - Redondo Beach, United States
継続期間: 2017 6月 112017 6月 14


名前IEEE Intelligent Vehicles Symposium, Proceedings


Other28th IEEE Intelligent Vehicles Symposium, IV 2017
国/地域United States
CityRedondo Beach

ASJC Scopus subject areas

  • コンピュータ サイエンスの応用
  • 自動車工学
  • モデリングとシミュレーション


「A multimodal human-machine interface enabling situation-Adaptive control inputs for highly automated vehicles」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。