Context-based rider assistant system for two wheeled self-balancing vehicles

Kim Jeyeon, Sato Kenta, Hashimoto Naohisa, Alexey Kashevnik, Tomita Kohji, Miyakoshi Seiichi, Takinami Yusuke, Matsumoto Osamu, Boyali Ali

Research output: Contribution to journalArticlepeer-review

5 Citations (Scopus)


Personal mobility devises become more and more popular last years. Gyroscooters, two wheeled self-balancing vehicles, wheelchair, bikes, and scooters help people to solve the first and last mile problems in big cities. To help people with navigation and to increase their safety the intelligent rider assistant systems can be utilized that are used the rider personal smartphone to form the context and provide the rider with the recommendations. We understand the context as any information that characterize current situation. So, the context represents the model of current situation. We assume that rider mounts personal smartphone that allows it to track the rider face using the front-facing camera. Modern smartphones allow to track current situation using such sensors as: GPS / GLONASS, accelerometer, gyroscope, magnetometer, microphone, and video cameras. The proposed rider assistant system uses these sensors to capture the context information about the rider and the vehicle and generates context-oriented recommendations. The proposed system is aimed at dangerous situation detection for the rider, we are considering two dangerous situations: drowsiness and distraction. Using the computer vision methods, we determine parameters of the rider face (eyes, nose, mouth, head pith and rotation angles) and based on analysis of this parameters detect the dangerous situations. The paper presents a comprehensive related work analysis in the topic of intelligent driver assistant systems and recommendation generation, an approach to dangerous situation detection and recommendation generation is proposed, and evaluation of the distraction dangerous state determination for personal mobility device riders.

Original languageEnglish
Pages (from-to)583-614
Number of pages32
JournalSPIIRAS Proceedings
Issue number3
Publication statusPublished - 2019 Jun 7
Externally publishedYes


  • Context
  • Distraction
  • Drowsiness
  • Rider Assistant
  • Vehicle

ASJC Scopus subject areas

  • Control and Systems Engineering
  • Computer Networks and Communications
  • Applied Mathematics
  • Artificial Intelligence


Dive into the research topics of 'Context-based rider assistant system for two wheeled self-balancing vehicles'. Together they form a unique fingerprint.

Cite this