End-to-End Tactile Feedback Loop: From Soft Sensor Skin over Deep GRU-Autoencoders to Tactile Stimulation

Andreas Geier*, Rawleigh Tucker, Sophon Somlor, Hideyuki Sawada, Shigeki Sugano


研究成果: Article査読

3 被引用数 (Scopus)


Tactile feedback is a key sensory channel that contributes to our ability to perform precise manipulations. In this regard, sensor skin provides robots with the sense of touch making them increasingly capable of dexterous object manipulation. However, in applications like teleoperation, the complex sensory input of an infinite number of different textures must be projected to the human user's skin in a meaningful manner. In addressing this issue, a deep gated recurrent unit-based autoencoder (GRU-AE) that captured the perceptual dimensions of tactile textures in latent space was deployed to implicitly understand unseen textures. The expression of unknown textures in this latent space allowed for the definition of a control law to effectively drive tactile displays and to convey tactile feedback in a psycho-physically meaningful manner. The approach was experimentally verified by evaluating the prediction performance of the GRU-AE on seen and unseen data that were gathered during active tactile exploration of objects commonly encountered in daily living. A user study on a custom-made tactile display was conducted in which real tactile perceptions in response to active tactile object exploration were compared to the emulated tactile feedback using the proposed tactile feedback loop. The results suggest that the deep GRU-AE for tactile display control offers an effective and intuitive method for efficient end-to-end tactile feedback during active tactile texture exploration.

ジャーナルIEEE Robotics and Automation Letters
出版ステータスPublished - 2020 10月

ASJC Scopus subject areas

  • 制御およびシステム工学
  • 生体医工学
  • 人間とコンピュータの相互作用
  • 機械工学
  • コンピュータ ビジョンおよびパターン認識
  • コンピュータ サイエンスの応用
  • 制御と最適化
  • 人工知能


「End-to-End Tactile Feedback Loop: From Soft Sensor Skin over Deep GRU-Autoencoders to Tactile Stimulation」の研究トピックを掘り下げます。これらがまとまってユニークなフィンガープリントを構成します。