Novel navigation system by augmented reality technology using a tablet PC for hepatobiliary and pancreatic surgery

Jungo Yasuda*, Tomoyoshi Okamoto, Shinji Onda, Yasuro Futagawa, Katsuhiko Yanaga, Naoki Suzuki, Asaki Hattori

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

14 Citations (Scopus)


Background: We previously developed an image-guided navigation system (IG-NS) using augmented reality technology for hepatobiliary and pancreatic (HBP) surgery. This system superimposed a 3D model onto a stereoscope-captured surgical field (i.e., the scope method). Unfortunately, this method requires an expensive stereoscope, surgeons have to shift their eyesight away from the surgical field, and the method has poor controllability. Therefore, an IG-NS using a tablet PC (i.e., the tablet method) was developed. The aim of the current study is to evaluate the efficiency of this novel method. Methods: We studied 9 patients, for whom a 3D model was created from computed tomography images. After registration was performed, the 3D model was superimposed onto the surgical field, which was captured by the tablet PC's camera. Results: The IG-NS could be applied with very little time lag. The visibility and controllability of the tablet method were superior to those of the scope method. It was especially useful in surgery for multiple metastatic liver carcinoma due to easy localization of the position of the carcinomas and vessels. Conclusions: We successfully developed the tablet method and tested it in a clinical setting. This system may contribute to surgical efficacy and improve the educational effects.

Original languageEnglish
Article numbere1921
JournalInternational Journal of Medical Robotics and Computer Assisted Surgery
Issue number5
Publication statusPublished - 2018 Oct
Externally publishedYes


  • augmented reality
  • hepatobiliary
  • navigation surgery
  • tablet PC

ASJC Scopus subject areas

  • Surgery
  • Biophysics
  • Computer Science Applications


Dive into the research topics of 'Novel navigation system by augmented reality technology using a tablet PC for hepatobiliary and pancreatic surgery'. Together they form a unique fingerprint.

Cite this