Learning to restore deteriorated line drawing

Kazuma Sasaki*, Satoshi Iizuka, Edgar Simo-Serra, Hiroshi Ishikawa

*Corresponding author for this work

Research output: Contribution to journalArticlepeer-review

13 Citations (Scopus)


We propose a fully automatic approach to restore aged old line drawings. We decompose the task into two subtasks: the line extraction subtask, which aims to extract line fragments and remove the paper texture background, and the restoration subtask, which fills in possible gaps and deterioration of the lines to produce a clean line drawing. Our approach is based on a convolutional neural network that consists of two sub-networks corresponding to the two subtasks. They are trained as part of a single framework in an end-to-end fashion. We also introduce a new dataset consisting of manually annotated sketches by Leonardo da Vinci which, in combination with a synthetic data generation approach, allows training the network to restore deteriorated line drawings. We evaluate our method on challenging 500-year-old sketches and compare with existing approaches with a user study, in which it is found that our approach is preferred 72.7% of the time.

Original languageEnglish
Pages (from-to)1077-1085
Number of pages9
JournalVisual Computer
Issue number6-8
Publication statusPublished - 2018 Jun 1


  • Convolutional neural network
  • Image manipulation
  • Image restoration
  • Line drawings

ASJC Scopus subject areas

  • Software
  • Computer Vision and Pattern Recognition
  • Computer Graphics and Computer-Aided Design


Dive into the research topics of 'Learning to restore deteriorated line drawing'. Together they form a unique fingerprint.

Cite this