Infrared Image Colorization Using a S-Shape Network

Ziyue Dong, Sei Ichiro Kamata, Toby P. Breckon

Research output: Chapter in Book/Report/Conference proceedingConference contribution

30 Citations (Scopus)


This paper proposes a novel approach for colorizing near infrared (NIR) images using a S-shape network (SNet). The proposed approach is based on the usage of an encoder-decoder architecture followed with a secondary assistant network. The encoder-decoder consists of a contracting path to capture context and a symmetric expanding path that enables precise localization. The assistant network is a shallow encoder-decoder to enhance the edge and improve the output, which can be trained end-to-end from a few image examples. The trained model does not require any user guidance or a reference image database. Furthermore, our architecture will preserve clear edges within NIR images. Our overall architecture is trained and evaluated on a real-world dataset containing a significant amount of road scene images. This dataset was captured by a NIR camera and a corresponding RGB camera to facilitate side-by-side comparison. In the experiments, we demonstrate that our SNet works well, and outperforms contemporary state-of-the-art approaches.

Original languageEnglish
Title of host publication2018 IEEE International Conference on Image Processing, ICIP 2018 - Proceedings
PublisherIEEE Computer Society
Number of pages5
ISBN (Electronic)9781479970612
Publication statusPublished - 2018 Aug 29
Event25th IEEE International Conference on Image Processing, ICIP 2018 - Athens, Greece
Duration: 2018 Oct 72018 Oct 10

Publication series

NameProceedings - International Conference on Image Processing, ICIP
ISSN (Print)1522-4880


Conference25th IEEE International Conference on Image Processing, ICIP 2018


  • Colorization
  • Convolutional neural network
  • Infrared
  • S-shape network

ASJC Scopus subject areas

  • Software
  • Computer Vision and Pattern Recognition
  • Signal Processing


Dive into the research topics of 'Infrared Image Colorization Using a S-Shape Network'. Together they form a unique fingerprint.

Cite this