TY - JOUR
T1 - A fully-blind and fast image quality predictor with convolutional neural networks
AU - Cheng, Zhengxue
AU - Takeuchi, Masaru
AU - Kanai, Kenji
AU - Katto, Jiro
N1 - Publisher Copyright:
© 2018 The Institute of Electronics, Information and Communication Engineers.
PY - 2018/9
Y1 - 2018/9
N2 - Image quality assessment (IQA) is an inherent problem in the field of image processing. Recently, deep learning-based image quality assessment has attracted increased attention, owing to its high prediction accuracy. In this paper, we propose a fully-blind and fast image quality predictor (FFIQP) using convolutional neural networks including two strategies. First, we propose a distortion clustering strategy based on the distribution function of intermediate-layer results in the convolutional neural network (CNN) to make IQA fully blind. Second, by analyzing the relationship between image saliency information and CNN prediction error, we utilize a pre-saliency map to skip the non-salient patches for IQA acceleration. Experimental results verify that our method can achieve the high accuracy (0.978) with subjective quality scores, outperforming existing IQA methods. Moreover, the proposed method is highly computationally appealing, achieving flexible complexity performance by assigning different thresholds in the saliency map.
AB - Image quality assessment (IQA) is an inherent problem in the field of image processing. Recently, deep learning-based image quality assessment has attracted increased attention, owing to its high prediction accuracy. In this paper, we propose a fully-blind and fast image quality predictor (FFIQP) using convolutional neural networks including two strategies. First, we propose a distortion clustering strategy based on the distribution function of intermediate-layer results in the convolutional neural network (CNN) to make IQA fully blind. Second, by analyzing the relationship between image saliency information and CNN prediction error, we utilize a pre-saliency map to skip the non-salient patches for IQA acceleration. Experimental results verify that our method can achieve the high accuracy (0.978) with subjective quality scores, outperforming existing IQA methods. Moreover, the proposed method is highly computationally appealing, achieving flexible complexity performance by assigning different thresholds in the saliency map.
KW - Convolutional neural networks
KW - Distortion recognition
KW - No-reference image quality assessment
KW - Saliency map
UR - http://www.scopus.com/inward/record.url?scp=85053852160&partnerID=8YFLogxK
UR - http://www.scopus.com/inward/citedby.url?scp=85053852160&partnerID=8YFLogxK
U2 - 10.1587/transfun.E101.A.1557
DO - 10.1587/transfun.E101.A.1557
M3 - Article
AN - SCOPUS:85053852160
SN - 0916-8508
VL - E101A
SP - 1557
EP - 1566
JO - IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences
JF - IEICE Transactions on Fundamentals of Electronics, Communications and Computer Sciences
IS - 9
ER -