Open Access Open Access  Restricted Access Subscription Access

No-Reference Image Quality Assessment for Multiple Distortions Using Saliency Map Based on Dual-Convolutional Neural Networks

Jian-Jun Li,
Lan-Lan Xu,
Zhi-Hui Wang,
Chin-Chen Chang,

Abstract


No-reference image quality assessment (NR-IQA) is a challenging topic in image processing and image assessment, especially for multiple distortions. We propose a novel NR-IQA method based on a dual-convolutional neural network structure. Both gray and color features in Hue Saturation Value (HSV) space are extracted to train a model in order to improve the accuracy of logistic regression. In addition, our method combines with saliency detection which is in line with human visual system (HVS). The saliency map contains more information of an image and is considered to be the most attractive region. Thus, a well-trained model is used to detect the saliency map of an input image. The saliency map is employed as a weighting function to reflect the important distortion brought by the local region. The first CNN structure includes two convolutional layers with maximum pooling, inception module and two fully connected layers. The second CNN structure only contains convolutional and pooling layers. Our proposed algorithm achieves a Pearson (Linear) Correlation Coefficient (LCC) of 0.964 and a Spearman's Rank Ordered Correlation Coefficient (SROCC) of 0.962 on the LIVE database, which demonstrates the excellent generalization ability in cross database experiment. Furthermore, we fine-tune a CNN model trained on LIVE database to predict multiply distorted image quality. Experiment result shows that our method outperforms the state-of-the-art methods on LIVE multiply distorted image database.

Keywords


Convolutional neural networks; NR-IQA; Multiply distorted image quality assessment; HSV; Saliency map

Citation Format:
Jian-Jun Li, Lan-Lan Xu, Zhi-Hui Wang, Chin-Chen Chang, "No-Reference Image Quality Assessment for Multiple Distortions Using Saliency Map Based on Dual-Convolutional Neural Networks," Journal of Internet Technology, vol. 18, no. 7 , pp. 1701-1710, Dec. 2017.

Full Text:

PDF

Refbacks

  • There are currently no refbacks.





Published by Executive Committee, Taiwan Academic Network, Ministry of Education, Taipei, Taiwan, R.O.C
JIT Editorial Office, Library and Information Center, National Dong Hwa University
No. 1, Sec. 2, Da Hsueh Rd. Shoufeng, Hualien 97401, Taiwan, R.O.C.
Tel: +886-3-931-7017  E-mail: jit.editorial@gmail.com