Improving the Architecture of Convolutional Neural Network for Classification of Images Corrupted by Impulse Noise
Subject Areas : electrical and computer engineering
Mohammad Momeny
1
,
M. Agha Sarram
2
,
A. M. Latif
3
*
,
R. Sheikhpour
4
1 - Yazd University
2 - Yazd University
3 - Yazd University
4 - دانشگاه اردكان
Keywords: Impulse noiseconvolutional neural networkimage classificationnoise identification,
Abstract :
Impulse noise is one the common noises which reduces the performance of convolutional neural networks (CNNs) in image classification. Preprocessing for removal of impulse noise is a costly process which may have a destructive effect on the training and validation of the convolutional neural networks due to insufficient improvement of noisy images. In this paper, a convolutional neural network is proposed which is robust to impulse noise. Proposed CNN classify images corrupted by impulse noise without any preprocessing for noise removal. A noise detection layer is placed at the beginning of the proposed CNN to prevent the processing of noisy values. The ILSVRC-2012 database is used to train the proposed CNN. Experimental results show that preventing the impact of impulse noise on the training process and classification of CNN can increase the accuracy and speed of the network training. The proposed CNN with error of 0.24 is better than other methods in classification of noisy image corrupted by impulse noise with 10% density. The time complexity of O(1) in the proposed CNN for robustness to noise indicates the superiority of the proposed CNN.
[1] Z. Zhang, D. Han, J. Dezert, and Y. Yang, "A new adaptive switching median filter for impulse noise reduction with pre-detection based on evidential reasoning," Signal Processing, vol. 147, pp. 173-189, Jun. 2018.
[2] K. H. Jin and J. C. Ye, "Sparse and low-rank decomposition of a hankel structured matrix for impulse noise removal," IEEE Trans. Image Process., vol. 27, no. 3, pp. 1448-1461, Nov. 2018.
[3] I. Turkmen, "The ANN based detector to remove random-valued impulse noise in images," J. Vis. Commun. Image Represent., vol. 34, pp. 28-36, Jan. 2016.
[4] S. Liang, S. Lu, J. Chang, and C. C. T. Lin, "A novel two-stage impulse noise removal technique based on neural networks and fuzzy decision," IEEE Trans. on Fuzzy Systems, vol. 16, no. 4, pp. 863-873, Aug. 2008.
[5] Y. Hou, Z. Li, P. Wang, and W. Li, "Skeleton optical spectra-based action recognition using convolutional neural networks," IEEE Trans. Circuits Syst. Video Technol., vol. 28, no. 3, pp. 807-811, Nov. 2018.
[6] C. Ding and D. Tao, "Trunk-branch ensemble convolutional neural networks for video-based face recognition," IEEE Trans. Pattern Anal. Mach. Intell., vol. 40, no. 4, pp. 1002-1014, May 2018.
[7] L. C. Chen, G. Papandreou, I. Kokkinos, K. Murphy, and A. L. Yuille, "DeepLab: semantic image segmentation with deep convolutional nets, atrous convolution, and fully connected CRFs," IEEE Trans. Pattern Anal. Mach. Intell., vol. 40, no. 4, pp. 834-848, Apr. 2018.
[8] G. Lin, Q. Wu, L. Qiu, and X. Huang, "Image super-resolution using a dilated convolutional neural network," Neurocomputing, vol. 275, pp. 1219-1230, Jan. 2018.
[9] S. Yu, S. Jia, C. Xu, "Convolutional neural networks for hyperspectral image classification," Neurocomputing, vol. 219, pp. 88-98, Jan. 2016.
[10] K. Audhkhasi, O. Osoba, B. Kosko, "Noise-enhanced convolutional neural networks," Neural Networks, vol.78, pp. 15-23, Jun. 2016.
[11] W. Zhang, L. Jin, E. Song, and X. Xu, "Removal of impulse noise in color images based on convolutional neural network," Applied Soft Computing, vol. 82, Article No. 105558, Sept. 2019.
[12] L. Jin, W. Zhang, G. Ma, and N. Song, "Learning deep CNNs for impulse noise removal in images," Journal of Visual Communication and Image Representation, vol. 62, pp. 193-205, Jul. 2019.
[13] J. Yim and K. A. Sohn, "Enhancing the performance of convolutional neural networks on quality degraded datasets," in Int. Conf. Digit. Image Comput. Tech. Appl., DICTA'17, 8 pp., Sydney, NSW, Australia, 29 Nov.-1 Dec. 2017.
[14] I. F. Jafar, R. A. Alna'Mneh, and K. A. Darabkh, "Efficient improvements on the BDND filtering algorithm for the removal of high-density impulse noise," IEEE Trans. Image Process., vol. 22, no. 3, pp. 1223-1232, Nov. 2013.
[15] S. Q. Yuan and Y. H. Tan, "Impulse noise removal by a global-local noise detector and adaptive median filter," Signal Processing, vol. 86, no. 8, pp. 2123-2128, Aug. 2006.
[16] D. Ze-Feng, Y. Zhou-Ping, and X. You-Lun, "High probability impulse noise-removing algorithm based on mathematical morphology," IEEE Signal Process. Lett., vol. 14, no. 1, pp. 31-34, Jan. 2007.
[17] K. S. Srinivasan and D. Ebenezer, "A new fast and efficient decision-based algorithm for removal of high-density impulse noises," IEEE Signal Process. Lett., vol. 14, no. 3, pp. 189-192, Mar. 2007.
[18] S. Esakkirajan, T. Veerakumar, A. N. Subramanyam, and C. H. PremChand, "Removal of high density salt and pepper noise through modified decision based unsymmetric trimmed median filter," IEEE Signal Process. Lett., vol. 18, no. 5, pp. 287-290, Mar. 2011.
[19] G. Yu, S. Niu, and J. Ma, "A hybrid spectral gradient method for removing salt-and-pepper impulse noise," in Proc. 4th Int. Congress on Image and Signal Processing, pp. 765-768, Shanghai, China, 15-17 Oct. 2011.
[20] P. Shanmugavadivu and P. S. Eliahim Jeevaraj, "Fixed-value impulse noise suppression for images using PDE based adaptive two-stage median filter," in Proc. Int. Conf. on Computer, Communication and Electrical Technology, ICCCET'11, pp. 290-295, Tamilnadu, India, 18-19 Mar. 2011.
[21] X. Zhang and Y. Xiong, "Impulse noise removal using directional difference based noise detector and adaptive weighted mean filter," IEEE Signal Process. Lett., vol. 16, no. 4, pp. 295-298, Apr. 2009.
[22] S. Sadeghi, A. Rezvanian, and E. Kamrani, "An efficient method for impulse noise reduction from images using fuzzy cellular automata," AEU-Int. J. Electron. Commun., vol. 66, no. 9, pp. 772-779, Sept. 2012.
[23] D. Androutsos, K. N. Plataniotis, and A. N. Venetsanopoulos, "Novel vector-based approach to color image retrieval using a vector angular-based distance measure," Comput. Vis. Image Underst., vol. 75, no. 1, pp. 46-58, Jul. 1999.
[24] T. Toffoli and N. Margolus, Cellular Automata Machines: A New Environment for Modeling, 1987.
[25] S. S. Wang and C. H. Wu, "A new impulse detection and filtering method for removal of wide range impulse noises," Pattern Recognit., vol. 42, no. 9, pp. 2194-2202, Sep. 2009.
[26] P. Y. Chen and C. Y. Lien, "An efficient edge-preserving algorithm for removal of salt-and-pepper noise," IEEE Signal Process. Lett., vol. 15, pp. 833-836, Dec. 2008.
[27] C. Szegedy, et al., "Going deeper with convolutions," in Proc. of the IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, CVPR'15, 9 pp., Boston, MA, USA, 7-12 Jun. 2015.
[28] J. Gu, et al., "Recent advances in convolutional neural networks," Pattern Recognit., vol. 77, pp. 354-377, May 2018.
[29] A. K. Samantaray, P. Kanungo, and B. Mohanty, "Neighbourhood decision based impulse noise filter," IET Image Process., vol. 12, no. 7, pp. 1222-1227, Jul. 2018.
[30] K. Simonyan and A. Zisserman, "Very Deep Convolutional Networks for Large-Scale Image Recognition," Sep. 2014.
[31] O. Russakovsky, et al., "ImageNet large scale visual recognition challenge," Int. J. Comput. Vis., vol. 115, no. 3, pp. 211-252, Dec. 2015.
[32] Y. LeCun, L. Bottou, Y. Bengio, and P. Haffner, "Gradient-based learning applied to document recognition," Proceedins of the IEEE, vol. 86, no. 11, pp. 2278-2324, Nov. 1998
[33] Y. Wang, A. Szlam, and G. Lerman, "Robust locally linear analysis with applications to image denoising and blind inpainting," SIAM J. Imaging Sci., vol. 6, no. 1, pp. 526-562, Jan. 2013.
[34] B. Dong, H. Ji, J. Li, Z. Shen, and Y. Xu, "Wavelet frame based blind image inpainting," Appl. Comput. Harmon. Anal., vol. 32, no. 2, pp. 268-279, May 2012.
[35] M. Yan, "Restoration of images corrupted by impulse noise and mixed gaussian impulse noise using blind inpainting," SIAM J. Imaging Sci., vol. 6, no. 3, pp. 1227-1245, Jan. 2013.
[36] J. Salmon, Z. Harmany, C. A. Deledalle, and R. Willett, "Poisson noise reduction with non-local PCA," J. Math. Imaging Vis., vol. 48, no. 2, pp. 279-294, Feb. 2014.