A Novel Cascading Scheme to Improve Speed and Accuracy of a VMMR System
Subject Areas : electrical and computer engineering
M.
Biglari
1
ali
Soleimani
2
H.
Hassanpour
3
(Shahrood University of Technology)
Abstract :
In the last decade, many researches have been done on fine-grained recognition. The main category of the object is known in this problem and the goal is to determine the subcategory or fine-grained category. Vehicle Make and Model Recognition (VMMR) is a hard fine-grained classification problem, due to the large number of classes, substantial inner-class and small inter-class distance. Furthermore, improving system accuracy leads to increasing in processing time. As we can see the state-of-the-art machine vision tool like convolutional neural networks lacks in real-time processing time. In this paper, a method has been presented briefly for VMMR firstly. Secondly, a cascading scheme for improving both speed and accuracy of this VMMR system has been proposed. In order to eliminate extra processing cost, the proposed cascading scheme applies classifiers to the input image in a sequential manner. Some effective criterions for an efficient ordering of classifiers are proposed and finally a fusion of them is used in the cascade algorithm. For evaluation purposes, a new dataset with more than 5000 vehicles of 28 different makes and models has been collected. The experimental results on this dataset and comprehensive CompCars dataset show outstanding performance of our approach. Our cascading scheme results up to 80% increase in the system processing speed.
[1] A. Krizhevsky, I. Sutskever, and G. E. Hinton, "Imagenet classification with deep convolutional neural networks," in Advances in Neural Information Processing Systems, pp. 1097-1105, 2012.
[2] P. Sermanet, D. Eigen, X. Zhang, M. Mathieu, R. Fergus, and Y. LeCun, OverFeat: Integrated Recognition, Localization and Detection Using Convolutional Networks, arXiv preprint arXiv: 1312.6229, 2013.
[3] Y. Zhou, L. Liu, L. Shao, and M. Mellor, DAVE: A Unified Framework for Fast Vehicle Detection and Annotation, arXiv: 1607.04564v2, 16 pp. , 2016.
[4] S. Ren, K. He, R. Girshick, and J. Sun, "Faster R-CNN: towards real-time object detection with region proposal networks," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 39, no. 6, pp. 1137-1149, Jun. 2017.
[5] Y. Jia, E. Shelhamer, J. Donahue, S. Karayev, J. Long, R. Girshick, S. Guadarrama, and T. Darrell, "Caffe: convolutional architecture for fast feature embedding," in Proc. of the 22nd ACM Int.Conf. on Multimedia, pp. 675-678, Nov. 2014.
[6] S. Tokui, K. Oono, S. Hido, and J. Clayton, "Chainer: a next-generation open source framework for deep learning," in Proc. of Workshop on Machine Learning Systems (LearningSys) in the 29th Annual Conf. on Neural Information Processing Systems, 6 pp., 2015.
[7] A. Vedaldi and K. Lenc, "Matconvnet: convolutional neural networks for matlab," in Proc. of the 23rd ACM Int. Conf. on Multimedia, pp. 689-692, Oct. 2015.
[8] M. Abadi, et al., "Tensorflow: a system for large-scale machine learning," in Proc. s of the 12th USENIX Conf. on Operating Systems Design and Implementation, OSDI'16, pp. 265-283, 2-4 Nov. 2016.
[9] S. Tulyakov, S. Jaeger, V. Govindaraju, and D. Doermann, "Review of classifier combination methods," Studies in Computational Intelligence, vol. 90, pp. 361-386, 2008.
[10] P. F. Felzenszwalb, R. B. Girshick, and D. McAllester, "Cascade object detection with deformable part models," in Proc. IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, pp. 2241-2248, Jun. 2010.
[11] P. Viola and M. Jones, "Rapid object detection using a boosted cascade of simple features," in Proc. IEEE Computer Society Conf. on Computer Vision and Pattern Recognition, vol. 1, pp. 511-518, Dec. 2001.
[12] B. Zhang, "Reliable classification of vehicle types based on cascade classifier ensembles," IEEE Trans. on Intelligent Transportation Systems, vol. 14, no. 1, pp. 322-332, Mar. 2013.
[13] M. Biglari, A. Soleimani, and H. Hassanpour, "Part-based recognition of vehicle make and model," IET Image Processing, vol. 11, no. 7, pp. 483-491, Mar. 2017.
[14] L. Yang, P. Luo, C. C. Loy, and X. Tang, "A large-scale car dataset for fine-grained categorization and verification," in Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 3973-3981, Jun. 2015.
[15] Multimedia Processing Lab, NTOU-MMR Dataset, http://mmplab.cs.ntou.edu.tw/mmplab/MMR/MMR.html (Accessed: Oct. 2016).
[16] J. Krause, H. Jin, J. Yang, and L. Fei-Fei, "Fine-grained recognition without part annotations," in Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 5546-5555, Jun. 2015.
[17] P. F. Felzenszwalb, R. B. Girshick, D. McAllester, and D. Ramanan, "Object detection with discriminatively trained part-based models," IEEE Trans. on Pattern Analysis and Machine Intelligence, vol. 32, no. 9, pp. 1627-1645, Sept. 2010.
[18] P. A. Savalle, S. Tsogkas, G. Papandreou, and I. Kokkinos, "Deformable part models with CNN features," in Proc. European Conf. on Computer Vision, Parts and Attributes Workshop, 5 pp., Sept. 2014.
[19] R. Girshick, F. Iandola, T. Darrell, and J. Malik, "Deformable part models are convolutional neural networks," in Proc. Proc. IEEE Conf. on Computer Vision and Pattern Recognition, pp. 437-446, Jun. 2015.
[20] –, The PASCAL Visual Object Classes, 2008, http://pascallin.ecs.soton.ac.uk/challenges/VOC/ (Accessed: 10 Mar. 2015).
[21] P. Felzenszwalb, D. McAllester, and D. Ramanan, "A discriminatively trained, multiscale, deformable part model," in IEEE Conf. on Computer Vision and Pattern Recognition, 8 pp., Jun. 2008.
[22] J. Platt, "Probabilistic outputs for support vector machines and comparisons to regularized likelihood methods," Advances in Large Margin Classifiers, vol. 10, no. 3, pp. 61-74, Mar. 1999.
[23] J. W. Hsieh, L. C. Chen, and D. Y. Chen, "Symmetrical SURF and its applications to vehicle detection and vehicle make and model recognition," IEEE Trans. on Intelligent Transportation Systems, vol. 15, no. 1, pp. 6-20, Feb. 2014.
[24] J. Fang, Y. Zhou, Y. Yu, and D. Sidan, "Fine-grained vehicle model recognition using a coarse-to-fine convolutional neural network architecture," IEEE Trans. on Intelligent Transportation Systems, vol. 18, no. 7, pp. 1782-1792, Jul. 2017.