Classifying Vehicle Types from Video Streams for Traffic Flow Analysis Systems

Imran B. Mu’azam - Center of Intelligent and Autonomous Systems (CIAS), Faculty of Computer Science and Information Technology, Universiti Tun Hussein Onn Malaysia, Parit Raja 86400, Johor, Malaysia.
Nor Fatihah Ismail - Center of Intelligent and Autonomous Systems (CIAS), Faculty of Computer Science and Information Technology, Universiti Tun Hussein Onn Malaysia, Parit Raja 86400, Johor, Malaysia.
Salama A. Mostafa - Center of Intelligent and Autonomous Systems (CIAS), Faculty of Computer Science and Information Technology, Universiti Tun Hussein Onn Malaysia, Parit Raja 86400, Johor, Malaysia.
Zirawani Baharum - Malaysian Institute of Industrial Technology, Universiti Kuala Lumpur, Persiaran Sinaran Ilmu, Bandar Seri Alam, 81750 Johor, Malaysia
Taufik Gusman - Department of Information Technology, Politeknik Negeri Padang, Sumatera Barat, Indonesia
Dewi Nasien - Department of Informatic Engineering, Faculty of Computer Science, Institut Bisnis dan Teknologi Pelita Pekanbaru, Pekanbaru, Indonesia


Citation Format:



DOI: http://dx.doi.org/10.30630/joiv.6.1.739

Abstract


This paper proposes a vehicle types classification modelfrom video streams for improving Traffic Flow Analysis (TFA) systems. A Video Content-based Vehicles Classification (VC-VC) model is used to support optimization for traffic signal control via online identification of vehicle types.The VC-VC model extends several methods to extract TFA parameters, including the background image processing, object detection, size of the object measurement, attention to the area of interest, objects clash or overlap handling, and tracking objects. The VC-VC model undergoes the main processing phases: preprocessing, segmentation, classification, and tracks. The main video and image processing methods are the Gaussian function, active contour, bilateral filter, and Kalman filter. The model is evaluated based on a comparison between the actual classification by the model and ground truth. Four formulas are applied in this project to evaluate the VC-VC model’s performance: error, average error, accuracy, and precision. The valid classification is counted to show the overall results. The VC-VC model detects and classifies vehicles accurately. For three tested videos, it achieves a high classification accuracy of 85.94% on average. The precession for the classification of the three tested videos is 92.87%. The results show that video 1 and video 3 have the most accurate vehicle classification results compared to video 2. It is because video 2 has more difficult camera positioning and recording angle and more challenging scenarios than the other two. The results show that it is difficult to classify vehicles based on objects size measures. The object's size is adjustable based on the camera altitude and zoom setting. This adjustment is affecting the accuracy of vehicles classification.

Keywords


Traffic flow analysis; vehicle types classification; segmentation; active contour.

Full Text:

PDF

References


M. A. Ali, H. E. Abd El Munim, A. H. Yousef and S. Hammad, "A Deep Learning Approach for Vehicle Detection." 2018 13th International Conference on Computer Engineering and Systems (ICCES). IEEE, 2018.

N. O. Alsrehin, A. F. Klaib, and A. Magableh, Intelligent transportation and control systems using data mining and machine learning techniques: A comprehensive study. IEEE Access, 7, 49830-49857, 2019.

M. Eom, and B. I. Kim. The traffic signal control problem for intersections: a review. European transport research review, 12(1), 1-20, 2020.

B. W. Hartill, S. M. Taylor, K. Keller, and M. S. Weltersbach, Digital camera monitoring of recreational fishing effort: applications and challenges. Fish and Fisheries, 21(1), 204-215, 2020.

K. Gwilliam. Urban transport in developing countries. Transport Reviews, 23(2), 197-216, 2003.

J. Lee, and A. C. Bovik, Estimation and analysis of urban traffic flow. In 2009 16th IEEE International Conference on Image Processing (ICIP) IEEE, (pp. 1157-1160) 2009.

R. Velazquez-Pupo, A. Sierra-Romero, D. Torres-Roman, Y. V. Shkvarko, J. Santiago-Paz, D. Gómez-Gutiérrez, ... and M. Romero-Delgado. Vehicle detection with occlusion handling, tracking, and OC-SVM classification: A high performance vision-based system. Sensors, 18(2), 374, 2018.

G. Zhang, R. P. Avery, and Y. Wang. Video-based vehicle detection and classification system for real-time traffic data collection using uncalibrated video cameras. Transportation research record, 1993(1), 138-147, 2007.

Abdulrahim, Khairi, and Rosalina Abdul Salam. "Traffic surveillance: A review of vision-based vehicle detection, recognition and tracking." International Journal of Applied Engineering Research 11.1: 713-726, 2016.

V. Kocur, and M. FtáÄnik. Detection of 3D bounding boxes of vehicles using perspective transformation for accurate speed measurement. Machine Vision and Applications, 31(7), 1-15, 2020.

J. Sochor, R. Juránek, J. Å paňhel, L. Maršík, A. Å iroký, A. Herout, and P. ZemÄík. Comprehensive data set for automatic single camera visual speed measurement. IEEE Transactions on Intelligent Transportation Systems, 20(5), 1633-1643, 2018.

S. Das, J. Saikia, S. Das, and N. A. Goni. Comparative study of different noise filtering techniques in digital images. International Journal of Engineering Research and General Science, 3(5), 180-191, 2015.

N. Xu, N. Ahuja, and R. Bansal. Object segmentation using graph cuts based active contours. Computer Vision and Image Understanding, 107(3), 210-224, 2007.

N. Al Khater, and R. E. Overill. Network traffic classification techniques and challenges. In 2015 Tenth international conference on digital information management (ICDIM) (pp. 43-48). IEEE, October 2015.

S. A. Kashinath, S. A. Mostafa, A. Mustapha, H. Mahdin, D. Lim, M. A. Mahmoud, ... and T. J. Yang. Review of Data Fusion Methods for Real-Time and Multi-Sensor Traffic Flow Analysis. IEEE Access, 2021.

D. S. Lee. Effective Gaussian mixture learning for video background subtraction. IEEE transactions on pattern analysis and machine intelligence, 27(5), 827-832, 2005.

A. ThaeerHammid, O. I. Awad, M. H. Sulaiman, S. S. Gunasekaran, S. A. Mostafa, N. Manoj Kumar, B. A. Khalaf, Y. A. Al-Jawhar, and R. A. Abdulhasan. A Review of Optimization Algorithms in Solving Hydro Generation Scheduling Problems. Energies, 13(11), 2787, 2020.

A. B. Annasaheb, V. K. Verma. Data mining classification techniques: A recent survey. International Journal of Emerging Technologies in Engineering Research, 4(8), 51-54, 2016.

S. García, S. Ramírez-Gallego, J. Luengo, J. M. Benítez, and F. Herrera. Big data preprocessing: methods and prospects. Big Data Analytics, 1(1), 1-22, 2016.

W. Zhang, G. Tan, H. M. Shi, and M. W. Lin. A Distributed Threshold Algorithm for Vehicle Classification Based on Binary Proximity Sensors and Intelligent Neuron Classifier. J. Inf. Sci. Eng., 26(3), 769-783, 2010.

N. A. Mohd, S. A. Mostafa, A. Mustapha, A. A. Ramli, M. A. Mohammed, and N. M. Kumar. Vehicles Counting from Video Stream for Automatic Traffic flow Analysis Systems. International Journal, 8(1.1), 2020.

J. Azzeh, B. Zahran, and Z. Alqadi. Salt and Pepper Noise: Effects and Removal. JOIV: International Journal on Informatics Visualization, 2(4), 252-256, 2018.

C. Yi, and J. Cho. Real-time Estimation of Road Surfaces using Fast Monocular Depth Estimation and Normal Vector Clustering. JOIV: International Journal on Informatics Visualization, 5(3), 206-211, 2021.

A. M. Aljamal, H. M. Abdelghaffar, and H. A. Rakha. Developing a neural–Kalman filtering approach for estimating traffic stream density using probe vehicle data. Sensors, 19(19), 4325, 2019.