A Robust License Plate Detection System Using Smart Device

Muhammad Darwish Bin Mohamad Azhar - Multimedia University, Jalan Ayer Keroh Lama, 75450 Melaka, Malaysia
Kah Ong Michael Goh - Multimedia University, Jalan Ayer Keroh Lama, 75450 Melaka, Malaysia
Law Check Yee - Multimedia University, Jalan Ayer Keroh Lama, 75450 Melaka, Malaysia
Tee Connie - Multimedia University, Jalan Ayer Keroh Lama, 75450 Melaka, Malaysia

Citation Format:

DOI: http://dx.doi.org/10.62527/joiv.8.2.2287


The license plate recognition (LPR) system is widely employed in various applications. However, most research studies have used a fixed camera rather than a moving one. This is because the location of the vehicle plate is nearly static and easily estimated, making the use of a static camera simple for locating and detecting the scanned license plate. Images obtained with a moving camera are highly complex due to frequent background changes. Additionally, a challenge with car plates in Malaysia is their non-standardized nature. Car owners are permitted to use any font type for their license plate number, rendering existing license plate recognition systems from other countries incapable of effectively detecting license plates on Malaysian car plates. A traditional LPR system typically requires a high-quality camera and a powerful computer for costly and bulky processing. Nowadays, many smartphones come equipped with powerful processors and cameras. Android smartphones include various libraries for modifying hardware configurations such as the camera. This paper presents a robust method for detecting Malaysia's license plate number using a convolutional neural network (CNN). The CNN model from the pre-training process is imported to the Android device and tested in real-time in an on-road driving environment, resulting in an average recognition rate of 89.37%. A comprehensive Character Recognition Analysis is also presented to demonstrate the accuracy of each character. However, there is still room for improvement in recognizing the character Q.


License Plate Recognition (LPR); Convolution Neural Network (CNN); Tesseract OCR

Full Text:



Sci, vol. 167, pp. 2623–2633, 2020, doi: 10.1016/j.procs.2020.03.324.

S. M. Silva and C. R. Jung, “A Flexible Approach for Automatic License Plate Recognition in Unconstrained Scenarios,” IEEE Transactions on Intelligent Transportation Systems, vol. 23, no. 6, pp. 5693–5703, Jun. 2022, doi: 10.1109/TITS.2021.3055946.

F. Sultan, K. Khan, Y. A. Shah, M. Shahzad, U. Khan, and Z. Mahmood, “Towards Automatic License Plate Recognition in Challenging Conditions,” Applied Sciences, vol. 13, no. 6, p. 3956, Mar. 2023, doi: 10.3390/app13063956.

N.-A.- Alam, M. Ahsan, Md. A. Based, and J. Haider, “Intelligent System for Vehicles Number Plate Detection and Recognition Using Convolutional Neural Networks,” Technologies (Basel), vol. 9, no. 1, p. 9, Jan. 2021, doi: 10.3390/technologies9010009.

A. Pattanaik and R. C. Balabantaray, “Enhancement of license plate recognition performance using Xception with Mish activation function,” Multimed Tools Appl, vol. 82, no. 11, pp. 16793–16815, May 2023, doi: 10.1007/s11042-022-13922-9.

A. Ammar, A. Koubaa, W. Boulila, B. Benjdira, and Y. Alhabashi, “A Multi-Stage Deep-Learning-Based Vehicle and License Plate Recognition System with Real-Time Edge Inference,” Sensors, vol. 23, no. 4, p. 2120, Feb. 2023, doi: 10.3390/s23042120.

S. Zhang, X. Lu, and Z. Lu, “Improved CNN-based CatBoost model for license plate remote sensing image classification,” Signal Processing, vol. 213, p. 109196, Dec. 2023, doi: 10.1016/j.sigpro.2023.109196.

A. S. Rawat, H. Devrani, A. Yaduvanshi, M. Bohra, I. Kumar, and T. Singh, “Surveillance System using Moving Vehicle Number Plate Recognition,” in 2023 2nd International Conference on Edge Computing and Applications (ICECAA), IEEE, Jul. 2023, pp. 940–945. doi: 10.1109/ICECAA58104.2023.10212426.

T. E. de Campos, “Character Recognition in Natural Images,” 2009. [Online]. Available: http://www.ee.surrey.ac.uk/CVSSP/demos/chars74k/