Performance Evaluation on Resolution Time Prediction Using Machine Learning Techniques

Tong Tong-Ern - Multimedia University, 63100, Cyberjaya, Malaysia
Haw Su-Cheng - Multimedia University, 63100, Cyberjaya, Malaysia
Ng Kok-Why - Multimedia University, 63100, Cyberjaya, Malaysia
Mutaz Al-Tarawneh - Mutah University, 61710, Jordan
Tong Gee-Kok - Multimedia University, 63100, Cyberjaya, Malaysia


Citation Format:



DOI: http://dx.doi.org/10.62527/joiv.8.2.2305

Abstract


The quality of customer service emphasizes support tickets. An excellent support ticket system qualifies businesses to provide clients with the finest level of customer support. This enables enterprises to guarantee the consistency of quality customer service delivered successfully, ensuring all clients have a good experience regardless of the nature of their inquiry or issue. To further achieve a higher efficiency of resource allocation, this is when the prediction of ticket resolution time comes into place. The advancing technologies, including artificial intelligence (AI) and machine learning (ML), can perform predictions on the duration required to tackle specific problems based on past similar data. ML enables the possibility of automatically classifying tickets, making it possible to anticipate the time resolution for cases. This paper explores various ML techniques widely applied in the Resolution Time Prediction system and investigates the performance of three selected ML techniques via the benchmarking dataset obtained from the UCI Machine Learning Repository. Implementing selected techniques will involve creating a graphical user interface and data visualization to provide insight for data analysis. The best technique will be concluded after performing the ML technique evaluation. The evaluation metrics involved in this step include Root Mean Square Error (RMSE) and Root Mean Absolute Error (MAE). The experimental evaluation shows that the best performance among the selected ML techniques is Random Forest (RF). 

Keywords


Resolution Time Prediction; Machine Learning; Ticketing System; Customer Service; Recommender System

Full Text:

PDF

References


Y. Ayodeji, H. Rjoub, and H. Özgit, “Achieving sustainable customer loyalty in airports: The role of waiting time satisfaction and self-service technologies,” Technol Soc, vol. 72, 2023, doi: 10.1016/j.techsoc.2022.102106.

L. Jenneboer, C. Herrando, and E. Constantinides, “The Impact of Chatbots on Customer Loyalty: A Systematic Literature Review,” Journal of Theoretical and Applied Electronic Commerce Research, vol. 17, no. 1. 2022. doi: 10.3390/jtaer17010011.

H. Ng, M. S. Jalani, T. T. V. Yap, and V. T. Goh, “Performance of Sentiment Classification on Tweets of Clothing Brands,” Journal of Informatics and Web Engineering, vol. 1, no. 1, 2022, doi: 10.33093/jiwe.2022.1.1.2.

A. A. Zaveri, R. Mashood, S. Shehmir, M. Parveen, N. Sami, and M. Nazar, “AIRA: An Intelligent Recommendation Agent Application for Movies,” Journal of Informatics and Web Engineering, vol. 2, no. 2, 2023, doi: 10.33093/jiwe.2023.2.2.6.

N. A. Mahoto, R. Iftikhar, A. Shaikh, Y. Asiri, A. Alghamdi, and K. Rajab, “An intelligent business model for product price prediction using machine learning approach,” Intelligent Automation and Soft Computing, vol. 30, no. 1, 2021, doi: 10.32604/iasc.2021.018944.

P. Ambardekar, A. Jamthe, and M. Chincholkar, “Predicting defect resolution time using cosine similarity,” in Proceedings of 2017 International Conference on Data and Software Engineering, ICoDSE 2017, 2018. doi: 10.1109/ICODSE.2017.8285884.

M. F. Bergeron et al., “Machine Learning in Modeling High School Sport Concussion Symptom Resolve,” Med Sci Sports Exerc, vol. 51, no. 7, 2019, doi: 10.1249/MSS.0000000000001903.

F. Al-Hawari and H. Barham, “A machine learning based help desk system for IT service management,” Journal of King Saud University - Computer and Information Sciences, vol. 33, no. 6, 2021, doi: 10.1016/j.jksuci.2019.04.001.

S. Fuchs, C. Drieschner, and H. Wittges, “Improving Support Ticket Systems Using Machine Learning: A Literature Review,” in Proceedings of the Annual Hawaii International Conference on System Sciences, 2022. doi: 10.24251/hicss.2022.238.

I. L. Sharon Christa and V. Suma, “Predictive analytics in IT Service Management (ITSM),” in Data Mining and Machine Learning Applications, 2022. doi: 10.1002/9781119792529.ch7.

S. C. Haw, K. Ong, L. J. Chew, K. W. Ng, P. Naveen, and E. A. Anaam, “Improving the Prediction Resolution Time for Customer Support Ticket System,” Journal of System and Management Sciences, vol. 12, no. 6, 2022, doi: 10.33168/JSMS.2022.0601.

L. S. B. Pereira, R. Pizzio, S. Bonho, L. M. F. De Souza, and A. C. A. Junior, “Machine Learning for Classification of IT Support Tickets,” in 2023 International Conference on Cyber Management and Engineering, CyMaEn 2023, 2023. doi: 10.1109/CyMaEn57228.2023.10051041.

M. F. Bin Harunasir, N. Palanichamy, S. C. Haw, and K. W. Ng, “Sentiment Analysis of Amazon Product Reviews by Supervised Machine Learning Models,” Journal of Advances in Information Technology, vol. 14, no. 4, 2023, doi: 10.12720/jait.14.4.857-862.

C. Miloudi, L. Cheikhi, A. Abran, and A. Idri, “Maintenance Effort Estimation for Open-Source Software: Current trends,” in CEUR Workshop Proceedings, 2022.

M. Mamedov, K. Vorontsova, E. Treshcheva, and I. Itkin, “Building a Reusable Defect Resolution Time Prediction Model Based on a Massive Open-Source Dataset: An Industrial Report,” in Proceedings - 3rd IEEE International Conference on Artificial Intelligence Testing, AITest 2021, 2021. doi: 10.1109/AITEST52744.2021.00023.

M. K. Yucel and A. Tosun, “Measuring Bug Reporter’s Reputation and Its Effect on Bug Resolution Time Prediction,” in Proceedings - 7th International Conference on Computer Science and Engineering, UBMK 2022, 2022. doi: 10.1109/UBMK55850.2022.9919454.

Y. Yang and W. Chen, “Taiga: Performance optimization of the C4.5 decision tree construction algorithm,” Tsinghua Sci Technol, vol. 21, no. 4, 2016, doi: 10.1109/TST.2016.7536719.

P. Mahajan, S. Uddin, F. Hajati, and M. A. Moni, “Ensemble Learning for Disease Prediction: A Review,” Healthcare (Switzerland), vol. 11, no. 12. 2023. doi: 10.3390/healthcare11121808.

J. J. Liu and J. C. Liu, “Permeability Predictions for Tight Sandstone Reservoir Using Explainable Machine Learning and Particle Swarm Optimization,” Geofluids, vol. 2022, 2022, doi: 10.1155/2022/2263329.

D. Pfahl, S. Karus, and M. Stavnycha, “Improving expert prediction of issue resolution time,” in ACM International Conference Proceeding Series, 2016. doi: 10.1145/2915970.2916004.

M. S. Rahaman, Y. Ren, M. Hamilton, and F. D. Salim, “Wait time prediction for airport taxis using weighted nearest neighbor regression,” IEEE Access, vol. 6, 2018, doi: 10.1109/ACCESS.2018.2882580.

D. Zuev, A. Kalistratov, and A. Zuev, “Machine Learning in IT Service Management,” in Procedia Computer Science, 2018. doi: 10.1016/j.procs.2018.11.063.

A. I. Kyritsis and M. Deriaz, “A machine learning approach to waiting time prediction in queueing scenarios,” in Proceedings - 2019 2nd International Conference on Artificial Intelligence for Industries, AI4I 2019, 2019. doi: 10.1109/AI4I46381.2019.00013.

E. Benevento, D. Aloini, N. Squicciarini, R. Dulmin, and V. Mininno, “Queue-based features for dynamic waiting time prediction in emergency department,” Measuring Business Excellence, vol. 23, no. 4, 2019, doi: 10.1108/MBE-12-2018-0108.

G. Bejarano, A. Kulkarni, X. Luo, A. Seetharam, and A. Ramesh, “DeepER: A Deep Learning based Emergency Resolution Time Prediction System,” in 2020 International Conferences on Internet of Things (iThings) and IEEE Green Computing and Communications (GreenCom) and IEEE Cyber, Physical and Social Computing (CPSCom) and IEEE Smart Data (SmartData) and IEEE Congress on Cybermatics (Cybermatics), IEEE, Nov. 2020, pp. 490–497. doi: 10.1109/iThings-GreenCom-CPSCom-SmartData-Cybermatics50389.2020.00090.

A. Pak, B. Gannon, and A. Staib, “Predicting waiting time to treatment for emergency department patients,” Int J Med Inform, vol. 145, 2021, doi: 10.1016/j.ijmedinf.2020.104303.

H. Hijry and R. Olawoyin, “Predicting Patient Waiting Time in the Queue System Using Deep Learning Algorithms in the Emergency Room,” International Journal of Industrial Engineering and Operations Management, vol. 03, no. 01, 2021, doi: 10.46254/j.ieom.20210103.

J. Azimjonov and T. Kim, “Stochastic gradient descent classifier-based lightweight intrusion detection systems using the efficient feature subsets of datasets,” Expert Syst Appl, vol. 237, 2024, doi: 10.1016/j.eswa.2023.121493.

Y. Arouri and M. Sayyafzadeh, “An adaptive moment estimation framework for well placement optimization,” Comput Geosci, vol. 26, no. 4, 2022, doi: 10.1007/s10596-022-10135-9.

K. Gayathri Devi, K. Balasubramanian, C. Senthilkumar, and K. Ramya, “Accurate Prediction and Classification of Corn Leaf Disease Using Adaptive Moment Estimation Optimizer in Deep Learning Networks,” Journal of Electrical Engineering and Technology, vol. 18, no. 1, 2023, doi: 10.1007/s42835-022-01205-0.

Z. W. Wang, J. W. Lu, and J. Zhou, “Learning Adaptive Gradients for Binary Neural Networks,” Tien Tzu Hsueh Pao/Acta Electronica Sinica, vol. 51, no. 2, 2023, doi: 10.12263/DZXB.20211084.

J. Ma, X. Zeng, X. Xue, and R. Deng, “Metro Emergency Passenger Flow Prediction on Transfer Learning and LSTM Model,” Applied Sciences (Switzerland), vol. 12, no. 3, 2022, doi: 10.3390/app12031644.

J. Schad, R. Sambasivan, and C. Woodward, “Predicting help desk ticket reassignments with graph convolutional networks,” Machine Learning with Applications, vol. 7, 2022, doi: 10.1016/j.mlwa.2021.100237.

M.F. Claudio, S.M. Peres, “Incident management process enriched event log Data Set”, UCI Machine Learning Repository. Retrieved January 28, 2023, from https://archive.ics.uci.edu/ml/datasets/Incident%2Bmanagement%2Bprocess%2Benriched%2Bevent%2Blog#