Automated Staging of Diabetic Retinopathy Using Convolutional Support Vector Machine (CSVM) Based on Fundus Image Data

Dian C Rini Novitasari - UIN Sunan Ampel Surabaya, Surabaya, Indonesia
Fatmawati Fatmawati - Universitas Airlangga, Surabaya, Indonesia
Rimuljo Hendradi - Universitas Airlangga, Surabaya, Indonesia
Rinda Nariswari - Bina Nusantara University, Jakarta, Indonesia
Rizal Saputra - Bina Sarana Informatics University, Sukabumi, Indonesia


Citation Format:



DOI: http://dx.doi.org/10.30630/joiv.7.4.01501

Abstract


Diabetic Retinopathy (DR) is a complication of diabetes mellitus, which attacks the eyes and often leads to blindness. The number of DR patients is significantly increasing because some people with diabetes are not aware that they have been affected by complications due to chronic diabetes. Some patients complain that the diagnostic process takes a long time and is expensive. So, it is necessary to do early detection automatically using Computer-Aided Diagnosis (CAD). The DR classification process based on these several classes has several steps: preprocessing and classification. Preprocessing consists of resizing and augmenting data, while in the classification process, CSVM method is used. The CSVM method is a combination of CNN and SVM methods so that the feature extraction and classification processes become a single unit. In the CSVM process, the first stage is extracting convolutional features using the existing architecture on CNN. CSVM could overcome the shortcomings of CNN in terms of training time. CSVM succeeded in accelerating the learning process and did not reduce the accuracy of CNN's results in 2 class, 3 class, and 5 class experiments. The best result achieved was at 2 class classification using CSVM with data augmentation which had an accuracy of 98.76% with a time of 8 seconds. On the contrary, CNN with data augmentation only obtained an accuracy of 86.15% with a time of 810 minutes 14 seconds. It can be concluded that CSVM was faster than CNN, and the accuracy obtained was also better to classify DR.

Keywords


CNN; CSVM; diabetic retinopathy; feature learning; SVM

Full Text:

PDF

References


Y. Zheng, S. H. Ley, and F. B. Hu, “Global aetiology and epidemiology of type 2 diabetes mellitus and its complications,” Nat. Rev. Endocrinol., vol. 14, no. 2, p. 88, 2018.

S. D. Solomon et al., “Diabetic retinopathy: a position statement by the American Diabetes Association,” Diabetes Care, vol. 40, no. 3, pp. 412–418, 2017.

E. J. Duh, J. K. Sun, and A. W. Stitt, “Diabetic retinopathy: current understanding, mechanisms, and treatment strategies,” JCI Insight, vol. 2, no. 14, Jul. 2017, doi: 10.1172/jci.insight.93751.

D. S. W. Ting, G. C. M. Cheung, and T. Y. Wong, “Diabetic retinopathy: global prevalence, major risk factors, screening practices and public health challenges: a review,” Clinical & Experimental Ophthalmology, vol. 44, no. 4, pp. 260–277, Feb. 2016, doi: 10.1111/ceo.12696.

R. Raman, L. Gella, S. Srinivasan, and T. Sharma, “Diabetic retinopathy: An epidemic at home and around the world,” Indian J. Ophthalmol., vol. 64, no. 1, p. 69, 2016.

D. B. de Andrade Mendanha, M. M. Abrahão, M. M. C. Vilar, and J. J. N. Junior, “Risk factors and incidence of diabetic retinopathy,” Bras., vol. 75, no. 6, pp. 443–446, 2016.

J.-Z. Cheng et al., “Computer-aided diagnosis with deep learning architecture: applications to breast lesions in US images and pulmonary nodules in CT scans,” Sci. Rep., vol. 6, no. 1, pp. 1–13, 2016.

N. I. R. Yassin, S. Omran, E. M. F. El Houby, and H. Allam, “Machine learning techniques for breast cancer computer aided diagnosis using different image modalities: A systematic review,” Comput. Methods Programs Biomed., vol. 156, pp. 25–45, 2018.

K. Machhale, H. B. Nandpuru, V. Kapur, and L. Kosta, “MRI brain cancer classification using hybrid classifier (SVM-KNN),” 2015 International Conference on Industrial Instrumentation and Control (ICIC), May 2015, doi: 10.1109/iic.2015.7150592.

K. H. Jin, M. T. McCann, E. Froustey, and M. Unser, “Deep convolutional neural network for inverse problems in imaging,” IEEE Trans. Image Process., vol. 26, no. 9, pp. 4509–4522, 2017.

U. R. Acharya, S. L. Oh, Y. Hagiwara, J. H. Tan, and H. Adeli, “Deep convolutional neural network for the automated detection and diagnosis of seizure using EEG signals,” Comput. Biol. Med., vol. 100, pp. 270–278, 2018.

W. Alakwaa, M. Nassef, and A. Badr, “Lung cancer detection and classification with 3D convolutional neural network (3D-CNN),” Lung Cancer, vol. 8, no. 8, p. 409, 2017.

R. Ghosh, K. Ghosh, and S. Maitra, “Automatic detection and classification of diabetic retinopathy stages using CNN,” in 2017 4th International Conference on Signal Processing and Integrated Networks (SPIN), 2017, pp. 550–554.

G. Altan and Y. Kutlu, “Superiorities of deep extreme learning machines against convolutional neural networks,” Nat. Eng. Sci., vol. 3, no. 3, pp. 103–109, 2018.

A. Z. Foeady, D. C. R. Novitasari, A. H. Asyhar, and M. Firmansjah, “Automated Diagnosis System of Diabetic Retinopathy Using GLCM Method and SVM Classifier,” 2018 5th International Conference on Electrical Engineering, Computer Science and Informatics (EECSI), Oct. 2018, doi: 10.1109/eecsi.2018.8752726.

H. Khalil et al., “Classification of diabetic retinopathy types based on convolution neural network (CNN),” Menoufia J. Electron. Eng. Res., vol. 28, no. ICEEM2019-Special Issue, pp. 126–153, 2019.

A. F. Agarap, “An architecture combining convolutional neural network (CNN) and support vector machine (SVM) for image classification,” arXiv Prepr. arXiv1712.03541, 2017.

P. W. Mirowski, Y. LeCun, D. Madhavan, and R. Kuzniecky, “Comparing SVM and convolutional networks for epileptic seizure prediction from intracranial EEG,” in 2008 IEEE workshop on machine learning for signal processing, 2008, pp. 244–249.

L. Zhang, D. Zhang, and F. Tian, “SVM and ELM: Who Wins? Object recognition with deep convolutional features from ImageNet,” in Proceedings of ELM-2015 Volume 1, Springer, 2016, pp. 249–263.

W. Wang and A. Lo, “Diabetic Retinopathy: Pathophysiology and Treatments,” International Journal of Molecular Sciences, vol. 19, no. 6, p. 1816, Jun. 2018, doi: 10.3390/ijms19061816.

A. Rübsam, S. Parikh, and P. Fort, “Role of Inflammation in Diabetic Retinopathy,” International Journal of Molecular Sciences, vol. 19, no. 4, p. 942, Mar. 2018, doi: 10.3390/ijms19040942.

A. P. Cabrera, F. Monickaraj, S. Rangasamy, S. Hobbs, P. McGuire, and A. Das, “Do Genomic Factors Play a Role in Diabetic Retinopathy?,” Journal of Clinical Medicine, vol. 9, no. 1, p. 216, Jan. 2020, doi: 10.3390/jcm9010216.

X. Cai and J. F. McGinnis, “Diabetic Retinopathy: Animal Models, Therapies, and Perspectives,” Journal of Diabetes Research, vol. 2016, pp. 1–9, 2016, doi: 10.1155/2016/3789217.

J. Gu et al., “Recent advances in convolutional neural networks,” Pattern Recognition, vol. 77, pp. 354–377, May 2018, doi: 10.1016/j.patcog.2017.10.013.

S. Yu, D. Xiao, and Y. Kanagasingam, “Exudate detection for diabetic retinopathy with convolutional neural networks,” in 2017 39th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC), 2017, pp. 1744–1747.

R. Yamashita, M. Nishio, R. K. G. Do, and K. Togashi, “Convolutional neural networks: an overview and application in radiology,” Insights into Imaging, vol. 9, no. 4, pp. 611–629, Jun. 2018, doi: 10.1007/s13244-018-0639-9.

S. Albawi, T. A. Mohammed, and S. Al-Zawi, “Understanding of a convolutional neural network,” in 2017 International Conference on Engineering and Technology (ICET), 2017, pp. 1–6.

K. Murata, M. Mito, D. Eguchi, Y. Mori, and M. Toyonaga, “A single filter CNN performance for basic shape classification,” in 2018 9th International Conference on Awareness Science and Technology (iCAST), 2018, pp. 139–143.

H. Lin, Y. Hu, S. Chen, J. Yao, and L. Zhang, “Fine-grained classification of cervical cells using morphological and appearance based convolutional neural networks,” IEEE Access, vol. 7, pp. 71541–71549, 2019.

P. Ballester and R. M. Araujo, “On the performance of GoogLeNet and AlexNet applied to sketches,” 2016.

R. U. Khan, X. Zhang, and R. Kumar, “Analysis of ResNet and GoogleNet models for malware detection,” J. Comput. Virol. Hacking Tech., vol. 15, no. 1, pp. 29–37, 2019.

R. Joshi, “Smart Ship Detection using Transfer Learning with ResNet,” Int. Res. J. Eng. Technol., vol. 1870, pp. 1870–1874, 2008.

D. McNeely-White, J. R. Beveridge, and B. A. Draper, “Inception and ResNet features are (almost) equivalent,” Cogn. Syst. Res., vol. 59, pp. 312–318, 2020.

K. Hernandez-Diaz, F. Alonso-Fernandez, and J. Bigun, “Cross spectral periocular matching using resnet features,” in 2019 International Conference on Biometrics (ICB), 2019, pp. 1–7.

A. Kumar and A. Kalia, “Object classification: Performance evaluation of cnn based classifiers using standard object detection datasets,” Int. J. Adv. Sci. Technol., vol. 28, no. 16, pp. 135–143, 2019.

A. M. Rafi et al., “Application of DenseNet in Camera Model Identification and Post-processing Detection,” arXiv Prepr. arXiv1809.00576, 2018.

V. Jakkula, “Tutorial on support vector machine (svm),” Sch. EECS, Washingt. State Univ., vol. 37, 2006.

R. Saha, A. R. Chowdhury, S. Banerjee, and T. Chatterjee, “Detection of Retinal Abnormalities Using Machine Learning Methodologies,” Neural Netw. World, vol. 28, no. 5, pp. 457–471, 2018.

G. B. Berikol, O. Yildiz, and İ. T. Özcan, “Diagnosis of acute coronary syndrome with a support vector machine,” J. Med. Syst., vol. 40, no. 4, p. 84, 2016.

C. J. C. Burges, “A tutorial on support vector machines for pattern recognition,” Data Min. Knowl. Discov., vol. 2, no. 2, pp. 121–167, 1998.

Y. Zeng, X. Xu, Y. Fang, and K. Zhao, “Traffic sign recognition using deep convolutional networks and extreme learning machine,” in International Conference on Intelligent Science and Big Data Engineering, 2015, pp. 272–280.

D. C. Rini Novitasari, A. Z. Foeady, M. Thohir, A. Z. Arifin, K. Niam, and A. H. Asyhar, “Automatic Approach for Cervical Cancer Detection Based on Deep Belief Network (DBN) Using Colposcopy Data,” 2020 International Conference on Artificial Intelligence in Information and Communication (ICAIIC), Feb. 2020, doi: 10.1109/icaiic48513.2020.9065196.