Optimization of Historic Buildings Recognition: CNN Model and Supported by Pre-processing Methods

Abdul Rangkuti - Bina Nusantara University, Jakarta,11480, Indonesia
Varyl Hasbi Athala - Bina Nusantara University, Jakarta,11480, Indonesia
Farrel Haridhi Indallah - Bina Nusantara University, Jakarta,11480, Indonesia
Evawaty Tanuar - Bina Nusantara University, Jakarta,11480, Indonesia
Johan Muliadi Kerta - Bina Nusantara University, Jakarta,11480, Indonesia


Citation Format:



DOI: http://dx.doi.org/10.30630/joiv.7.4.01359

Abstract


Several cities in Indonesia, such as Cirebon, Bandung, and Bogor, have several historical buildings that date back to the Dutch colonial period. Several Dutch colonial heritage buildings can be found in several areas. The existence of historical buildings also would attract foreign or local tourists who visit one of an area. We need a technology or model that would support the recognition and identification of buildings, including their characteristics. However, recognizing and identifying them is a problem in itself, so technology would be needed to help them. The technology or model that would be implemented in this research is the Convolutional Neural Network model, a derivative of Artificial Intelligent technology focused on image processing and pattern recognition. This process consists of several stages. The initial stage uses the Gaussian Blur, SuCK, and CLAHE methods which are useful for image sharpening and recognition. The second process is feature extraction of the image characteristics of buildings. The results of the image process will support the third process, namely the image retrieval process of buildings based on their characteristics. Based on these three main processes, they would facilitate and support local and foreign tourists to recognize historic buildings in the area. In this experiment, the Euclidean distance and Manhattan distance methods were used in the retrieval process. The highest accuracy in the retrieval process for the feature extraction process with the DenseNet 121 model with the initial process is Gaussian Blur of 88.96% and 88.46%, with the SuCK method of 88.3 and 87.8%, and with CLAHE of 87.7%, and 87.6%. We hope that this research can be continued to identify buildings with more complex characteristics and models.

Keywords


Historical building; SuCK; CLAHE; gaussian blur; convolutional neural network; artificial intelligent

Full Text:

PDF

References


E. Andiyan, A., & Budianto, “Penerapan Konsep Arsitektur Kontemporer pada Penataan Cagar Budaya Situ Tasikardi,” vol. 6, no. 6, p. 6, 2021, [Online.]

K. P. dan Kebudayaan., “Undang-undang Republik Indonesia Nomor 11 Tahun 2010 Tentang Cagar Budaya,” Undang. Republik Indones. Nomor 11 Tahun 2010 Tentang Cagar Budaya, p. 13, 2011.

K. D. Rahmat, “Pelestarian Cagar Budaya Melalui Pemanfaatan Pariwisata Berkelanjutan,” Jurnal Pariwisata Terapan, vol. 5, no. 1, p. 26, Nov. 2021, doi: 10.22146/jpt.58505.

S. Rahardjo, “Beberapa Permasalahan Pelestarian Kawasan Cagar Budaya Dan Strategi Solusinya,” Jurnal Konservasi Cagar Budaya, vol. 7, no. 2, pp. 4–17, Mar. 2013, doi:10.33374/jurnalkonservasicagarbudaya.v7i2.109.

R. Parhani, “Manajemen Pengelolaan Objek Wisata Kota Tua Jakarta Berbasis Masyarakat,” p. 6, 2016.

M. F. Rizqullah and W. Swasty, “Perancangan Media Informasi Kota Tua Jakarta Utara Melalui Sign System Yang Terintegrasi Website,” Andharupa: Jurnal Desain Komunikasi Visual & Multimedia, vol. 5, no. 02, pp. 210–225, Sep. 2019, doi: 10.33633/andharupa.v5i2.1957.

d. R. Aditia, “klasterisasi pengenalan situs bersejarah kota magelang berbasis web dengan menggunakan algoritma k- medoid,” 2019.

Y. N. Tonapa, S. M. , Dwight M. Rondonuwu, and S. M. , Dr. Aristotulus E. Tungka, “Kajian Konservasi Bangunan Kuno Dan Kawasan Bersejarah Di Pusat Kota Lama Manado,” Spasial, vol. 2, no. 3, pp. 121–130, 2015.

L. Moya, F. Yamazaki, W. Liu, and M. Yamada, “Detection of collapsed buildings from lidar data due to the 2016 Kumamoto earthquake in Japan,” Natural Hazards and Earth System Sciences, vol. 18, no. 1, pp. 65–78, Jan. 2018, doi: 10.5194/nhess-18-65-2018.

C. Hörr, E. Lindinger, and G. Brunnett, “Machine learning based typology development in archaeology,” Journal on Computing and Cultural Heritage, vol. 7, no. 1, pp. 1–23, Feb. 2014, doi:10.1145/2533988.

Md. Samaun Hasan et al., “Heritage Building Era Detection using CNN,” IOP Conference Series: Materials Science and Engineering, vol. 617, no. 1, p. 012016, Sep. 2019, doi: 10.1088/1757-899x/617/1/012016.

X. Zhao, Z. Zou, N. Wang, and P. Zhao, “Feature recognition and detection for ancient architecture based on machine vision,” Smart Structures and NDE for Industry 4.0, Mar. 2018, doi:10.1117/12.2296543.

M. E. Hatir, M. Barstuğan, and İ. İnce, “Deep learning-based weathering type recognition in historical stone monuments,” Journal of Cultural Heritage, vol. 45, pp. 193–203, Sep. 2020, doi:10.1016/j.culher.2020.04.008.

Y. K. Yi, Y. Zhang, and J. Myung, “House style recognition using deep convolutional neural network,” Automation in Construction, vol. 118, p. 103307, Oct. 2020, doi: 10.1016/j.autcon.2020.103307.

O. S. Laptev and I. I. Bikmullina, “Sightseeing Application Based on Location Marking and Convolutional Neural Network Building Recognition,” 2020 International Russian Automation Conference (RusAutoCon), Sep. 2020, doi:10.1109/rusautocon49822.2020.9208062.

L. Zheng, P. Ai, and Y. Wu, “Building Recognition of UAV Remote Sensing Images by Deep Learning,” IGARSS 2020 - 2020 IEEE International Geoscience and Remote Sensing Symposium, Sep. 2020, doi: 10.1109/igarss39084.2020.9323322.

Y. Zeng, Y. Guo, and J. Li, “Recognition and extraction of high-resolution satellite remote sensing image buildings based on deep learning,” Neural Computing and Applications, vol. 34, no. 4, pp. 2691–2706, May 2021, doi: 10.1007/s00521-021-06027-1.

E. Maltezos, N. Doulamis, A. Doulamis, and C. Ioannidis, “Deep convolutional neural networks for building extraction from orthoimages and dense image matching point clouds,” Journal of Applied Remote Sensing, vol. 11, no. 04, p. 1, Dec. 2017, doi: 10.1117/1.jrs.11.042620.

N. Wang, X. Zhao, P. Zhao, Y. Zhang, Z. Zou, and J. Ou, “Automatic damage detection of historic masonry buildings based on mobile deep learning,” Automation in Construction, vol. 103, pp. 53–66, Jul. 2019, doi: 10.1016/j.autcon.2019.03.003.

M. E. Hatir, M. Barstuğan, and İ. İnce, “Deep learning-based weathering type recognition in historical stone monuments,” Journal of Cultural Heritage, vol. 45, pp. 193–203, Sep. 2020, doi: 10.1016/j.culher.2020.04.008.

N. Wang, X. Zhao, Z. Zou, P. Zhao, and F. Qi, “Autonomous damage segmentation and measurement of glazed tiles in historic buildings via deep learning,” Computer-Aided Civil and Infrastructure Engineering, vol. 35, no. 3, pp. 277–291, Aug. 2019, doi: 10.1111/mice.12488.

Y. Xiong, Q. Chen, M. Zhu, Y. Zhang, and K. Huang, “Accurate Detection of Historical Buildings Using Aerial Photographs and Deep Transfer Learning,” IGARSS 2020 - 2020 IEEE International Geoscience and Remote Sensing Symposium, Sep. 2020, doi: 10.1109/igarss39084.2020.9323541.

M. Sun, F. Zhang, F. Duarte, and C. Ratti, “Understanding architecture age and style through deep learning,” Cities, vol. 128, p. 103787, Sep. 2022, doi: 10.1016/j.cities.2022.103787.

N. Ibrahim, A. ElFarag, and R. Kadry, “Gaussian Blur through Parallel Computing,” Proceedings of the International Conference on Image Processing and Vision Engineering, 2021, doi: 10.5220/0010513301750179.

Munesh Singh Chauhan, “Optimizing Gaussian Blur Filter using CUDA Parallel Framework,” no. May, p. 442, 2018.

J. Ma, X. Fan, S. X. Yang, X. Zhang, and X. Zhu, “Contrast Limited Adaptive Histogram Equalization-Based Fusion in YIQ and HSI Color Spaces for Underwater Image Enhancement,” International Journal of Pattern Recognition and Artificial Intelligence, vol. 32, no. 07, p. 1854018, Mar. 2018, doi: 10.1142/s0218001418540186.

P. Lu and Q. Huang, “Robotic Weld Image Enhancement Based on Improved Bilateral Filtering and CLAHE Algorithm,” Electronics, vol. 11, no. 21, p. 3629, Nov. 2022, doi: 10.3390/electronics11213629.

N. Kaveri and N. B. Mustare, “Modified CNN Model for Malaria Diagnosis,” J. Posit. Sch. Psychol., no. July, 2022, [Online]. Available: https://www.researchgate.net/publication/361842000_Modified_CNN_Model_for_Malaria_Diagnosis.

J. L. Suárez-Díaz, S. García, and F. Herrera, “A Tutorial on Distance Metric Learning: Mathematical Foundations, Algorithms, Experimental Analysis, Prospects and Challenges (with Appendices on Mathematical Background and Detailed Algorithms Explanation),” 2018, [Online]. Available: http://arxiv.org/abs/1812.05944.

M. K. Gupta and P. Chandra, “Effects of similarity/distance metrics on k-means algorithm with respect to its applications in IoT and multimedia: a review,” Multimedia Tools and Applications, vol. 81, no. 26, pp. 37007–37032, Sep. 2021, doi: 10.1007/s11042-021-11255-7.

R. Suwanda, Z. Syahputra, and E. M. Zamzami, “Analysis of Euclidean Distance and Manhattan Distance in the K-Means Algorithm for Variations Number of Centroid K,” Journal of Physics: Conference Series, vol. 1566, no. 1, p. 012058, Jun. 2020, doi: 10.1088/1742-6596/1566/1/012058.

A. Hafidz, D. I. Mulyana, D. B. Sumantri, and K. S. Nugroho, “Identification of Buni Fruit Image Using Euclidean Distance Method,” SinkrOn, vol. 7, no. 2, pp. 392–398, Mar. 2022, doi: 10.33395/sinkron.v7i2.11333.

T. M. Ghazal et al., “Performances of K-Means Clustering Algorithm with Different Distance Metrics,” Intelligent Automation & Soft Computing, vol. 29, no. 3, pp. 735–742, 2021, doi: 10.32604/iasc.2021.019067.

G. Feng, Z. Jiang, X. Tan, and F. Cheng, “Hierarchical Clustering-Based Image Retrieval for Indoor Visual Localization,” Electronics, vol. 11, no. 21, p. 3609, Nov. 2022, doi: 10.3390/electronics11213609.

L. Zheng, Y. Yang, and A. G. Hauptmann, “Person Re-identification: Past, Present and Future.”

P. Marchwica, M. Jamieson, and P. Siva, “An Evaluation of Deep CNN Baselines for Scene-Independent Person Re-Identification.”

F. A. Irawan and D. A. Rochmah, “Penerapan Algoritma CNN Untuk Mengetahui Sentimen Masyarakat Terhadap Kebijakan Vaksin Covid-19,” Jurnal Informatika, vol. 9, no. 2, pp. 148–158, Oct. 2022, doi: 10.31294/inf.v9i2.13257.

V. R. Joseph and A. Vakayil, “SPlit: An Optimal Method for Data Splitting,” Technometrics, vol. 64, no. 2, pp. 166–176, Jun. 2021, doi: 10.1080/00401706.2021.1921037.

D. Han, Q. Liu, and W. Fan, “A new image classification method using CNN transfer learning and web data augmentation,” Expert Systems with Applications, vol. 95, pp. 43–56, Apr. 2018, doi: 10.1016/j.eswa.2017.11.028.

A. H. Rangkuti, V. H. Atthala, E. Tanuar, and J. M. Kerta, “Performance Evaluation of traditional Clothes pattern retrieval with CNN Model and Distance Matrices,” pp. 1–9, 2020.